-- Logs begin at Sun 2022-08-28 00:10:29 UTC, end at Sun 2022-08-28 01:10:17 UTC. -- Aug 28 00:40:23.635290 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 28 00:40:23.647418 dv-cinder-master-3-smb devstack@keystone.service[81503]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 28 00:40:23.648490 dv-cinder-master-3-smb devstack@keystone.service[81503]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 28 00:40:23 2022] *** Aug 28 00:40:23.648490 dv-cinder-master-3-smb devstack@keystone.service[81503]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 28 00:40:23.648490 dv-cinder-master-3-smb devstack@keystone.service[81503]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 28 00:40:23.648490 dv-cinder-master-3-smb devstack@keystone.service[81503]: nodename: dv-cinder-master-3-smb Aug 28 00:40:23.648490 dv-cinder-master-3-smb devstack@keystone.service[81503]: machine: x86_64 Aug 28 00:40:23.648490 dv-cinder-master-3-smb devstack@keystone.service[81503]: clock source: unix Aug 28 00:40:23.648490 dv-cinder-master-3-smb devstack@keystone.service[81503]: pcre jit disabled Aug 28 00:40:23.648490 dv-cinder-master-3-smb devstack@keystone.service[81503]: detected number of CPU cores: 4 Aug 28 00:40:23.648490 dv-cinder-master-3-smb devstack@keystone.service[81503]: current working directory: / Aug 28 00:40:23.648490 dv-cinder-master-3-smb devstack@keystone.service[81503]: detected binary path: /usr/bin/uwsgi-core Aug 28 00:40:23.649679 dv-cinder-master-3-smb devstack@keystone.service[81503]: your processes number limit is 47680 Aug 28 00:40:23.649679 dv-cinder-master-3-smb devstack@keystone.service[81503]: your memory page size is 4096 bytes Aug 28 00:40:23.649679 dv-cinder-master-3-smb devstack@keystone.service[81503]: detected max file descriptor number: 2048 Aug 28 00:40:23.649679 dv-cinder-master-3-smb devstack@keystone.service[81503]: lock engine: pthread robust mutexes Aug 28 00:40:23.649679 dv-cinder-master-3-smb devstack@keystone.service[81503]: thunder lock: enabled Aug 28 00:40:23.649679 dv-cinder-master-3-smb devstack@keystone.service[81503]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 28 00:40:23.649679 dv-cinder-master-3-smb devstack@keystone.service[81503]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 28 00:40:23.688487 dv-cinder-master-3-smb devstack@keystone.service[81503]: Python main interpreter initialized at 0x55c6088319c0 Aug 28 00:40:23.688487 dv-cinder-master-3-smb devstack@keystone.service[81503]: python threads support enabled Aug 28 00:40:23.688487 dv-cinder-master-3-smb devstack@keystone.service[81503]: your server socket listen backlog is limited to 100 connections Aug 28 00:40:23.688487 dv-cinder-master-3-smb devstack@keystone.service[81503]: your mercy for graceful operations on workers is 90 seconds Aug 28 00:40:23.688875 dv-cinder-master-3-smb devstack@keystone.service[81503]: mapped 403077 bytes (393 KB) for 2 cores Aug 28 00:40:23.688875 dv-cinder-master-3-smb devstack@keystone.service[81503]: *** Operational MODE: preforking *** Aug 28 00:40:23.689173 dv-cinder-master-3-smb devstack@keystone.service[81503]: *** uWSGI is running in multiple interpreter mode *** Aug 28 00:40:23.689173 dv-cinder-master-3-smb devstack@keystone.service[81503]: spawned uWSGI master process (pid: 81503) Aug 28 00:40:23.689465 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 28 00:40:23.691125 dv-cinder-master-3-smb devstack@keystone.service[81503]: spawned uWSGI worker 1 (pid: 81517, cores: 1) Aug 28 00:40:23.691125 dv-cinder-master-3-smb devstack@keystone.service[81503]: spawned uWSGI worker 2 (pid: 81518, cores: 1) Aug 28 00:40:23.691125 dv-cinder-master-3-smb devstack@keystone.service[81503]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 28 00:40:27.950709 dv-cinder-master-3-smb devstack@keystone.service[81518]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 00:40:27.950709 dv-cinder-master-3-smb devstack@keystone.service[81518]: from cryptography.utils import int_from_bytes Aug 28 00:40:27.951489 dv-cinder-master-3-smb devstack@keystone.service[81517]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 00:40:27.951489 dv-cinder-master-3-smb devstack@keystone.service[81517]: from cryptography.utils import int_from_bytes Aug 28 00:40:27.951906 dv-cinder-master-3-smb devstack@keystone.service[81518]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 00:40:27.951906 dv-cinder-master-3-smb devstack@keystone.service[81518]: from cryptography.utils import int_from_bytes Aug 28 00:40:27.952005 dv-cinder-master-3-smb devstack@keystone.service[81517]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 00:40:27.952005 dv-cinder-master-3-smb devstack@keystone.service[81517]: from cryptography.utils import int_from_bytes Aug 28 00:40:28.000869 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 28 00:40:28.001083 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 28 00:40:28.001168 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 28 00:40:28.001265 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 28 00:40:28.001331 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] command line args: [] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 28 00:40:28.001396 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] command line args: [] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 28 00:40:28.001463 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 28 00:40:28.001766 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ================================================================================ {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 28 00:40:28.001898 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 28 00:40:28.001898 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ================================================================================ {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 28 00:40:28.002018 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] admin_token = **** {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.002088 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] admin_token = **** {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.002153 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] config_dir = [] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.002286 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.002371 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] config_dir = [] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.002438 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] config_source = [] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.002501 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.002632 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] debug = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.002776 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] config_source = [] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.002776 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] debug = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.002916 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.004234 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.004341 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.004410 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.004477 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.004555 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.004669 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.004754 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.004832 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.004898 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.004969 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] list_limit = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.005037 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] list_limit = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.005095 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] log_config_append = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.005171 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] log_config_append = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.005246 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.005318 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.005390 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] log_dir = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.005454 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] log_dir = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.005523 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] log_file = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.005591 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] log_file = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.005661 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.005725 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.005799 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.006082 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.006164 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.006237 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.006297 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.006358 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.006417 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.006476 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.006541 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.006606 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.006670 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.006734 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.006797 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.006864 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.006934 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.006999 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.007058 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.007115 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.007171 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.007228 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.007291 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.007350 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.007413 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.007472 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.007575 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.007708 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.007865 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.007956 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.008322 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.008427 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.008509 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] publish_errors = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.008582 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] publish_errors = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.008697 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.008795 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.008920 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.009016 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.009083 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.009147 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.009324 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.009426 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.009619 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.009766 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.009879 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] standard_threads = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.009970 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] standard_threads = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.010058 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.010131 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.010234 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.010340 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.010413 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.010486 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.010609 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] use_journal = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.010679 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] use_journal = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.010742 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] use_json = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.010812 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] use_json = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.010877 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] use_stderr = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.010945 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] use_stderr = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.011021 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] use_syslog = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.011093 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] use_syslog = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.011238 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.011336 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:40:28.011492 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.011574 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.011728 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.011809 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.011976 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.012073 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.012210 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.012298 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.012450 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.012537 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.012681 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.012765 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.012920 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.013008 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.013151 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.013229 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.013389 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.013467 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.013629 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.013706 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.013887 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.013982 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.014122 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.014200 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.014363 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.014447 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.014593 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.014678 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.014835 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.014913 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.015072 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.015155 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.015303 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.015381 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.015548 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.015624 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.015830 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.015905 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.016088 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.016168 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.016338 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.016415 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.016596 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.016674 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.016856 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.016935 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.017106 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.017183 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.017350 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.017438 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.017577 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.017667 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.017805 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.017916 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.018056 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.018147 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.018287 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.018363 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.018529 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.018605 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.018777 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.018913 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.019004 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.019080 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.019210 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.019301 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.019451 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.019540 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.019690 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.019766 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.019918 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.020001 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.020158 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.020245 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.020385 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.020463 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.020614 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.020692 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.020841 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.020930 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.021065 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.021148 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.021289 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.021365 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.021509 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.021663 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.021738 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.021807 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.021976 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.022072 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.022218 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.022314 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.022443 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.022520 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.022672 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.022750 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.022897 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.022986 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.023127 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.023205 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.023356 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.023433 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.023597 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.023715 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.023822 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.023899 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.024050 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.024127 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.024280 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.024365 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.024509 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.024587 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.024877 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.024977 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.025047 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.025118 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.025177 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.025236 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.025403 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.025485 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.025646 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.025777 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.025927 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.026039 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.026144 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.026223 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.026325 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.026411 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.026559 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.026641 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.026784 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.026861 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.027011 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.027130 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.027248 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.027346 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.027487 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.027574 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.027720 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.027826 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.027961 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.028047 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.028199 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.028275 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.028434 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.028519 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.028660 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.028740 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.028914 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.029051 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.029153 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.029285 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.029379 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.029455 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.029573 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.029647 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.029793 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.029896 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.030048 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.030131 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.030289 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.030377 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.030517 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.030635 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.030746 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.030866 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.030974 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.031052 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.031203 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.031283 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.031488 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.031634 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.031748 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.031988 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.032070 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.032235 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.032357 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.032474 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.032710 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.032788 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.032949 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.033146 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.033300 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.033403 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.033596 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.033674 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.033890 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.034065 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.034158 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.034315 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.034495 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.034581 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.034761 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.034926 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.035011 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.035217 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.035356 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.035462 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.035697 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.035782 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.035948 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.036204 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.036282 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.036449 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.036638 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.036838 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] auth.external = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.036918 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.037088 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.037174 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.037384 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.037537 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.037618 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] auth.password = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.037827 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] auth.token = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.038004 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.038093 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.038227 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.038308 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.038487 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.038578 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.038734 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.038814 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.038987 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.039069 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.039236 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.039317 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.039467 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.039593 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.039703 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] credential.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.039806 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] auth.external = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.039934 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.040012 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.040179 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.040257 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.040424 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.040506 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.040665 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] auth.password = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.040743 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.040902 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] auth.token = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.040986 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.041124 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.041203 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.041357 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.041436 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.041602 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.041681 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.041833 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.041957 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.042137 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.042223 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.042348 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.042428 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.042579 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.042660 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.042815 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] credential.caching = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.042895 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.043061 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.043141 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.043305 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.043388 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.043535 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] federation.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.043614 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.043771 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.043851 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.044008 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.044087 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.044240 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.044320 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.044465 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.044603 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.044711 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.044792 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.044940 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.045019 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.045188 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.045320 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.045444 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.045523 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.045658 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.045742 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.045915 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.045999 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.046165 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.046246 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.046404 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.046484 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.046641 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] federation.caching = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.046728 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.046876 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.046955 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.047136 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.047216 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.047372 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.047486 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.047623 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.047730 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.047851 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.047938 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.048087 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.048248 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.048348 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.048455 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.048582 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.048708 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.048832 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.048925 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.049068 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.049146 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.049300 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.049389 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.049533 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity.caching = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.049621 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.049777 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.049870 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.050044 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.050123 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.050279 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.050371 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.050512 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.050591 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.050756 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.050835 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.050984 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.051075 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.051218 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.051297 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.051463 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.051543 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.051704 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.051852 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.051941 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.052016 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.052137 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.052230 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.052362 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.052452 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.052599 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.052678 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.052838 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.052917 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.053066 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.053153 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.053312 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.053398 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.053551 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.053629 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.053781 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.053906 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.054055 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.054135 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.054284 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.054363 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.054510 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.054600 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.054743 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.054822 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.054967 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.055052 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.055199 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.055287 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.055435 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.055513 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.055670 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.055750 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.055902 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.055988 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.056128 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.056206 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.056368 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.056448 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.056609 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.056697 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.056838 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.056917 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.057071 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.057152 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.057308 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.057388 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.057537 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.057618 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.057769 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.057876 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.058017 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.058100 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.058250 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.058330 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.058479 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.058559 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.058711 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.058791 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.058944 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.059024 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.059177 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.059257 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.059417 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.059498 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.059657 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.059736 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.059885 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.059965 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.060112 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.060192 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.060336 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.060415 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.060570 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.060650 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.060800 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.060880 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.061030 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.061109 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.061258 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.061337 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.061479 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.061559 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.061714 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.061800 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.061985 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.062065 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.062210 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.062290 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.062451 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.062539 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.062709 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.062821 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.062955 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.063105 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.063286 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.063363 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.063436 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.063508 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.063611 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.063691 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.063842 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.063923 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.064072 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.064151 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.064296 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.064376 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.064535 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.064615 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.064769 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.064849 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.065001 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.065081 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.065235 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.065315 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.065466 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.065544 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.065686 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.065765 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.065944 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.066026 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.066176 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.066254 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.066419 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.066648 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.066727 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.066886 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.066965 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.067121 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.067495 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] resource.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.067581 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.067655 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.067655 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.067786 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.067858 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.067938 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.068047 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.068127 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.068270 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.068348 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.068512 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.068601 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.068744 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.068824 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.068975 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.069053 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.069204 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.069342 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.069472 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] role.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.069610 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.069737 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] role.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.069921 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.070047 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.070188 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.070315 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.070442 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.070568 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.070695 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] resource.caching = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.070821 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.071023 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.071152 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.071281 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.071416 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.071560 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.071699 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.071821 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.071949 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.072075 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.072199 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.072328 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.072463 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.072590 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.072715 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.072847 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.072974 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.073100 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.073244 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.073375 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] role.caching = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.073501 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.073628 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] role.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.073628 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.073878 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.074012 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.074137 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.074260 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.074386 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.074510 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.074633 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.074764 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.074895 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.075022 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.075146 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.075269 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.075393 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.075525 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.075649 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.075772 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.075895 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.076018 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.076145 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.076276 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.076402 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.076525 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.076665 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.076788 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.076911 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.077110 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.077237 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.077362 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.077487 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.077611 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.077742 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.077896 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.078021 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.078021 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.078337 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.078603 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.078887 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.079111 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] token.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.079287 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.079417 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.079492 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.079565 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.079647 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.079722 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.079843 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.079920 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.079993 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.079993 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.080133 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.080207 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.080279 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.080351 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.080423 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.080494 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.080574 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.080648 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.080720 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.080792 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.080863 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.080934 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.081013 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.081087 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.081159 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.081230 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.081301 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.081373 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] token.caching = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.081453 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.081526 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.081598 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.081679 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.081760 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.081833 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.081973 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.082063 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.082143 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.connection = **** {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.082216 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.082216 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.082340 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.082412 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.082492 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.082567 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.082638 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.082794 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.082874 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.083025 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.083112 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.083257 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.083336 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.083488 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.083567 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.083724 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.083813 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.083968 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.084048 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.084201 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.084280 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.084439 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.084527 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.084670 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.084757 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.084915 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.084995 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.connection = **** {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.085146 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.085235 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.085390 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.085480 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.085617 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.085696 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.085871 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.085956 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.086109 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.086200 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.086276 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 28 00:40:28.086349 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.086559 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.086787 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.087025 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.087254 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.087492 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.087721 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.087964 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.088195 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.088434 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.088662 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.088897 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.089127 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:40:28.089291 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 28 00:40:28.116237 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.116469 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.116694 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.117993 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.118224 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.118453 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.125208 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.126884 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.153334 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.153585 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.154347 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.154578 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.207125 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.207664 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.256128 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.256322 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.256490 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.256602 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.411529 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.411733 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.411950 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.412164 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.412349 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.412590 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.412724 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.412935 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.413157 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.413387 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.413655 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.413964 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.435704 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.435922 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.436047 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.436148 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.436216 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.436405 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.436534 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.436675 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.436992 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.437083 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.437212 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.437293 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.437415 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.437415 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.448481 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.448610 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.461461 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.461605 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.461819 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.461958 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.462085 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.462166 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.462230 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.462360 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.462448 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.462513 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.462630 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.462708 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.462826 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.462952 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:40:28.479870 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.480084 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.480185 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 28 00:40:28.480314 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 28 00:40:28.480399 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.480569 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 28 00:40:28.480656 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.480793 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 28 00:40:28.480877 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.481003 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.481096 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.481291 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.481546 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.481678 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.481757 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.481821 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.491249 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.491480 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.491606 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.491797 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.491926 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.492086 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.492220 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.492347 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.498971 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.499197 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.501874 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.502106 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.502233 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.502428 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.502553 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.502692 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.502878 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.502971 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.503098 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.503181 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.503302 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.503397 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.503530 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.503707 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.503834 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.503961 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.504099 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.504231 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.504361 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.504492 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.504621 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.504751 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.527149 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.527372 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.528609 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.528736 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.528884 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.529039 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.535071 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.535277 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.535430 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.535573 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.535736 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.535878 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.540429 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.540628 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.540722 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.540860 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.544762 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.544890 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.545040 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.545186 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.545435 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.545589 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.545669 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.545732 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.545902 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.546089 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.546198 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.546385 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.546648 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.548165 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.548461 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.548744 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.563932 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.564197 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.564376 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.564678 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.568106 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.569875 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.571314 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.571607 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.573819 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.574133 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.576284 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.579728 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.579856 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.583024 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.583152 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.583416 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.583700 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.583997 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.584270 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.584552 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.586157 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.586457 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.586736 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.587031 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.587307 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.587692 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.600567 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.600835 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.601132 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.601420 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.603654 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.603946 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.604208 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.604490 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.608301 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.609871 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.611432 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.611557 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.611704 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.613136 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.614369 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.614654 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.614779 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.614927 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.615069 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.615290 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.615593 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.617574 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.617874 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.618171 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.618446 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.618723 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.626699 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.626998 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.627377 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.627661 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.627958 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.628244 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.628528 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.630327 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.630606 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.630886 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.631149 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.631437 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.631712 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.631991 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.644065 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.646975 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.647322 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.649874 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.650319 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.651329 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.652942 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.653172 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.653299 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.653450 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.654626 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.656087 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.656420 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.656848 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.659979 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.661451 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.663448 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.664450 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.664750 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.664876 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.665100 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.665318 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.667760 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.668046 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.668333 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.668620 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.673121 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.673409 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.673684 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.676898 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.677184 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.677439 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.680542 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.680830 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.681119 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.681392 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.681665 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.681971 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.682263 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.682531 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.682796 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.683065 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.683297 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.683572 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.683851 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.684117 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.684302 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:40:28.684534 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.684815 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.685087 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.685359 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.685636 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.685967 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.686230 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.686482 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.686746 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.687009 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.687267 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.687587 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.687849 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:40:28.718141 dv-cinder-master-3-smb devstack@keystone.service[81517]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c6088319c0 pid: 81517 (default app) Aug 28 00:40:28.721907 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b67a6-3706-499e-82aa-ccf028a2c451 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:28.722196 dv-cinder-master-3-smb devstack@keystone.service[81518]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c6088319c0 pid: 81518 (default app) Aug 28 00:40:28.722321 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b67a6-3706-499e-82aa-ccf028a2c451 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:28.722439 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b67a6-3706-499e-82aa-ccf028a2c451 None None] PATH_INFO: `/v3` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:28.726648 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 791 bytes} [Sun Aug 28 00:40:28 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:40:35.324401 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36bff1-b060-4d19-a316-4e0e648e6ee8 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:35.325292 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36bff1-b060-4d19-a316-4e0e648e6ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:35.325292 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36bff1-b060-4d19-a316-4e0e648e6ee8 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:35.331006 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1/2] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:40:35 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:40:35.337341 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e4637-622d-46c5-9c7d-3622382ea1c1 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:35.338291 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e4637-622d-46c5-9c7d-3622382ea1c1 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:35.338291 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e4637-622d-46c5-9c7d-3622382ea1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:35.416175 dv-cinder-master-3-smb devstack@keystone.service[81517]: INFO dbcounter [None req-734e4637-622d-46c5-9c7d-3622382ea1c1 None None] Registered counter for database keystone Aug 28 00:40:35.437339 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG oslo_db.sqlalchemy.engines [None req-734e4637-622d-46c5-9c7d-3622382ea1c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 28 00:40:35.445555 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writer thread running {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 28 00:40:35.629048 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG passlib.handlers.bcrypt [None req-734e4637-622d-46c5-9c7d-3622382ea1c1 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81517) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 28 00:40:35.629388 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG passlib.handlers.bcrypt [None req-734e4637-622d-46c5-9c7d-3622382ea1c1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81517) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 28 00:40:35.685348 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-734e4637-622d-46c5-9c7d-3622382ea1c1 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:40:35.688198 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-734e4637-622d-46c5-9c7d-3622382ea1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:40:35.835595 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 2/3] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:40:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 500 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 28 00:40:36.389524 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36bff1-b060-4d19-a316-4e0e648e6ee8 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:36.466197 dv-cinder-master-3-smb devstack@keystone.service[81518]: INFO dbcounter [None req-6f36bff1-b060-4d19-a316-4e0e648e6ee8 None None] Registered counter for database keystone Aug 28 00:40:36.491373 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG oslo_db.sqlalchemy.engines [None req-6f36bff1-b060-4d19-a316-4e0e648e6ee8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 28 00:40:36.499422 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writer thread running {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 28 00:40:36.618080 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36bff1-b060-4d19-a316-4e0e648e6ee8 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:36.623637 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb967d-99d3-4af9-ad64-07835652a5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:36.624267 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb967d-99d3-4af9-ad64-07835652a5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:36.624542 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb967d-99d3-4af9-ad64-07835652a5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:36.625001 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb967d-99d3-4af9-ad64-07835652a5a4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:36.634344 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb967d-99d3-4af9-ad64-07835652a5a4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:36.685091 dv-cinder-master-3-smb devstack@keystone.service[81518]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3feb967d-99d3-4af9-ad64-07835652a5a4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 28 00:40:36.685367 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb967d-99d3-4af9-ad64-07835652a5a4 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:36.695914 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 2/4] 10.222.0.52 () {58 vars in 1324 bytes} [Sun Aug 28 00:40:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 00:40:36.705744 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e4637-622d-46c5-9c7d-3622382ea1c1 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:36.729754 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e4637-622d-46c5-9c7d-3622382ea1c1 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:36.736680 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51909b4-86dd-4ffe-a171-41483d17f80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:36.737792 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51909b4-86dd-4ffe-a171-41483d17f80f admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:36.738101 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51909b4-86dd-4ffe-a171-41483d17f80f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:36.738368 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51909b4-86dd-4ffe-a171-41483d17f80f admin admin] PATH_INFO: `/v3/projects/4e55fe92e3a24b25b164aeab879fa6da` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:36.740014 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51909b4-86dd-4ffe-a171-41483d17f80f admin admin] RBAC: Authorizing `identity:get_project(project_id=4e55fe92e3a24b25b164aeab879fa6da)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:36.791974 dv-cinder-master-3-smb devstack@keystone.service[81517]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f51909b4-86dd-4ffe-a171-41483d17f80f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 28 00:40:36.792286 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51909b4-86dd-4ffe-a171-41483d17f80f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:36.796910 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 3/5] 10.222.0.52 () {56 vars in 1207 bytes} [Sun Aug 28 00:40:36 2022] GET /identity/v3/projects/4e55fe92e3a24b25b164aeab879fa6da => generated 344 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:40:38.671025 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308039f-91db-4c71-83a6-6fbf6055d706 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:38.671938 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308039f-91db-4c71-83a6-6fbf6055d706 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:38.671938 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308039f-91db-4c71-83a6-6fbf6055d706 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:38.678579 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 3/6] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:40:38 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:40:38.688323 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d57f3-7401-42fc-909e-63f18be91a57 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:38.688735 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d57f3-7401-42fc-909e-63f18be91a57 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:38.688876 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d57f3-7401-42fc-909e-63f18be91a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:38.710121 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c65d57f3-7401-42fc-909e-63f18be91a57 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:40:38.711676 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c65d57f3-7401-42fc-909e-63f18be91a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:40:38.721492 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 4/7] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:40:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 28 00:40:39.012436 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4308039f-91db-4c71-83a6-6fbf6055d706 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:39.031305 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4308039f-91db-4c71-83a6-6fbf6055d706 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:39.039257 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aaa978-35cf-4fea-9c3f-16e20203271c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:39.040170 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aaa978-35cf-4fea-9c3f-16e20203271c admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:39.040465 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aaa978-35cf-4fea-9c3f-16e20203271c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:39.040721 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aaa978-35cf-4fea-9c3f-16e20203271c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:39.050474 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aaa978-35cf-4fea-9c3f-16e20203271c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:39.052311 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aaa978-35cf-4fea-9c3f-16e20203271c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:39.060970 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 4/8] 10.222.0.52 () {58 vars in 1324 bytes} [Sun Aug 28 00:40:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 00:40:39.067196 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d57f3-7401-42fc-909e-63f18be91a57 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:39.077345 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d57f3-7401-42fc-909e-63f18be91a57 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:39.083533 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cda47-c975-4538-8b72-cf68357b87e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:39.084156 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cda47-c975-4538-8b72-cf68357b87e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:39.084439 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cda47-c975-4538-8b72-cf68357b87e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:39.084707 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cda47-c975-4538-8b72-cf68357b87e6 admin admin] PATH_INFO: `/v3/users/f0ea7ade0fdf4b01bc4d2a18f09385cb` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:39.086144 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73cda47-c975-4538-8b72-cf68357b87e6 admin admin] RBAC: Authorizing `identity:get_user(user_id=f0ea7ade0fdf4b01bc4d2a18f09385cb)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:39.087988 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73cda47-c975-4538-8b72-cf68357b87e6 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:39.089556 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 5/9] 10.222.0.52 () {56 vars in 1198 bytes} [Sun Aug 28 00:40:39 2022] GET /identity/v3/users/f0ea7ade0fdf4b01bc4d2a18f09385cb => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:40:41.170274 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21616f-1828-44c2-b003-1b3df1b6cc83 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:41.170815 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21616f-1828-44c2-b003-1b3df1b6cc83 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:41.170815 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21616f-1828-44c2-b003-1b3df1b6cc83 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:41.172289 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 5/10] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:40:41.178222 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7157bd5-7e07-4f47-9053-f10be5363507 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:41.178657 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7157bd5-7e07-4f47-9053-f10be5363507 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:41.178758 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d6639-a426-451a-ba1b-c8357d1e7eb8 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:41.178847 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7157bd5-7e07-4f47-9053-f10be5363507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:41.178938 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d6639-a426-451a-ba1b-c8357d1e7eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:41.179158 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d6639-a426-451a-ba1b-c8357d1e7eb8 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:41.180371 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 6/11] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:40:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:40:41.185549 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d5e9a-5d61-48d5-b339-ee6f131c9472 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:41.185860 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d5e9a-5d61-48d5-b339-ee6f131c9472 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:41.186148 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d5e9a-5d61-48d5-b339-ee6f131c9472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:41.197815 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f7157bd5-7e07-4f47-9053-f10be5363507 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:40:41.199083 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f7157bd5-7e07-4f47-9053-f10be5363507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:40:41.228695 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG passlib.handlers.bcrypt [None req-1b5d5e9a-5d61-48d5-b339-ee6f131c9472 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81518) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 28 00:40:41.229125 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG passlib.handlers.bcrypt [None req-1b5d5e9a-5d61-48d5-b339-ee6f131c9472 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81518) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 28 00:40:41.274104 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-1b5d5e9a-5d61-48d5-b339-ee6f131c9472 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:40:41.275693 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1b5d5e9a-5d61-48d5-b339-ee6f131c9472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:40:41.281795 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 6/12] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:40:41.381589 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 7/13] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:40:41.549079 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7157bd5-7e07-4f47-9053-f10be5363507 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:41.574336 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:41.646288 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d5e9a-5d61-48d5-b339-ee6f131c9472 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:41.660542 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7157bd5-7e07-4f47-9053-f10be5363507 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:41.700854 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb15460-f8dc-42a3-8819-f382167ed7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:41.701486 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb15460-f8dc-42a3-8819-f382167ed7b9 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:41.701760 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb15460-f8dc-42a3-8819-f382167ed7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:41.702058 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb15460-f8dc-42a3-8819-f382167ed7b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:41.714938 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb15460-f8dc-42a3-8819-f382167ed7b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:40:41.724390 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-5bb15460-f8dc-42a3-8819-f382167ed7b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:40:41.724390 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:40:41.724390 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:40:41.724390 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:40:41.724390 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:40:41.724390 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:40:41.724390 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:40:41.724390 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:40:41.724390 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:40:41.724390 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:40:41.724390 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:40:41.724390 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:40:41.724390 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:40:41.724390 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:40:41.724390 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:40:41.724390 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:40:41.725346 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:40:41.725346 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:40:41.725346 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:40:41.725346 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:40:41.725346 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:40:41.725346 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:40:41.725346 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:40:41.725346 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:40:41.725346 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:40:41.725346 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:40:41.725346 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:40:41.725346 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:40:41.725346 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:40:41.725346 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:40:41.725346 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:40:41.725346 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:40:41.726377 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:40:41.726377 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:40:41.726377 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:40:41.726377 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:40:41.726377 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:40:41.726377 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:40:41.726377 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:40:41.726377 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:40:41.726377 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:40:41.726377 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:40:41.726377 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:40:41.726377 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:40:41.726377 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 7/14] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:40:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:40:41.731388 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb15460-f8dc-42a3-8819-f382167ed7b9 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:41.753404 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d5e9a-5d61-48d5-b339-ee6f131c9472 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:41.755882 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:41.794922 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb29d1-3aed-48ad-a759-9d19fcf9a7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:41.795697 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb29d1-3aed-48ad-a759-9d19fcf9a7f7 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:41.795978 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb29d1-3aed-48ad-a759-9d19fcf9a7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:41.796242 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb29d1-3aed-48ad-a759-9d19fcf9a7f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:41.815745 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:41.835425 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb15460-f8dc-42a3-8819-f382167ed7b9 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:41.864630 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb29d1-3aed-48ad-a759-9d19fcf9a7f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:41.866206 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb29d1-3aed-48ad-a759-9d19fcf9a7f7 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:41.869278 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b1891-ea63-402f-a069-9becc98ccc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:41.869908 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b1891-ea63-402f-a069-9becc98ccc96 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:41.870188 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b1891-ea63-402f-a069-9becc98ccc96 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:41.870452 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b1891-ea63-402f-a069-9becc98ccc96 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:41.871111 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b1891-ea63-402f-a069-9becc98ccc96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:40:41.871409 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b1891-ea63-402f-a069-9becc98ccc96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:41.872841 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b1891-ea63-402f-a069-9becc98ccc96 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:41.884484 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 8/15] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:40:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:40:41.890170 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b1891-ea63-402f-a069-9becc98ccc96 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:41.966682 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 8/16] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:40:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 00:40:41.972988 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb29d1-3aed-48ad-a759-9d19fcf9a7f7 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:41.975784 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:41.992711 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b1891-ea63-402f-a069-9becc98ccc96 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:42.025552 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405648b-b4b1-4f8b-9629-3494c8daf45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:42.026205 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405648b-b4b1-4f8b-9629-3494c8daf45b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:42.026488 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405648b-b4b1-4f8b-9629-3494c8daf45b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:42.026752 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405648b-b4b1-4f8b-9629-3494c8daf45b None admin] PATH_INFO: `/v3/users/f0ea7ade0fdf4b01bc4d2a18f09385cb` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:42.027883 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6405648b-b4b1-4f8b-9629-3494c8daf45b None admin] RBAC: Authorizing `identity:get_user(user_id=f0ea7ade0fdf4b01bc4d2a18f09385cb)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:42.029345 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6405648b-b4b1-4f8b-9629-3494c8daf45b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:42.030970 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 9/17] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:40:41 2022] GET /identity/v3/users/f0ea7ade0fdf4b01bc4d2a18f09385cb => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:40:42.036544 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405648b-b4b1-4f8b-9629-3494c8daf45b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:42.051400 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:42.072741 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb29d1-3aed-48ad-a759-9d19fcf9a7f7 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:42.105730 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e266f-822e-4309-9963-e895d7dc151e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:42.106621 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e266f-822e-4309-9963-e895d7dc151e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:42.106898 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e266f-822e-4309-9963-e895d7dc151e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:42.107170 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e266f-822e-4309-9963-e895d7dc151e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:42.127911 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e266f-822e-4309-9963-e895d7dc151e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:42.129864 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e266f-822e-4309-9963-e895d7dc151e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:42.138153 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405648b-b4b1-4f8b-9629-3494c8daf45b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:42.150128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-e77e266f-822e-4309-9963-e895d7dc151e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:40:42.150128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:40:42.150128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:40:42.150128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:40:42.150128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:40:42.150128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:40:42.150128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:40:42.150128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:40:42.150128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:40:42.150128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:40:42.150128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:40:42.150128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:40:42.150128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:40:42.150128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:40:42.150128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:40:42.150128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:40:42.150999 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:40:42.150999 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:40:42.150999 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:40:42.150999 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:40:42.150999 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:40:42.150999 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:40:42.150999 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:40:42.150999 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:40:42.150999 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:40:42.150999 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:40:42.150999 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:40:42.150999 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:40:42.150999 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:40:42.150999 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:40:42.150999 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:40:42.150999 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:40:42.150999 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:40:42.152003 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:40:42.152003 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:40:42.152003 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:40:42.152003 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 9/18] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:40:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:40:42.158788 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e266f-822e-4309-9963-e895d7dc151e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:42.175736 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a43cf0-8e3f-4b01-b7b4-b8aeb6f1d4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:42.176362 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a43cf0-8e3f-4b01-b7b4-b8aeb6f1d4f1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:42.176639 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a43cf0-8e3f-4b01-b7b4-b8aeb6f1d4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:42.176915 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a43cf0-8e3f-4b01-b7b4-b8aeb6f1d4f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:42.178122 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a43cf0-8e3f-4b01-b7b4-b8aeb6f1d4f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:42.179610 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a43cf0-8e3f-4b01-b7b4-b8aeb6f1d4f1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:42.181168 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 10/19] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:40:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:40:42.187096 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a43cf0-8e3f-4b01-b7b4-b8aeb6f1d4f1 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:42.217476 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:42.262250 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e266f-822e-4309-9963-e895d7dc151e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:42.270637 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:42.288931 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a43cf0-8e3f-4b01-b7b4-b8aeb6f1d4f1 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:42.298370 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f845a0-6475-4c40-a6df-3a4bf5a1f305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:42.298986 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f845a0-6475-4c40-a6df-3a4bf5a1f305 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:42.299268 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f845a0-6475-4c40-a6df-3a4bf5a1f305 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:42.299537 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f845a0-6475-4c40-a6df-3a4bf5a1f305 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:42.300185 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f845a0-6475-4c40-a6df-3a4bf5a1f305 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:40:42.300488 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f845a0-6475-4c40-a6df-3a4bf5a1f305 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:42.301975 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f845a0-6475-4c40-a6df-3a4bf5a1f305 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:42.319057 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 10/20] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:40:42.321299 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45b2b1-40b1-4908-869c-2959e8641c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:42.321943 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45b2b1-40b1-4908-869c-2959e8641c67 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:42.322224 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45b2b1-40b1-4908-869c-2959e8641c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:42.322497 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45b2b1-40b1-4908-869c-2959e8641c67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:42.323235 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45b2b1-40b1-4908-869c-2959e8641c67 None admin] RBAC: Adding query filter params (role.id=cc013581bb07418d9ec6a3a1d282ea53, scope.domain.id=default, user.id=f0ea7ade0fdf4b01bc4d2a18f09385cb) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:40:42.323562 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45b2b1-40b1-4908-869c-2959e8641c67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:42.325022 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45b2b1-40b1-4908-869c-2959e8641c67 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:42.332930 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 11/21] 10.222.0.52 () {56 vars in 1322 bytes} [Sun Aug 28 00:40:42 2022] GET /identity/v3/role_assignments?user.id=f0ea7ade0fdf4b01bc4d2a18f09385cb&scope.domain.id=default&role.id=cc013581bb07418d9ec6a3a1d282ea53 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:40:44.558720 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bed249-cddf-4433-8f28-29d64cc76a14 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:44.559205 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bed249-cddf-4433-8f28-29d64cc76a14 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:44.559276 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bed249-cddf-4433-8f28-29d64cc76a14 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:44.560601 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 11/22] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:40:44.571393 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963ee10-4183-4b7d-b569-42c1f96b023b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:44.572289 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963ee10-4183-4b7d-b569-42c1f96b023b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:44.572757 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963ee10-4183-4b7d-b569-42c1f96b023b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:44.595575 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-4963ee10-4183-4b7d-b569-42c1f96b023b None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:40:44.596790 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4963ee10-4183-4b7d-b569-42c1f96b023b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:40:44.688074 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 12/23] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:40:44.707201 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc72f33-8a99-4e7f-9477-f5baaa7ae456 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:44.707763 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc72f33-8a99-4e7f-9477-f5baaa7ae456 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:44.708228 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc72f33-8a99-4e7f-9477-f5baaa7ae456 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:44.709774 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 12/24] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:40:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:40:44.715150 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19bcac-716d-4013-8d7d-ac01de8ebee3 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:44.715437 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19bcac-716d-4013-8d7d-ac01de8ebee3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:44.715711 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19bcac-716d-4013-8d7d-ac01de8ebee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:44.738801 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-1c19bcac-716d-4013-8d7d-ac01de8ebee3 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:40:44.739998 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1c19bcac-716d-4013-8d7d-ac01de8ebee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:40:44.836968 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 13/25] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:40:44.898830 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e527e3d-73b3-4465-b446-262562abd90d None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:44.899277 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e527e3d-73b3-4465-b446-262562abd90d None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:44.899622 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e527e3d-73b3-4465-b446-262562abd90d None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:44.901052 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 13/26] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:40:44.906322 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d97c39-4654-4f1f-a7de-2e1903237fad None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:44.906710 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d97c39-4654-4f1f-a7de-2e1903237fad None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:44.907052 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d97c39-4654-4f1f-a7de-2e1903237fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:44.914513 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:44.934858 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-95d97c39-4654-4f1f-a7de-2e1903237fad None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:40:44.936060 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-95d97c39-4654-4f1f-a7de-2e1903237fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:40:45.049977 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 14/27] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:40:45.059725 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943de251-855a-4766-a5fa-51abf3305696 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:45.060132 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943de251-855a-4766-a5fa-51abf3305696 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:45.060456 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943de251-855a-4766-a5fa-51abf3305696 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:45.062578 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 14/28] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:40:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:40:45.083426 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7ab85-dbe5-48d1-a4fb-5635b746da23 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:45.083746 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7ab85-dbe5-48d1-a4fb-5635b746da23 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:45.083980 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7ab85-dbe5-48d1-a4fb-5635b746da23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:45.084163 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943de251-855a-4766-a5fa-51abf3305696 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:45.112615 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a3a7ab85-dbe5-48d1-a4fb-5635b746da23 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:40:45.119045 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a3a7ab85-dbe5-48d1-a4fb-5635b746da23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:40:45.279933 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 15/29] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:40:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:40:45.295496 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943de251-855a-4766-a5fa-51abf3305696 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:45.329875 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:45.353562 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f8962-09c7-4581-b56b-da3cf9462b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:45.354604 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f8962-09c7-4581-b56b-da3cf9462b25 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:45.355077 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f8962-09c7-4581-b56b-da3cf9462b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:45.355567 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f8962-09c7-4581-b56b-da3cf9462b25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:45.373371 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f8962-09c7-4581-b56b-da3cf9462b25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:45.375291 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f8962-09c7-4581-b56b-da3cf9462b25 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:45.380208 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7ab85-dbe5-48d1-a4fb-5635b746da23 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:45.395644 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-370f8962-09c7-4581-b56b-da3cf9462b25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:40:45.395644 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:40:45.395644 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:40:45.395644 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:40:45.395644 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:40:45.395644 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:40:45.395644 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:40:45.395644 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:40:45.395644 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:40:45.395644 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:40:45.395644 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:40:45.395644 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:40:45.395644 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:40:45.395644 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:40:45.395644 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:40:45.395644 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:40:45.396646 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:40:45.396646 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:40:45.396646 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:40:45.396646 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:40:45.396646 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:40:45.396646 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:40:45.396646 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:40:45.396646 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:40:45.396646 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:40:45.396646 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:40:45.396646 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:40:45.396646 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:40:45.396646 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:40:45.396646 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:40:45.396646 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:40:45.396646 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:40:45.396646 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:40:45.397604 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:40:45.397604 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:40:45.397604 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:40:45.397604 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 15/30] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:40:45.397604 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f8962-09c7-4581-b56b-da3cf9462b25 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:45.512203 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f8962-09c7-4581-b56b-da3cf9462b25 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:45.524677 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:45.561425 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c617cc-d844-4335-8300-d5ba5702d132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:45.562830 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c617cc-d844-4335-8300-d5ba5702d132 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:45.563470 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c617cc-d844-4335-8300-d5ba5702d132 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:45.563959 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c617cc-d844-4335-8300-d5ba5702d132 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:45.590253 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c617cc-d844-4335-8300-d5ba5702d132 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:40:45.604222 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-55c617cc-d844-4335-8300-d5ba5702d132 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:40:45.604222 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:40:45.604222 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:40:45.604222 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:40:45.604222 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:40:45.604222 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:40:45.604222 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:40:45.604222 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:40:45.604222 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:40:45.604222 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:40:45.604222 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:40:45.604222 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:40:45.604222 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:40:45.604222 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:40:45.604222 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:40:45.604222 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:40:45.605088 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:40:45.605088 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:40:45.605088 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:40:45.605088 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:40:45.605088 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:40:45.605088 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:40:45.605088 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:40:45.605088 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:40:45.605088 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:40:45.605088 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:40:45.605088 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:40:45.605088 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:40:45.605088 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:40:45.605088 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:40:45.605088 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:40:45.605088 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:40:45.605963 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:40:45.605963 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:40:45.605963 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:40:45.605963 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:40:45.605963 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:40:45.605963 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:40:45.605963 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:40:45.605963 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:40:45.605963 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:40:45.605963 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:40:45.605963 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:40:45.605963 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:40:45.608235 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 16/31] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:40:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:40:45.611901 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c617cc-d844-4335-8300-d5ba5702d132 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:45.620133 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7ab85-dbe5-48d1-a4fb-5635b746da23 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:45.667019 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:45.674035 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ecda2-1fa0-423c-87ad-201562e562ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:45.674691 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ecda2-1fa0-423c-87ad-201562e562ee None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:45.674967 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ecda2-1fa0-423c-87ad-201562e562ee None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:45.675239 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ecda2-1fa0-423c-87ad-201562e562ee None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:45.675959 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ecda2-1fa0-423c-87ad-201562e562ee None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:45.677412 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ecda2-1fa0-423c-87ad-201562e562ee None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:45.745717 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c617cc-d844-4335-8300-d5ba5702d132 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:45.780941 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3e251-c95b-4993-9ccc-3a401683e705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:45.782194 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3e251-c95b-4993-9ccc-3a401683e705 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:45.782668 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3e251-c95b-4993-9ccc-3a401683e705 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:45.783126 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3e251-c95b-4993-9ccc-3a401683e705 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:45.783991 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3e251-c95b-4993-9ccc-3a401683e705 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:40:45.784493 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3e251-c95b-4993-9ccc-3a401683e705 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:45.786109 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3e251-c95b-4993-9ccc-3a401683e705 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:45.798217 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 17/32] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:40:45.799311 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3e251-c95b-4993-9ccc-3a401683e705 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:45.822250 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 16/33] 10.222.0.52 () {60 vars in 1131 bytes} [Sun Aug 28 00:40:45 2022] POST /identity/v3/roles => generated 219 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:40:45.823457 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ecda2-1fa0-423c-87ad-201562e562ee None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:45.913241 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:45.943115 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3e251-c95b-4993-9ccc-3a401683e705 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:46.009521 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859f994-759c-41c5-9c76-ea2f98a5f96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:46.010165 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859f994-759c-41c5-9c76-ea2f98a5f96b None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:46.010439 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859f994-759c-41c5-9c76-ea2f98a5f96b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:46.010707 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859f994-759c-41c5-9c76-ea2f98a5f96b None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:46.011381 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859f994-759c-41c5-9c76-ea2f98a5f96b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:40:46.013102 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859f994-759c-41c5-9c76-ea2f98a5f96b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:46.014556 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859f994-759c-41c5-9c76-ea2f98a5f96b None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:46.024587 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ecda2-1fa0-423c-87ad-201562e562ee None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:46.049896 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 18/34] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:40:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:40:46.050756 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859f994-759c-41c5-9c76-ea2f98a5f96b None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:46.064908 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:46.081606 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88ec77-4a3d-4e70-b0f1-4e63dbfd096d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:46.082253 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88ec77-4a3d-4e70-b0f1-4e63dbfd096d None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:46.082532 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88ec77-4a3d-4e70-b0f1-4e63dbfd096d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:46.082801 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88ec77-4a3d-4e70-b0f1-4e63dbfd096d None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:46.083472 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88ec77-4a3d-4e70-b0f1-4e63dbfd096d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:46.085285 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88ec77-4a3d-4e70-b0f1-4e63dbfd096d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:46.104392 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 17/35] 10.222.0.52 () {60 vars in 1131 bytes} [Sun Aug 28 00:40:45 2022] POST /identity/v3/roles => generated 225 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:40:46.105327 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88ec77-4a3d-4e70-b0f1-4e63dbfd096d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:46.175764 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859f994-759c-41c5-9c76-ea2f98a5f96b None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:46.219877 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b777ec-bcba-4825-8302-8e23ba2f42b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:46.221085 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b777ec-bcba-4825-8302-8e23ba2f42b2 None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:46.221584 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b777ec-bcba-4825-8302-8e23ba2f42b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:46.222065 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b777ec-bcba-4825-8302-8e23ba2f42b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:46.223133 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b777ec-bcba-4825-8302-8e23ba2f42b2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:46.224799 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b777ec-bcba-4825-8302-8e23ba2f42b2 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:46.256327 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88ec77-4a3d-4e70-b0f1-4e63dbfd096d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:46.310886 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574babb-f9ab-4217-84cc-01512757d329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:46.311549 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574babb-f9ab-4217-84cc-01512757d329 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:46.313832 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574babb-f9ab-4217-84cc-01512757d329 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:46.313832 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574babb-f9ab-4217-84cc-01512757d329 None admin] PATH_INFO: `/v3/users/f0ea7ade0fdf4b01bc4d2a18f09385cb` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:46.314951 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574babb-f9ab-4217-84cc-01512757d329 None admin] RBAC: Authorizing `identity:get_user(user_id=f0ea7ade0fdf4b01bc4d2a18f09385cb)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:46.316463 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574babb-f9ab-4217-84cc-01512757d329 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:46.318280 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 18/36] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:40:46 2022] GET /identity/v3/users/f0ea7ade0fdf4b01bc4d2a18f09385cb => generated 247 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:40:46.319704 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41912e5-406b-4fac-a82e-2aaa36467b53 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:46.319989 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41912e5-406b-4fac-a82e-2aaa36467b53 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:46.320263 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41912e5-406b-4fac-a82e-2aaa36467b53 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:46.321487 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 19/37] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:40:46.326609 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41912e5-406b-4fac-a82e-2aaa36467b53 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:46.387363 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:46.401923 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 19/38] 10.222.0.52 () {60 vars in 1141 bytes} [Sun Aug 28 00:40:46 2022] POST /identity/v3/projects => generated 301 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:40:46.403524 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29683f27-0299-4b68-a4f0-7bacd3f753aa None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:46.403822 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29683f27-0299-4b68-a4f0-7bacd3f753aa None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:46.404103 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29683f27-0299-4b68-a4f0-7bacd3f753aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:46.411051 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:46.426817 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-29683f27-0299-4b68-a4f0-7bacd3f753aa None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:40:46.428626 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-29683f27-0299-4b68-a4f0-7bacd3f753aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:40:46.455256 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41912e5-406b-4fac-a82e-2aaa36467b53 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:46.496677 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc2712-894b-4bf2-96a1-0213ca41361e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:46.497263 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc2712-894b-4bf2-96a1-0213ca41361e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:46.497541 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc2712-894b-4bf2-96a1-0213ca41361e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:46.497817 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc2712-894b-4bf2-96a1-0213ca41361e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:46.499071 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc2712-894b-4bf2-96a1-0213ca41361e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:46.500820 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc2712-894b-4bf2-96a1-0213ca41361e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:46.502824 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 20/39] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:40:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:40:46.504042 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa0007-7bdc-4583-9851-80fe28008100 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:46.504322 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa0007-7bdc-4583-9851-80fe28008100 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:46.504593 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa0007-7bdc-4583-9851-80fe28008100 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:46.505820 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 21/40] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:40:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:40:46.510655 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa0007-7bdc-4583-9851-80fe28008100 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:46.527574 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 20/41] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:40:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:40:46.537015 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513feeb8-0e63-4e29-bff7-8dd7472e8b30 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:46.537015 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513feeb8-0e63-4e29-bff7-8dd7472e8b30 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:46.537015 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513feeb8-0e63-4e29-bff7-8dd7472e8b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:46.567118 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-513feeb8-0e63-4e29-bff7-8dd7472e8b30 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:40:46.568426 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-513feeb8-0e63-4e29-bff7-8dd7472e8b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:40:46.660725 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa0007-7bdc-4583-9851-80fe28008100 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:46.661806 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 21/42] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:40:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:40:46.684967 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:46.698212 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab9a6a-caf2-44fe-8155-12720d0c6ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:46.698875 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab9a6a-caf2-44fe-8155-12720d0c6ac9 None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:46.699158 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab9a6a-caf2-44fe-8155-12720d0c6ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:46.699434 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab9a6a-caf2-44fe-8155-12720d0c6ac9 None admin] PATH_INFO: `/v3/domains/default/users/f0ea7ade0fdf4b01bc4d2a18f09385cb/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:46.701393 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab9a6a-caf2-44fe-8155-12720d0c6ac9 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f0ea7ade0fdf4b01bc4d2a18f09385cb, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:46.703008 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab9a6a-caf2-44fe-8155-12720d0c6ac9 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:46.717335 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 22/43] 10.222.0.52 () {58 vars in 1361 bytes} [Sun Aug 28 00:40:46 2022] PUT /identity/v3/domains/default/users/f0ea7ade0fdf4b01bc4d2a18f09385cb/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:40:46.798190 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513feeb8-0e63-4e29-bff7-8dd7472e8b30 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:46.878406 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:46.920041 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513feeb8-0e63-4e29-bff7-8dd7472e8b30 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:46.936707 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab9a6a-caf2-44fe-8155-12720d0c6ac9 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:46.956687 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aecf34-7cd3-40fe-acc4-ca96d4e7cded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:46.957353 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aecf34-7cd3-40fe-acc4-ca96d4e7cded None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:46.957638 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aecf34-7cd3-40fe-acc4-ca96d4e7cded None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:46.957945 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aecf34-7cd3-40fe-acc4-ca96d4e7cded None admin] PATH_INFO: `/v3/domains/default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:46.959177 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aecf34-7cd3-40fe-acc4-ca96d4e7cded None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:46.960830 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aecf34-7cd3-40fe-acc4-ca96d4e7cded None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:46.963048 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 22/44] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:40:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:40:46.968992 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aecf34-7cd3-40fe-acc4-ca96d4e7cded None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:47.083149 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aecf34-7cd3-40fe-acc4-ca96d4e7cded None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:47.112634 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:47.119463 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea78f4-eeda-442d-8464-ef09a9610759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:47.120089 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea78f4-eeda-442d-8464-ef09a9610759 None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:47.120378 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea78f4-eeda-442d-8464-ef09a9610759 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:47.120932 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea78f4-eeda-442d-8464-ef09a9610759 None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:47.121603 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea78f4-eeda-442d-8464-ef09a9610759 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:47.123112 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea78f4-eeda-442d-8464-ef09a9610759 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:47.152308 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 23/45] 10.222.0.52 () {60 vars in 1141 bytes} [Sun Aug 28 00:40:46 2022] POST /identity/v3/projects => generated 312 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:40:47.158597 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab9a6a-caf2-44fe-8155-12720d0c6ac9 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:47.200743 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb862c9-f756-4a54-885e-f67453f8d4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:47.201775 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb862c9-f756-4a54-885e-f67453f8d4d3 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:47.202238 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb862c9-f756-4a54-885e-f67453f8d4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:47.202816 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb862c9-f756-4a54-885e-f67453f8d4d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:47.204382 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb862c9-f756-4a54-885e-f67453f8d4d3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:47.206359 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb862c9-f756-4a54-885e-f67453f8d4d3 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:47.225081 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 23/46] 10.222.0.52 () {60 vars in 1131 bytes} [Sun Aug 28 00:40:46 2022] POST /identity/v3/roles => generated 223 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:40:48.648637 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d1e46-cd71-4bd6-b150-c334bd32ae0f None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:48.649184 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d1e46-cd71-4bd6-b150-c334bd32ae0f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:48.649184 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d1e46-cd71-4bd6-b150-c334bd32ae0f None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:48.650714 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 24/47] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:40:48.656291 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee50c0-abb2-4337-939d-a3866af12d82 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:48.656712 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee50c0-abb2-4337-939d-a3866af12d82 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:48.656954 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee50c0-abb2-4337-939d-a3866af12d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:48.676174 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-5eee50c0-abb2-4337-939d-a3866af12d82 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:40:48.677686 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5eee50c0-abb2-4337-939d-a3866af12d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:40:48.715002 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:48.751289 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 24/48] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:40:49.028717 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d1e46-cd71-4bd6-b150-c334bd32ae0f None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:49.083896 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641cc4b-4b27-407d-9f30-30e81b680ee9 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:49.084204 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641cc4b-4b27-407d-9f30-30e81b680ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:49.084479 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641cc4b-4b27-407d-9f30-30e81b680ee9 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:49.085804 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 25/49] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:40:49.090796 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fb937-d747-483b-8b31-5cbee99ee660 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:49.091080 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fb937-d747-483b-8b31-5cbee99ee660 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:49.091348 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fb937-d747-483b-8b31-5cbee99ee660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:49.111100 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-4c6fb937-d747-483b-8b31-5cbee99ee660 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:40:49.112292 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4c6fb937-d747-483b-8b31-5cbee99ee660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:40:49.136598 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d1e46-cd71-4bd6-b150-c334bd32ae0f None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:49.170451 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2f8ac-8ea7-41e5-8716-843faae86c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:49.171386 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2f8ac-8ea7-41e5-8716-843faae86c4c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:49.171676 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2f8ac-8ea7-41e5-8716-843faae86c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:49.171950 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2f8ac-8ea7-41e5-8716-843faae86c4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:49.180392 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 26/50] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:40:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:40:49.182657 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2f8ac-8ea7-41e5-8716-843faae86c4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:40:49.187977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-84f2f8ac-8ea7-41e5-8716-843faae86c4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:40:49.187977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:40:49.187977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:40:49.187977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:40:49.187977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:40:49.187977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:40:49.187977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:40:49.187977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:40:49.187977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:40:49.187977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:40:49.187977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:40:49.187977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:40:49.187977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:40:49.187977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:40:49.187977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:40:49.187977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:40:49.188861 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:40:49.188861 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:40:49.188861 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:40:49.188861 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:40:49.188861 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:40:49.188861 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:40:49.188861 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:40:49.188861 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:40:49.188861 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:40:49.188861 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:40:49.188861 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:40:49.188861 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:40:49.188861 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:40:49.188861 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:40:49.188861 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:40:49.188861 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:40:49.189617 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:40:49.189617 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:40:49.189617 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:40:49.189617 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:40:49.189617 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:40:49.189617 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:40:49.189617 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:40:49.189617 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:40:49.189617 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:40:49.189617 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:40:49.189617 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:40:49.189617 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:40:49.189617 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 25/51] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:40:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:40:49.194807 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fb937-d747-483b-8b31-5cbee99ee660 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:49.291393 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:49.295154 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fb937-d747-483b-8b31-5cbee99ee660 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:49.330248 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f3fb3-ace6-465e-8330-d969fbf6ecd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:49.330860 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f3fb3-ace6-465e-8330-d969fbf6ecd0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:49.331141 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f3fb3-ace6-465e-8330-d969fbf6ecd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:49.331418 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f3fb3-ace6-465e-8330-d969fbf6ecd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:49.332085 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f3fb3-ace6-465e-8330-d969fbf6ecd0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:40:49.332394 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f3fb3-ace6-465e-8330-d969fbf6ecd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:49.333795 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f3fb3-ace6-465e-8330-d969fbf6ecd0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:49.342178 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 27/52] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:40:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:40:49.348347 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2f8ac-8ea7-41e5-8716-843faae86c4c None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:49.393034 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:49.445295 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f3fb3-ace6-465e-8330-d969fbf6ecd0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:49.450391 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2f8ac-8ea7-41e5-8716-843faae86c4c None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:49.485046 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960f8de-7a42-450d-a94a-a92aed74f4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:49.485769 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960f8de-7a42-450d-a94a-a92aed74f4d1 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:49.486120 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960f8de-7a42-450d-a94a-a92aed74f4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:49.486429 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960f8de-7a42-450d-a94a-a92aed74f4d1 None admin] PATH_INFO: `/v3/users/f0ea7ade0fdf4b01bc4d2a18f09385cb` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:49.488043 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4960f8de-7a42-450d-a94a-a92aed74f4d1 None admin] RBAC: Authorizing `identity:get_user(user_id=f0ea7ade0fdf4b01bc4d2a18f09385cb)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:49.489796 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4960f8de-7a42-450d-a94a-a92aed74f4d1 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:49.496279 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 26/53] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:40:49 2022] GET /identity/v3/users/f0ea7ade0fdf4b01bc4d2a18f09385cb => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:40:49.497447 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960f8de-7a42-450d-a94a-a92aed74f4d1 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:49.552178 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f3fb3-ace6-465e-8330-d969fbf6ecd0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:49.588585 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f242b4-e2fa-4c40-97e7-427a9392b22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:49.589216 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f242b4-e2fa-4c40-97e7-427a9392b22b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:49.589492 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f242b4-e2fa-4c40-97e7-427a9392b22b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:49.589761 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f242b4-e2fa-4c40-97e7-427a9392b22b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:49.590922 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f242b4-e2fa-4c40-97e7-427a9392b22b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:49.592402 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f242b4-e2fa-4c40-97e7-427a9392b22b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:49.594033 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 28/54] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:40:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:40:49.599897 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f242b4-e2fa-4c40-97e7-427a9392b22b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:49.600999 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960f8de-7a42-450d-a94a-a92aed74f4d1 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:49.611541 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:49.629762 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:49.638876 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1797aea-563c-4e55-a041-e1e37a51be2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:49.639517 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1797aea-563c-4e55-a041-e1e37a51be2b None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:49.639799 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1797aea-563c-4e55-a041-e1e37a51be2b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:49.640330 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1797aea-563c-4e55-a041-e1e37a51be2b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:49.641551 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1797aea-563c-4e55-a041-e1e37a51be2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:49.643057 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1797aea-563c-4e55-a041-e1e37a51be2b None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:49.644880 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 27/55] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:40:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:40:49.650474 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1797aea-563c-4e55-a041-e1e37a51be2b None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:49.699962 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f242b4-e2fa-4c40-97e7-427a9392b22b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:49.734252 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4cb25-b244-4731-a359-df8fc349dc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:49.734886 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4cb25-b244-4731-a359-df8fc349dc0c None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:49.735167 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4cb25-b244-4731-a359-df8fc349dc0c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:49.735443 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4cb25-b244-4731-a359-df8fc349dc0c None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:49.736113 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e4cb25-b244-4731-a359-df8fc349dc0c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:49.737622 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e4cb25-b244-4731-a359-df8fc349dc0c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:49.771428 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 29/56] 10.222.0.52 () {60 vars in 1140 bytes} [Sun Aug 28 00:40:49 2022] POST /identity/v3/projects => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:40:49.867615 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1797aea-563c-4e55-a041-e1e37a51be2b None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:49.906939 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d477b-06ad-4b30-a6a1-3d59619f5e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:49.907562 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d477b-06ad-4b30-a6a1-3d59619f5e75 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:49.907849 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d477b-06ad-4b30-a6a1-3d59619f5e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:49.908124 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d477b-06ad-4b30-a6a1-3d59619f5e75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:49.908871 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d477b-06ad-4b30-a6a1-3d59619f5e75 None admin] RBAC: Adding query filter params (role.id=cc013581bb07418d9ec6a3a1d282ea53, scope.domain.id=default, user.id=f0ea7ade0fdf4b01bc4d2a18f09385cb) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:40:49.909180 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d477b-06ad-4b30-a6a1-3d59619f5e75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:49.910691 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d477b-06ad-4b30-a6a1-3d59619f5e75 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:49.920651 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 28/57] 10.222.0.52 () {56 vars in 1322 bytes} [Sun Aug 28 00:40:49 2022] GET /identity/v3/role_assignments?user.id=f0ea7ade0fdf4b01bc4d2a18f09385cb&scope.domain.id=default&role.id=cc013581bb07418d9ec6a3a1d282ea53 => generated 530 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:40:51.679598 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304bec6-acce-494a-8611-a3a999035987 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:51.680150 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304bec6-acce-494a-8611-a3a999035987 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:51.680150 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304bec6-acce-494a-8611-a3a999035987 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:51.681525 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 30/58] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:40:51.688080 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722df8f6-d4e2-4c99-93fa-bcf994f94438 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:51.688822 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722df8f6-d4e2-4c99-93fa-bcf994f94438 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:51.688959 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722df8f6-d4e2-4c99-93fa-bcf994f94438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:51.714349 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-722df8f6-d4e2-4c99-93fa-bcf994f94438 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:40:51.715581 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-722df8f6-d4e2-4c99-93fa-bcf994f94438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:40:51.754743 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:51.793248 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 29/59] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:40:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:40:52.064729 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304bec6-acce-494a-8611-a3a999035987 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:52.152049 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:52.172797 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304bec6-acce-494a-8611-a3a999035987 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:52.206344 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3d697-7b60-46cf-aaab-05203931ccf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:52.206984 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3d697-7b60-46cf-aaab-05203931ccf5 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:52.207268 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3d697-7b60-46cf-aaab-05203931ccf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:52.207543 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3d697-7b60-46cf-aaab-05203931ccf5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:52.208670 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3d697-7b60-46cf-aaab-05203931ccf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:52.210177 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3d697-7b60-46cf-aaab-05203931ccf5 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:52.211754 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 31/60] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:40:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:40:52.217391 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722df8f6-d4e2-4c99-93fa-bcf994f94438 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:52.319505 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722df8f6-d4e2-4c99-93fa-bcf994f94438 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:52.354934 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9f5b0-96f7-4c96-9216-aad8f5f7c4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:52.355550 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9f5b0-96f7-4c96-9216-aad8f5f7c4dc None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:52.355825 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9f5b0-96f7-4c96-9216-aad8f5f7c4dc None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:52.356093 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9f5b0-96f7-4c96-9216-aad8f5f7c4dc None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:52.356752 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9f5b0-96f7-4c96-9216-aad8f5f7c4dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:52.358270 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9f5b0-96f7-4c96-9216-aad8f5f7c4dc None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:52.390339 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 30/61] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Aug 28 00:40:52 2022] POST /identity/v3/users => generated 275 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:40:55.459035 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb4cc8-46d7-44ac-be58-b021318a1733 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:55.460050 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb4cc8-46d7-44ac-be58-b021318a1733 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:55.460532 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb4cc8-46d7-44ac-be58-b021318a1733 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:55.462125 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 32/62] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:40:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:40:55.467593 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb336d8-ec62-480f-8796-823a68db5fd0 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:55.468508 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb336d8-ec62-480f-8796-823a68db5fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:55.469104 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb336d8-ec62-480f-8796-823a68db5fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:55.491107 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-5cb336d8-ec62-480f-8796-823a68db5fd0 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:40:55.492596 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-5cb336d8-ec62-480f-8796-823a68db5fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:40:55.492898 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256ead3-b372-42c9-a189-3f344ac727d4 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:55.493197 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256ead3-b372-42c9-a189-3f344ac727d4 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:55.493478 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256ead3-b372-42c9-a189-3f344ac727d4 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:55.494860 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 33/63] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:40:55.508106 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91a9bd-1dd6-4cd4-8685-e4645a7ecd04 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:55.508725 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91a9bd-1dd6-4cd4-8685-e4645a7ecd04 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:55.509200 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91a9bd-1dd6-4cd4-8685-e4645a7ecd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:55.526879 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:55.549387 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-5c91a9bd-1dd6-4cd4-8685-e4645a7ecd04 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:40:55.555360 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5c91a9bd-1dd6-4cd4-8685-e4645a7ecd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:40:55.607415 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 31/64] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:40:55.632315 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 34/65] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:40:55.714550 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5a7e0-251a-4c19-bd3f-2c58b7604552 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:55.714961 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5a7e0-251a-4c19-bd3f-2c58b7604552 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:55.715249 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5a7e0-251a-4c19-bd3f-2c58b7604552 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:55.716893 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 32/66] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:40:55.722566 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bccd52-c9b7-429a-a639-52e260c57402 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:55.723062 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bccd52-c9b7-429a-a639-52e260c57402 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:55.723517 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bccd52-c9b7-429a-a639-52e260c57402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:55.742386 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-78bccd52-c9b7-429a-a639-52e260c57402 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:40:55.743920 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-78bccd52-c9b7-429a-a639-52e260c57402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:40:55.812271 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 35/67] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:40:55.945513 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5a7e0-251a-4c19-bd3f-2c58b7604552 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:56.024993 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bccd52-c9b7-429a-a639-52e260c57402 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:56.040618 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:56.085180 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5a7e0-251a-4c19-bd3f-2c58b7604552 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:56.121833 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23382ac4-9fbc-407e-887c-d4c365f1bbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:56.122862 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23382ac4-9fbc-407e-887c-d4c365f1bbc8 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:56.123340 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23382ac4-9fbc-407e-887c-d4c365f1bbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:56.123800 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23382ac4-9fbc-407e-887c-d4c365f1bbc8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:56.135283 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23382ac4-9fbc-407e-887c-d4c365f1bbc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:40:56.141115 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-23382ac4-9fbc-407e-887c-d4c365f1bbc8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:40:56.141115 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:40:56.141115 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:40:56.141115 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:40:56.141115 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:40:56.141115 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:40:56.141115 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:40:56.141115 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:40:56.141115 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:40:56.141115 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:40:56.141115 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:40:56.141115 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:40:56.141115 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:40:56.141115 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:40:56.141115 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:40:56.141115 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:40:56.141983 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:40:56.141983 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:40:56.141983 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:40:56.141983 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:40:56.141983 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:40:56.141983 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:40:56.141983 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:40:56.141983 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:40:56.141983 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:40:56.141983 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:40:56.141983 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:40:56.141983 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:40:56.141983 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:40:56.141983 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:40:56.141983 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:40:56.141983 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:40:56.142721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:40:56.142721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:40:56.142721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:40:56.142721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:40:56.142721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:40:56.142721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:40:56.142721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:40:56.142721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:40:56.142721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:40:56.142721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:40:56.142721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:40:56.142721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:40:56.145293 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 33/68] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:40:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:40:56.147193 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea22b67-15de-4a42-8021-c3a930d970ff None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:56.147693 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea22b67-15de-4a42-8021-c3a930d970ff None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:56.148171 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea22b67-15de-4a42-8021-c3a930d970ff None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:56.149683 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 34/69] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:40:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:40:56.154779 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea22b67-15de-4a42-8021-c3a930d970ff None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:56.159308 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bccd52-c9b7-429a-a639-52e260c57402 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:56.177164 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:56.202771 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7427e7-8706-4181-b366-7522d96b2677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:56.203454 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7427e7-8706-4181-b366-7522d96b2677 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:56.203895 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7427e7-8706-4181-b366-7522d96b2677 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:56.204166 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7427e7-8706-4181-b366-7522d96b2677 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:56.214131 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7427e7-8706-4181-b366-7522d96b2677 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:40:56.219023 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-ab7427e7-8706-4181-b366-7522d96b2677 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:40:56.219023 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:40:56.219023 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:40:56.219023 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:40:56.219023 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:40:56.219023 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:40:56.219023 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:40:56.219023 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:40:56.219023 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:40:56.219023 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:40:56.219023 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:40:56.219023 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:40:56.219023 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:40:56.219023 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:40:56.219023 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:40:56.219023 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:40:56.220222 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:40:56.220222 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:40:56.220222 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:40:56.220222 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:40:56.220222 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:40:56.220222 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:40:56.220222 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:40:56.220222 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:40:56.220222 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:40:56.220222 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:40:56.220222 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:40:56.220222 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:40:56.220222 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:40:56.220222 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:40:56.220222 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:40:56.220222 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:40:56.220982 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:40:56.220982 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:40:56.220982 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:40:56.220982 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:40:56.220982 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:40:56.220982 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:40:56.220982 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:40:56.220982 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:40:56.220982 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:40:56.220982 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:40:56.220982 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:40:56.220982 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:40:56.220982 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 36/70] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:40:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:40:56.222449 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585bcf4-c5db-444f-accb-dc24d65a7116 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:56.222449 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585bcf4-c5db-444f-accb-dc24d65a7116 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:56.222622 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585bcf4-c5db-444f-accb-dc24d65a7116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:56.241193 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-1585bcf4-c5db-444f-accb-dc24d65a7116 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:40:56.242419 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1585bcf4-c5db-444f-accb-dc24d65a7116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:40:56.265612 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea22b67-15de-4a42-8021-c3a930d970ff None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:56.300485 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401c48c-c87e-4e5f-92f7-72f3c9074163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:56.301104 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401c48c-c87e-4e5f-92f7-72f3c9074163 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:56.301557 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401c48c-c87e-4e5f-92f7-72f3c9074163 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:56.301950 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401c48c-c87e-4e5f-92f7-72f3c9074163 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:56.302722 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401c48c-c87e-4e5f-92f7-72f3c9074163 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:40:56.303030 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401c48c-c87e-4e5f-92f7-72f3c9074163 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:56.304742 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401c48c-c87e-4e5f-92f7-72f3c9074163 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:56.306148 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:56.311648 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 37/71] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:40:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:40:56.313165 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10503279-f6b5-44f1-b3c6-7be06c3af245 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:56.313549 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10503279-f6b5-44f1-b3c6-7be06c3af245 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:56.313940 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10503279-f6b5-44f1-b3c6-7be06c3af245 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:56.314419 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 35/72] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:40:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:40:56.315244 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401c48c-c87e-4e5f-92f7-72f3c9074163 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:56.326626 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 38/73] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:40:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:40:56.326626 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10503279-f6b5-44f1-b3c6-7be06c3af245 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:56.402414 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:56.422842 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401c48c-c87e-4e5f-92f7-72f3c9074163 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:56.435848 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10503279-f6b5-44f1-b3c6-7be06c3af245 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:56.457376 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d4c3f-5acf-403c-9c7d-1e14a05c9fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:56.458032 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d4c3f-5acf-403c-9c7d-1e14a05c9fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:56.458327 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d4c3f-5acf-403c-9c7d-1e14a05c9fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:56.458600 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d4c3f-5acf-403c-9c7d-1e14a05c9fa8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:56.469694 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063d4c3f-5acf-403c-9c7d-1e14a05c9fa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:40:56.472277 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bcdeb-e43c-4299-8d16-e7328acffb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:56.472871 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bcdeb-e43c-4299-8d16-e7328acffb96 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:56.473155 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bcdeb-e43c-4299-8d16-e7328acffb96 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:56.473431 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bcdeb-e43c-4299-8d16-e7328acffb96 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:56.474139 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bcdeb-e43c-4299-8d16-e7328acffb96 None admin] RBAC: Adding query filter params (name=member) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:40:56.474456 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bcdeb-e43c-4299-8d16-e7328acffb96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:56.475062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-063d4c3f-5acf-403c-9c7d-1e14a05c9fa8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:40:56.475062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:40:56.475062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:40:56.475062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:40:56.475062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:40:56.475062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:40:56.475062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:40:56.475062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:40:56.475062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:40:56.475062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:40:56.475062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:40:56.475062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:40:56.475062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:40:56.475062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:40:56.475062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:40:56.475062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:40:56.475895 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:40:56.475895 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:40:56.475895 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:40:56.475895 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:40:56.475895 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:40:56.475895 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:40:56.475895 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:40:56.475895 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:40:56.475895 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:40:56.475895 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:40:56.475895 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:40:56.475895 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:40:56.475895 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:40:56.475895 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:40:56.475895 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:40:56.475895 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:40:56.478355 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:40:56.478355 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:40:56.478355 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:40:56.478355 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:40:56.478355 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:40:56.478355 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:40:56.478355 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:40:56.478355 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:40:56.478355 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:40:56.478355 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:40:56.478355 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:40:56.478355 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:40:56.478943 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bcdeb-e43c-4299-8d16-e7328acffb96 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:56.479012 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 36/74] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:40:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:40:56.479012 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d4c3f-5acf-403c-9c7d-1e14a05c9fa8 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:56.491389 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 39/75] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Aug 28 00:40:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:40:56.496272 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5f6d2-a494-42a5-8d9b-244d94d8f81d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:56.496272 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5f6d2-a494-42a5-8d9b-244d94d8f81d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:56.496272 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5f6d2-a494-42a5-8d9b-244d94d8f81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:56.513043 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-2da5f6d2-a494-42a5-8d9b-244d94d8f81d None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:40:56.514377 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2da5f6d2-a494-42a5-8d9b-244d94d8f81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:40:56.577245 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:56.589415 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 40/76] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:40:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:40:56.590276 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5f6d2-a494-42a5-8d9b-244d94d8f81d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:56.590373 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d4c3f-5acf-403c-9c7d-1e14a05c9fa8 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:56.627478 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e189af5-d439-456f-abbb-687c3addda7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:56.628203 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e189af5-d439-456f-abbb-687c3addda7c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:56.628494 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e189af5-d439-456f-abbb-687c3addda7c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:56.628771 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e189af5-d439-456f-abbb-687c3addda7c None admin] PATH_INFO: `/v3/users/f0ea7ade0fdf4b01bc4d2a18f09385cb` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:56.629948 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e189af5-d439-456f-abbb-687c3addda7c None admin] RBAC: Authorizing `identity:get_user(user_id=f0ea7ade0fdf4b01bc4d2a18f09385cb)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:56.631497 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e189af5-d439-456f-abbb-687c3addda7c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:56.633238 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 37/77] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:40:56 2022] GET /identity/v3/users/f0ea7ade0fdf4b01bc4d2a18f09385cb => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:40:56.633875 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e189af5-d439-456f-abbb-687c3addda7c None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:56.645951 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:56.698103 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5f6d2-a494-42a5-8d9b-244d94d8f81d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:56.733618 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34018cf4-bb17-47a8-840a-36fb500faba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:56.734472 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34018cf4-bb17-47a8-840a-36fb500faba9 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:56.734758 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34018cf4-bb17-47a8-840a-36fb500faba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:56.735038 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34018cf4-bb17-47a8-840a-36fb500faba9 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:56.735715 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34018cf4-bb17-47a8-840a-36fb500faba9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:40:56.736020 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34018cf4-bb17-47a8-840a-36fb500faba9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:56.737430 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34018cf4-bb17-47a8-840a-36fb500faba9 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:56.745330 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e189af5-d439-456f-abbb-687c3addda7c None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:56.745816 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 41/78] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Aug 28 00:40:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:40:56.746376 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34018cf4-bb17-47a8-840a-36fb500faba9 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:56.784674 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8dcb1f-d0e9-40e4-be36-ad249ab9100e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:56.785309 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8dcb1f-d0e9-40e4-be36-ad249ab9100e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:56.785591 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8dcb1f-d0e9-40e4-be36-ad249ab9100e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:56.785889 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8dcb1f-d0e9-40e4-be36-ad249ab9100e None admin] PATH_INFO: `/v3/users/aa5b6bfda63641828423fc56bb44215c` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:56.802389 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:56.802991 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8dcb1f-d0e9-40e4-be36-ad249ab9100e None admin] RBAC: Authorizing `identity:get_user(user_id=aa5b6bfda63641828423fc56bb44215c)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:56.804770 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8dcb1f-d0e9-40e4-be36-ad249ab9100e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:56.807426 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 38/79] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:40:56 2022] GET /identity/v3/users/aa5b6bfda63641828423fc56bb44215c => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:40:56.812886 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8dcb1f-d0e9-40e4-be36-ad249ab9100e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:56.849489 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34018cf4-bb17-47a8-840a-36fb500faba9 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:56.880503 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:56.885303 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb970e8-f98f-4427-9db8-75d84557db36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:56.886410 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb970e8-f98f-4427-9db8-75d84557db36 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:56.886693 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb970e8-f98f-4427-9db8-75d84557db36 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:56.886967 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb970e8-f98f-4427-9db8-75d84557db36 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:56.897675 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb970e8-f98f-4427-9db8-75d84557db36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:40:56.903012 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-4bb970e8-f98f-4427-9db8-75d84557db36 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:40:56.903012 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:40:56.903012 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:40:56.903012 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:40:56.903012 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:40:56.903012 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:40:56.903012 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:40:56.903012 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:40:56.903012 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:40:56.903012 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:40:56.903012 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:40:56.903012 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:40:56.903012 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:40:56.903012 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:40:56.903012 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:40:56.903012 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:40:56.903860 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:40:56.903860 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:40:56.903860 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:40:56.903860 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:40:56.903860 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:40:56.903860 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:40:56.903860 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:40:56.903860 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:40:56.903860 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:40:56.903860 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:40:56.903860 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:40:56.903860 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:40:56.903860 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:40:56.903860 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:40:56.903860 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:40:56.903860 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:40:56.904840 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:40:56.904840 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:40:56.904840 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:40:56.904840 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:40:56.904840 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:40:56.904840 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:40:56.904840 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:40:56.904840 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:40:56.904840 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:40:56.904840 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:40:56.904840 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:40:56.904840 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:40:56.904840 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 42/80] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Aug 28 00:40:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:40:56.905782 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb970e8-f98f-4427-9db8-75d84557db36 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:56.915934 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8dcb1f-d0e9-40e4-be36-ad249ab9100e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:56.949175 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e0ef1-c44e-4f35-bec2-59c82cbb081a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:56.949785 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e0ef1-c44e-4f35-bec2-59c82cbb081a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:56.950088 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e0ef1-c44e-4f35-bec2-59c82cbb081a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:56.950360 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e0ef1-c44e-4f35-bec2-59c82cbb081a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:57.002888 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb970e8-f98f-4427-9db8-75d84557db36 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:57.016011 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e0ef1-c44e-4f35-bec2-59c82cbb081a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:57.017449 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:57.017564 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e0ef1-c44e-4f35-bec2-59c82cbb081a None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:57.038098 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c05fa-ee29-428c-9612-54e9361e8694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:57.038729 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c05fa-ee29-428c-9612-54e9361e8694 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:57.039014 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c05fa-ee29-428c-9612-54e9361e8694 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:57.039287 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c05fa-ee29-428c-9612-54e9361e8694 None admin] PATH_INFO: `/v3/users/aa5b6bfda63641828423fc56bb44215c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:57.040440 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c05fa-ee29-428c-9612-54e9361e8694 None admin] RBAC: Authorizing `identity:get_user(user_id=aa5b6bfda63641828423fc56bb44215c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:57.041949 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c05fa-ee29-428c-9612-54e9361e8694 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:57.045866 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 43/81] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:40:56 2022] GET /identity/v3/users/aa5b6bfda63641828423fc56bb44215c => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:40:57.045866 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c05fa-ee29-428c-9612-54e9361e8694 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:57.084669 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:57.120897 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 39/82] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:40:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:40:57.121657 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e0ef1-c44e-4f35-bec2-59c82cbb081a None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:57.143715 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c05fa-ee29-428c-9612-54e9361e8694 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:57.177617 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a6d88-b45c-4ca2-bf4e-60d8bf196c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:57.178257 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a6d88-b45c-4ca2-bf4e-60d8bf196c03 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:57.178542 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a6d88-b45c-4ca2-bf4e-60d8bf196c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:57.178822 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a6d88-b45c-4ca2-bf4e-60d8bf196c03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:57.217720 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e0ef1-c44e-4f35-bec2-59c82cbb081a None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:57.228899 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:57.247536 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a6d88-b45c-4ca2-bf4e-60d8bf196c03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:57.249021 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a6d88-b45c-4ca2-bf4e-60d8bf196c03 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:57.252288 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a028bb-87bf-4367-9fcd-6731827f343d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:57.252921 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a028bb-87bf-4367-9fcd-6731827f343d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:57.253203 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a028bb-87bf-4367-9fcd-6731827f343d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:57.253479 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a028bb-87bf-4367-9fcd-6731827f343d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:57.254647 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a028bb-87bf-4367-9fcd-6731827f343d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:57.256120 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a028bb-87bf-4367-9fcd-6731827f343d None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:57.257700 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 40/83] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:40:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:40:57.258496 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a028bb-87bf-4367-9fcd-6731827f343d None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:57.292294 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:57.352704 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 44/84] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:40:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:40:57.353580 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a6d88-b45c-4ca2-bf4e-60d8bf196c03 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:57.365013 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a028bb-87bf-4367-9fcd-6731827f343d None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:57.400187 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d925a-cfd8-4eab-89dd-0ba9f1d2d1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:57.400808 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d925a-cfd8-4eab-89dd-0ba9f1d2d1e0 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:57.401143 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d925a-cfd8-4eab-89dd-0ba9f1d2d1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:57.401420 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d925a-cfd8-4eab-89dd-0ba9f1d2d1e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:57.402123 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d925a-cfd8-4eab-89dd-0ba9f1d2d1e0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:40:57.402430 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d925a-cfd8-4eab-89dd-0ba9f1d2d1e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:57.403929 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d925a-cfd8-4eab-89dd-0ba9f1d2d1e0 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:57.412578 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 41/85] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:40:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:40:57.413404 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d925a-cfd8-4eab-89dd-0ba9f1d2d1e0 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:57.436947 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:57.455425 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a6d88-b45c-4ca2-bf4e-60d8bf196c03 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:57.490058 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c04be5-73f1-46d7-afc9-767cf4408f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:57.490700 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c04be5-73f1-46d7-afc9-767cf4408f0d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:57.490930 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c04be5-73f1-46d7-afc9-767cf4408f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:57.491200 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c04be5-73f1-46d7-afc9-767cf4408f0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:57.510447 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:57.517088 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d925a-cfd8-4eab-89dd-0ba9f1d2d1e0 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:57.550569 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cab028-8eae-4baf-8a8b-f0719fd047f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:57.551246 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cab028-8eae-4baf-8a8b-f0719fd047f8 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:57.551552 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cab028-8eae-4baf-8a8b-f0719fd047f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:57.551829 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cab028-8eae-4baf-8a8b-f0719fd047f8 None admin] PATH_INFO: `/v3/projects/93e707bfff714b1c80277c83a2ed2c93` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:57.552977 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cab028-8eae-4baf-8a8b-f0719fd047f8 None admin] RBAC: Authorizing `identity:get_project(project_id=93e707bfff714b1c80277c83a2ed2c93)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:57.554501 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cab028-8eae-4baf-8a8b-f0719fd047f8 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:57.556142 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 42/86] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:40:57 2022] GET /identity/v3/projects/93e707bfff714b1c80277c83a2ed2c93 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:40:57.556887 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cab028-8eae-4baf-8a8b-f0719fd047f8 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:57.564642 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c04be5-73f1-46d7-afc9-767cf4408f0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:57.566231 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c04be5-73f1-46d7-afc9-767cf4408f0d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:57.645144 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:57.657453 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cab028-8eae-4baf-8a8b-f0719fd047f8 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:57.664356 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 45/87] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:40:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:40:57.665209 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c04be5-73f1-46d7-afc9-767cf4408f0d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:57.692438 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb53f7-5a9b-4601-a338-f978e82f64ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:57.693053 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb53f7-5a9b-4601-a338-f978e82f64ea None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:57.693351 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb53f7-5a9b-4601-a338-f978e82f64ea None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:57.693667 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb53f7-5a9b-4601-a338-f978e82f64ea None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:57.694354 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb53f7-5a9b-4601-a338-f978e82f64ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:57.695826 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb53f7-5a9b-4601-a338-f978e82f64ea None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:57.717893 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 43/88] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Aug 28 00:40:57 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:40:57.718808 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb53f7-5a9b-4601-a338-f978e82f64ea None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:57.745815 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:57.777868 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c04be5-73f1-46d7-afc9-767cf4408f0d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:57.816620 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc4593-07df-4865-a2b1-8cd24bbff57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:57.817268 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc4593-07df-4865-a2b1-8cd24bbff57d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:57.817550 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc4593-07df-4865-a2b1-8cd24bbff57d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:57.817825 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc4593-07df-4865-a2b1-8cd24bbff57d None admin] PATH_INFO: `/v3/projects/93e707bfff714b1c80277c83a2ed2c93` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:57.819029 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc4593-07df-4865-a2b1-8cd24bbff57d None admin] RBAC: Authorizing `identity:get_project(project_id=93e707bfff714b1c80277c83a2ed2c93)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:57.820522 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc4593-07df-4865-a2b1-8cd24bbff57d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:57.822257 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 46/89] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:40:57 2022] GET /identity/v3/projects/93e707bfff714b1c80277c83a2ed2c93 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:40:57.823060 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc4593-07df-4865-a2b1-8cd24bbff57d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:57.853406 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb53f7-5a9b-4601-a338-f978e82f64ea None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:57.883235 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:57.898486 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b6b07-5d96-4eed-b384-35a2c046fe6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:57.899164 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b6b07-5d96-4eed-b384-35a2c046fe6e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:57.899444 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b6b07-5d96-4eed-b384-35a2c046fe6e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:57.899718 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b6b07-5d96-4eed-b384-35a2c046fe6e None admin] PATH_INFO: `/v3/users/aa5b6bfda63641828423fc56bb44215c` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:57.900867 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b6b07-5d96-4eed-b384-35a2c046fe6e None admin] RBAC: Authorizing `identity:get_user(user_id=aa5b6bfda63641828423fc56bb44215c)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:57.902540 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b6b07-5d96-4eed-b384-35a2c046fe6e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:57.904322 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 44/90] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:40:57 2022] GET /identity/v3/users/aa5b6bfda63641828423fc56bb44215c => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:40:57.904992 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b6b07-5d96-4eed-b384-35a2c046fe6e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:57.948582 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc4593-07df-4865-a2b1-8cd24bbff57d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:57.999680 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c98623-5e4c-49bc-ac51-ab51f944b5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:58.000325 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c98623-5e4c-49bc-ac51-ab51f944b5ff None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:58.000777 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c98623-5e4c-49bc-ac51-ab51f944b5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:58.000851 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c98623-5e4c-49bc-ac51-ab51f944b5ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:58.001583 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c98623-5e4c-49bc-ac51-ab51f944b5ff None admin] RBAC: Adding query filter params (role.id=cc013581bb07418d9ec6a3a1d282ea53, scope.project.id=93e707bfff714b1c80277c83a2ed2c93, user.id=f0ea7ade0fdf4b01bc4d2a18f09385cb) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:40:58.001930 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c98623-5e4c-49bc-ac51-ab51f944b5ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:58.003427 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c98623-5e4c-49bc-ac51-ab51f944b5ff None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:58.010143 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 47/91] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:40:57 2022] GET /identity/v3/role_assignments?user.id=f0ea7ade0fdf4b01bc4d2a18f09385cb&scope.project.id=93e707bfff714b1c80277c83a2ed2c93&role.id=cc013581bb07418d9ec6a3a1d282ea53 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:40:58.010818 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c98623-5e4c-49bc-ac51-ab51f944b5ff None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:58.025874 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:58.042531 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b6b07-5d96-4eed-b384-35a2c046fe6e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:58.096028 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708becd7-add3-4ac1-ae7c-ec006464c4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:58.096690 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708becd7-add3-4ac1-ae7c-ec006464c4ce None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:58.096969 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708becd7-add3-4ac1-ae7c-ec006464c4ce None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:58.097238 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708becd7-add3-4ac1-ae7c-ec006464c4ce None admin] PATH_INFO: `/v3/projects/4e9f6d41f6a049858cfcfeb5f12fab19` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:58.099069 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708becd7-add3-4ac1-ae7c-ec006464c4ce None admin] RBAC: Authorizing `identity:get_project(project_id=4e9f6d41f6a049858cfcfeb5f12fab19)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:58.100644 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708becd7-add3-4ac1-ae7c-ec006464c4ce None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:58.102850 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 45/92] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:40:57 2022] GET /identity/v3/projects/4e9f6d41f6a049858cfcfeb5f12fab19 => generated 312 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:40:58.103665 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708becd7-add3-4ac1-ae7c-ec006464c4ce None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:58.133696 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c98623-5e4c-49bc-ac51-ab51f944b5ff None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:58.157254 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:58.194407 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027c466-22a7-4bde-8b60-9ee6c5941e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:58.195030 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027c466-22a7-4bde-8b60-9ee6c5941e35 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:58.195317 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027c466-22a7-4bde-8b60-9ee6c5941e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:58.195585 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027c466-22a7-4bde-8b60-9ee6c5941e35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:58.196331 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d027c466-22a7-4bde-8b60-9ee6c5941e35 None admin] RBAC: Adding query filter params (role.id=2231e998e50146f4b53b832f2f88c1c8, scope.project.id=93e707bfff714b1c80277c83a2ed2c93, user.id=aa5b6bfda63641828423fc56bb44215c) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:40:58.196643 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d027c466-22a7-4bde-8b60-9ee6c5941e35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:58.198292 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d027c466-22a7-4bde-8b60-9ee6c5941e35 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:58.206164 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 48/93] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:40:58 2022] GET /identity/v3/role_assignments?user.id=aa5b6bfda63641828423fc56bb44215c&scope.project.id=93e707bfff714b1c80277c83a2ed2c93&role.id=2231e998e50146f4b53b832f2f88c1c8 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:40:58.206976 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027c466-22a7-4bde-8b60-9ee6c5941e35 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:58.304040 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708becd7-add3-4ac1-ae7c-ec006464c4ce None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:58.403326 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe5995-8ac2-452f-b7b2-c6c9637ddcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:58.403966 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe5995-8ac2-452f-b7b2-c6c9637ddcef None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:58.404247 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe5995-8ac2-452f-b7b2-c6c9637ddcef None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:58.404519 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe5995-8ac2-452f-b7b2-c6c9637ddcef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:58.410253 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027c466-22a7-4bde-8b60-9ee6c5941e35 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:58.457954 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d41f7-d7e2-4bab-a31d-aceb19042371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:58.457954 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d41f7-d7e2-4bab-a31d-aceb19042371 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:58.457954 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d41f7-d7e2-4bab-a31d-aceb19042371 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:58.457954 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d41f7-d7e2-4bab-a31d-aceb19042371 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:58.458315 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d41f7-d7e2-4bab-a31d-aceb19042371 None admin] RBAC: Adding query filter params (role.id=2231e998e50146f4b53b832f2f88c1c8, scope.project.id=4e9f6d41f6a049858cfcfeb5f12fab19, user.id=aa5b6bfda63641828423fc56bb44215c) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:40:58.458315 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d41f7-d7e2-4bab-a31d-aceb19042371 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:58.458315 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d41f7-d7e2-4bab-a31d-aceb19042371 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:58.464233 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 49/94] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:40:58 2022] GET /identity/v3/role_assignments?user.id=aa5b6bfda63641828423fc56bb44215c&scope.project.id=4e9f6d41f6a049858cfcfeb5f12fab19&role.id=2231e998e50146f4b53b832f2f88c1c8 => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:40:58.465492 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:58.524920 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe5995-8ac2-452f-b7b2-c6c9637ddcef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:58.527355 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe5995-8ac2-452f-b7b2-c6c9637ddcef None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:58.670368 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 46/95] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:40:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:40:58.676892 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d41f7-d7e2-4bab-a31d-aceb19042371 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:58.745299 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:58.825197 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d41f7-d7e2-4bab-a31d-aceb19042371 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:58.869067 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe87b08-a288-460e-8925-047b1cd5b407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:58.869720 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe87b08-a288-460e-8925-047b1cd5b407 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:58.870041 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe87b08-a288-460e-8925-047b1cd5b407 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:58.870317 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe87b08-a288-460e-8925-047b1cd5b407 None admin] PATH_INFO: `/v3/projects/93e707bfff714b1c80277c83a2ed2c93` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:58.871582 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe87b08-a288-460e-8925-047b1cd5b407 None admin] RBAC: Authorizing `identity:get_project(project_id=93e707bfff714b1c80277c83a2ed2c93)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:58.873130 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe87b08-a288-460e-8925-047b1cd5b407 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:58.875536 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 50/96] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:40:58 2022] GET /identity/v3/projects/93e707bfff714b1c80277c83a2ed2c93 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:40:58.882884 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe5995-8ac2-452f-b7b2-c6c9637ddcef None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:40:58.986676 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:40:59.042488 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe5995-8ac2-452f-b7b2-c6c9637ddcef None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:40:59.096724 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94334d42-70a7-40d8-b2c5-10cd700ca1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:40:59.097339 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94334d42-70a7-40d8-b2c5-10cd700ca1b8 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:40:59.097618 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94334d42-70a7-40d8-b2c5-10cd700ca1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:40:59.097913 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94334d42-70a7-40d8-b2c5-10cd700ca1b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:40:59.098654 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94334d42-70a7-40d8-b2c5-10cd700ca1b8 None admin] RBAC: Adding query filter params (role.id=258091cadd094ad2a608d396036e8869, scope.project.id=93e707bfff714b1c80277c83a2ed2c93, user.id=aa5b6bfda63641828423fc56bb44215c) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:40:59.098961 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94334d42-70a7-40d8-b2c5-10cd700ca1b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:40:59.100417 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94334d42-70a7-40d8-b2c5-10cd700ca1b8 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:40:59.108144 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 47/97] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:40:58 2022] GET /identity/v3/role_assignments?user.id=aa5b6bfda63641828423fc56bb44215c&scope.project.id=93e707bfff714b1c80277c83a2ed2c93&role.id=258091cadd094ad2a608d396036e8869 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:00.464742 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc8256-1105-461c-8de1-4132e045efab None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:00.465812 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc8256-1105-461c-8de1-4132e045efab None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:00.466354 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc8256-1105-461c-8de1-4132e045efab None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:00.468351 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 51/98] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:00.473968 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8145ede-c91c-4ef8-984e-97a0fe7ef550 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:00.474842 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8145ede-c91c-4ef8-984e-97a0fe7ef550 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:00.475343 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8145ede-c91c-4ef8-984e-97a0fe7ef550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:00.502581 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-b8145ede-c91c-4ef8-984e-97a0fe7ef550 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:00.504162 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b8145ede-c91c-4ef8-984e-97a0fe7ef550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:00.591820 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 48/99] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:00.609556 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33b75f-d0d4-4bd1-a285-0a2dcd88454d None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:00.609873 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33b75f-d0d4-4bd1-a285-0a2dcd88454d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:00.610157 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33b75f-d0d4-4bd1-a285-0a2dcd88454d None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:00.611522 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 52/100] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:00.617069 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4465609-ee60-4f3f-a5a1-0f7cbce6eae0 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:00.617366 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4465609-ee60-4f3f-a5a1-0f7cbce6eae0 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:00.617647 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4465609-ee60-4f3f-a5a1-0f7cbce6eae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:00.646029 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-a4465609-ee60-4f3f-a5a1-0f7cbce6eae0 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:00.647235 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a4465609-ee60-4f3f-a5a1-0f7cbce6eae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:00.711770 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:00.739037 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 49/101] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:00.962081 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33b75f-d0d4-4bd1-a285-0a2dcd88454d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:01.087171 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33b75f-d0d4-4bd1-a285-0a2dcd88454d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:01.099168 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:01.122825 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ec88e-f276-477b-a47c-7fd18074800c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:01.123521 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ec88e-f276-477b-a47c-7fd18074800c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:01.123804 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ec88e-f276-477b-a47c-7fd18074800c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:01.124079 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ec88e-f276-477b-a47c-7fd18074800c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:01.125306 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ec88e-f276-477b-a47c-7fd18074800c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:01.126823 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ec88e-f276-477b-a47c-7fd18074800c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:01.128673 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 53/102] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:41:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:01.134363 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4465609-ee60-4f3f-a5a1-0f7cbce6eae0 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:01.217719 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ec88e-f276-477b-a47c-7fd18074800c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:01.276928 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4465609-ee60-4f3f-a5a1-0f7cbce6eae0 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:01.319117 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe2f5e-9c45-478e-880a-c93e8283cd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:01.319735 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe2f5e-9c45-478e-880a-c93e8283cd2e None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:01.320536 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe2f5e-9c45-478e-880a-c93e8283cd2e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:01.320871 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe2f5e-9c45-478e-880a-c93e8283cd2e None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:01.321528 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe2f5e-9c45-478e-880a-c93e8283cd2e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:01.323491 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe2f5e-9c45-478e-880a-c93e8283cd2e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:01.346762 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ec88e-f276-477b-a47c-7fd18074800c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:01.359612 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 50/103] 10.222.0.52 () {60 vars in 1141 bytes} [Sun Aug 28 00:41:01 2022] POST /identity/v3/projects => generated 302 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:41:01.360895 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6650a5c-e46c-488a-8ab5-4bc7fc18d340 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:01.361184 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6650a5c-e46c-488a-8ab5-4bc7fc18d340 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:01.361461 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6650a5c-e46c-488a-8ab5-4bc7fc18d340 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:01.362982 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 51/104] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:01.364264 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f4aed-0481-48f3-932c-b3de40b3dd43 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:01.364549 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f4aed-0481-48f3-932c-b3de40b3dd43 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:01.364824 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f4aed-0481-48f3-932c-b3de40b3dd43 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:01.366179 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 52/105] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:01.371826 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0748120-b16b-4eef-82d8-ef4b1fa1d74a None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:01.372407 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0748120-b16b-4eef-82d8-ef4b1fa1d74a None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:01.372692 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0748120-b16b-4eef-82d8-ef4b1fa1d74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:01.395557 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-b0748120-b16b-4eef-82d8-ef4b1fa1d74a None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:01.396920 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b0748120-b16b-4eef-82d8-ef4b1fa1d74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:01.415343 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0367e-ae7b-4a3e-ab71-942ce0de147c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:01.415996 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0367e-ae7b-4a3e-ab71-942ce0de147c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:01.417349 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0367e-ae7b-4a3e-ab71-942ce0de147c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:01.417760 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0367e-ae7b-4a3e-ab71-942ce0de147c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:01.432256 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:01.435313 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0367e-ae7b-4a3e-ab71-942ce0de147c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:01.450349 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-09b0367e-ae7b-4a3e-ab71-942ce0de147c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:41:01.450349 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:01.450349 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:01.450349 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:01.450349 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:01.450349 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:01.450349 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:01.450349 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:01.450349 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:01.450349 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:01.450349 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:01.450349 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:01.450349 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:01.450349 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:01.450349 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:01.450349 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:01.451285 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:01.451285 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:01.451285 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:01.451285 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:01.451285 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:01.451285 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:01.451285 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:01.451285 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:01.451285 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:01.451285 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:01.451285 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:01.451285 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:01.451285 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:01.451285 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:01.451285 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:01.451285 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:01.452034 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:01.452034 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:01.452034 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:01.452034 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:01.452034 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:01.452034 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:01.452034 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:01.452034 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:01.452034 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:01.452034 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:01.452034 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:41:01.452034 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:01.454765 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 54/106] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:41:01.456344 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea16266-26f3-4f60-bf68-a941fd45d67f None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:01.456834 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea16266-26f3-4f60-bf68-a941fd45d67f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:01.457315 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea16266-26f3-4f60-bf68-a941fd45d67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:01.481202 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-3ea16266-26f3-4f60-bf68-a941fd45d67f None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:01.482030 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 53/107] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:01.487593 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ff96d-e653-4f5f-96e0-8533141a2cb1 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:01.487593 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ff96d-e653-4f5f-96e0-8533141a2cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:01.487593 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ff96d-e653-4f5f-96e0-8533141a2cb1 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:01.487593 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 54/108] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:01.487593 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ff96d-e653-4f5f-96e0-8533141a2cb1 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:01.490108 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3ea16266-26f3-4f60-bf68-a941fd45d67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:01.566138 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:01.613589 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 55/109] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:01.614689 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed27eb-3bdb-4ad9-9860-227929b60e3c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:01.614983 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed27eb-3bdb-4ad9-9860-227929b60e3c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:01.615258 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed27eb-3bdb-4ad9-9860-227929b60e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:01.648572 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-5fed27eb-3bdb-4ad9-9860-227929b60e3c None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:01.649614 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5fed27eb-3bdb-4ad9-9860-227929b60e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:01.652727 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ff96d-e653-4f5f-96e0-8533141a2cb1 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:01.693295 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4744f3-abcb-4e72-99f2-a625c617801f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:01.694166 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4744f3-abcb-4e72-99f2-a625c617801f None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:01.694833 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4744f3-abcb-4e72-99f2-a625c617801f None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:01.695244 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4744f3-abcb-4e72-99f2-a625c617801f None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:01.696197 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4744f3-abcb-4e72-99f2-a625c617801f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:01.696672 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4744f3-abcb-4e72-99f2-a625c617801f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:01.698609 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4744f3-abcb-4e72-99f2-a625c617801f None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:01.709147 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 55/110] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Aug 28 00:41:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:01.715890 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4744f3-abcb-4e72-99f2-a625c617801f None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:01.761966 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:01.763839 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 56/111] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:01.815038 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed27eb-3bdb-4ad9-9860-227929b60e3c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:01.886221 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4744f3-abcb-4e72-99f2-a625c617801f None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:01.949773 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f4e7b-eb9a-4479-b7de-2995e0d25b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:01.950445 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f4e7b-eb9a-4479-b7de-2995e0d25b7d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:01.950728 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f4e7b-eb9a-4479-b7de-2995e0d25b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:01.951007 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f4e7b-eb9a-4479-b7de-2995e0d25b7d None admin] PATH_INFO: `/v3/users/4399c9bdccc742ea927325dd9b7b50b1` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:01.979262 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f4e7b-eb9a-4479-b7de-2995e0d25b7d None admin] RBAC: Authorizing `identity:get_user(user_id=4399c9bdccc742ea927325dd9b7b50b1)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:01.980826 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f4e7b-eb9a-4479-b7de-2995e0d25b7d None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:01.982725 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 56/112] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:41:01 2022] GET /identity/v3/users/4399c9bdccc742ea927325dd9b7b50b1 => generated 289 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:41:01.988523 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f4e7b-eb9a-4479-b7de-2995e0d25b7d None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:01.992388 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:01.997630 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed27eb-3bdb-4ad9-9860-227929b60e3c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:02.055918 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f798d-f36b-49c0-9170-9bab646b0b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:02.057300 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f798d-f36b-49c0-9170-9bab646b0b73 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:02.057784 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f798d-f36b-49c0-9170-9bab646b0b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:02.058287 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f798d-f36b-49c0-9170-9bab646b0b73 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:02.071758 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f798d-f36b-49c0-9170-9bab646b0b73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:02.079393 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-b01f798d-f36b-49c0-9170-9bab646b0b73 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:41:02.079393 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:02.079393 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:02.079393 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:02.079393 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:02.079393 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:02.079393 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:02.079393 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:02.079393 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:02.079393 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:02.079393 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:02.079393 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:02.079393 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:02.079393 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:02.079393 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:02.079393 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:02.080253 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:02.080253 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:02.080253 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:02.080253 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:02.080253 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:02.080253 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:02.080253 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:02.080253 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:02.080253 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:02.080253 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:02.080253 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:02.080253 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:02.080253 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:02.080253 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:02.080253 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:02.080253 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:02.080995 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:02.080995 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:02.080995 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:02.080995 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:02.080995 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:02.080995 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:02.080995 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:02.080995 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:02.080995 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:02.080995 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:02.080995 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:41:02.080995 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:02.081562 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 57/113] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:41:02.082362 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f798d-f36b-49c0-9170-9bab646b0b73 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:02.109307 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:02.130360 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f4e7b-eb9a-4479-b7de-2995e0d25b7d None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:02.166338 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1995a2-25c9-4aa7-8b0b-c1b1006920d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:02.166878 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1995a2-25c9-4aa7-8b0b-c1b1006920d9 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:02.167163 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1995a2-25c9-4aa7-8b0b-c1b1006920d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:02.167441 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1995a2-25c9-4aa7-8b0b-c1b1006920d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:02.185960 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f798d-f36b-49c0-9170-9bab646b0b73 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:02.220416 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e49a9-3715-4854-80de-6f2d8e74b7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:02.221044 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e49a9-3715-4854-80de-6f2d8e74b7e7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:02.221322 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e49a9-3715-4854-80de-6f2d8e74b7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:02.221596 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e49a9-3715-4854-80de-6f2d8e74b7e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:02.232186 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e49a9-3715-4854-80de-6f2d8e74b7e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:02.237303 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-942e49a9-3715-4854-80de-6f2d8e74b7e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:41:02.237303 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:02.237303 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:02.237303 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:02.237303 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:02.237303 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:02.237303 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:02.237303 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:02.237303 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:02.237303 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:02.237303 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:02.237303 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:02.237303 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:02.237303 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:02.237303 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:02.237303 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:02.238413 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:02.238413 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:02.238413 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:02.238413 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:02.238413 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:02.238413 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:02.238413 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:02.238413 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:02.238413 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:02.238413 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:02.238413 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:02.238413 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:02.238413 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:02.238413 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:02.238413 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:02.238413 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:02.244761 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:02.244761 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:02.244761 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:02.244761 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:02.244761 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:02.244761 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:02.244761 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:02.244761 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:02.244761 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:02.244761 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:02.244761 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:41:02.244761 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:02.244761 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 58/114] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:02.244761 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14e96a-b0bc-4aa1-b1e2-67951060bf04 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:02.245456 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14e96a-b0bc-4aa1-b1e2-67951060bf04 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:02.245456 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14e96a-b0bc-4aa1-b1e2-67951060bf04 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:02.245456 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 59/115] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:02.245456 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14e96a-b0bc-4aa1-b1e2-67951060bf04 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:02.248296 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1995a2-25c9-4aa7-8b0b-c1b1006920d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:02.250130 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1995a2-25c9-4aa7-8b0b-c1b1006920d9 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:02.266454 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:02.335791 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:02.357327 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 57/116] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:41:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:41:02.358359 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1995a2-25c9-4aa7-8b0b-c1b1006920d9 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:02.367430 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14e96a-b0bc-4aa1-b1e2-67951060bf04 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:02.404645 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01953a-d9dd-4d43-b231-4210cee87043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:02.405274 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01953a-d9dd-4d43-b231-4210cee87043 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:02.405556 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01953a-d9dd-4d43-b231-4210cee87043 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:02.405865 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01953a-d9dd-4d43-b231-4210cee87043 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:02.416549 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01953a-d9dd-4d43-b231-4210cee87043 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:02.421410 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-ab01953a-d9dd-4d43-b231-4210cee87043 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:41:02.421410 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:02.421410 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:02.421410 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:02.421410 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:02.421410 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:02.421410 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:02.421410 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:02.421410 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:02.421410 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:02.421410 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:02.421410 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:02.421410 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:02.421410 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:02.421410 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:02.421410 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:02.422442 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:02.422442 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:02.422442 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:02.422442 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:02.422442 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:02.422442 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:02.422442 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:02.422442 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:02.422442 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:02.422442 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:02.422442 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:02.422442 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:02.422442 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:02.422442 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:02.422442 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:02.422442 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:02.423190 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:02.423190 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:02.423190 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:02.423190 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:02.423190 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:02.423190 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:02.423190 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:02.423190 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:02.423190 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:02.423190 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:02.423190 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:41:02.423190 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:02.423190 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 60/117] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:41:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:02.423840 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a479603-eb81-4622-8a67-cdb1a318fecf None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:02.424350 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a479603-eb81-4622-8a67-cdb1a318fecf None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:02.424350 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a479603-eb81-4622-8a67-cdb1a318fecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:02.443109 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-5a479603-eb81-4622-8a67-cdb1a318fecf None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:02.444311 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5a479603-eb81-4622-8a67-cdb1a318fecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:02.478113 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1995a2-25c9-4aa7-8b0b-c1b1006920d9 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:02.530001 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3bf9ac-f15d-4f50-89a3-b0e0d24f11ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:02.531011 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3bf9ac-f15d-4f50-89a3-b0e0d24f11ec None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:02.531454 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3bf9ac-f15d-4f50-89a3-b0e0d24f11ec None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:02.531830 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3bf9ac-f15d-4f50-89a3-b0e0d24f11ec None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:02.532776 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3bf9ac-f15d-4f50-89a3-b0e0d24f11ec None admin] RBAC: Adding query filter params (name=member) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:02.533254 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3bf9ac-f15d-4f50-89a3-b0e0d24f11ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:02.535493 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3bf9ac-f15d-4f50-89a3-b0e0d24f11ec None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:02.539359 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 61/118] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:02.540739 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a479603-eb81-4622-8a67-cdb1a318fecf None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:02.555085 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:02.564329 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 58/119] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Aug 28 00:41:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:02.564329 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3bf9ac-f15d-4f50-89a3-b0e0d24f11ec None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:02.648335 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:02.667828 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a479603-eb81-4622-8a67-cdb1a318fecf None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:02.709411 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486a9f3-1c91-4c3d-bc3b-5a5473936d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:02.710057 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486a9f3-1c91-4c3d-bc3b-5a5473936d47 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:02.710342 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486a9f3-1c91-4c3d-bc3b-5a5473936d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:02.710617 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486a9f3-1c91-4c3d-bc3b-5a5473936d47 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:02.711295 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486a9f3-1c91-4c3d-bc3b-5a5473936d47 None admin] RBAC: Adding query filter params (name=member) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:02.711761 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486a9f3-1c91-4c3d-bc3b-5a5473936d47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:02.713024 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486a9f3-1c91-4c3d-bc3b-5a5473936d47 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:02.715477 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3bf9ac-f15d-4f50-89a3-b0e0d24f11ec None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:02.723426 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 62/120] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Aug 28 00:41:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:02.724335 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486a9f3-1c91-4c3d-bc3b-5a5473936d47 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:02.761072 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c8eee-4ca3-4595-8280-ed5fd3a7ed41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:02.761716 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c8eee-4ca3-4595-8280-ed5fd3a7ed41 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:02.762032 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c8eee-4ca3-4595-8280-ed5fd3a7ed41 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:02.762316 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c8eee-4ca3-4595-8280-ed5fd3a7ed41 None admin] PATH_INFO: `/v3/projects/93e707bfff714b1c80277c83a2ed2c93` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:02.763465 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c8eee-4ca3-4595-8280-ed5fd3a7ed41 None admin] RBAC: Authorizing `identity:get_project(project_id=93e707bfff714b1c80277c83a2ed2c93)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:02.764935 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c8eee-4ca3-4595-8280-ed5fd3a7ed41 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:02.766927 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 59/121] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:02 2022] GET /identity/v3/projects/93e707bfff714b1c80277c83a2ed2c93 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:02.767769 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c8eee-4ca3-4595-8280-ed5fd3a7ed41 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:02.813273 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:02.850792 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486a9f3-1c91-4c3d-bc3b-5a5473936d47 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:02.890189 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee241d5e-2ab5-4cd0-91d3-8ff0086cdb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:02.890785 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c8eee-4ca3-4595-8280-ed5fd3a7ed41 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:02.891019 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee241d5e-2ab5-4cd0-91d3-8ff0086cdb44 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:02.891318 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee241d5e-2ab5-4cd0-91d3-8ff0086cdb44 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:02.891596 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee241d5e-2ab5-4cd0-91d3-8ff0086cdb44 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:02.892289 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee241d5e-2ab5-4cd0-91d3-8ff0086cdb44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:02.892598 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee241d5e-2ab5-4cd0-91d3-8ff0086cdb44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:02.894037 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee241d5e-2ab5-4cd0-91d3-8ff0086cdb44 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:02.903041 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 63/122] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:02.903654 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee241d5e-2ab5-4cd0-91d3-8ff0086cdb44 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:02.911063 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:02.935189 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc2e90-0b67-4c94-8f8e-50d3f22b5f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:02.935750 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc2e90-0b67-4c94-8f8e-50d3f22b5f6b None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:02.936030 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc2e90-0b67-4c94-8f8e-50d3f22b5f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:02.936303 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc2e90-0b67-4c94-8f8e-50d3f22b5f6b None admin] PATH_INFO: `/v3/users/aa5b6bfda63641828423fc56bb44215c` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:02.937710 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc2e90-0b67-4c94-8f8e-50d3f22b5f6b None admin] RBAC: Authorizing `identity:get_user(user_id=aa5b6bfda63641828423fc56bb44215c)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:02.939219 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc2e90-0b67-4c94-8f8e-50d3f22b5f6b None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:02.941034 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 60/123] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:41:02 2022] GET /identity/v3/users/aa5b6bfda63641828423fc56bb44215c => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:02.941799 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc2e90-0b67-4c94-8f8e-50d3f22b5f6b None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:03.009166 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee241d5e-2ab5-4cd0-91d3-8ff0086cdb44 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:03.041065 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:03.046472 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc2e90-0b67-4c94-8f8e-50d3f22b5f6b None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:03.047930 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a97991-69de-4c69-b8c9-0af8d9126a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:03.048577 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a97991-69de-4c69-b8c9-0af8d9126a10 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:03.048871 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a97991-69de-4c69-b8c9-0af8d9126a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:03.049197 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a97991-69de-4c69-b8c9-0af8d9126a10 None admin] PATH_INFO: `/v3/users/aa5b6bfda63641828423fc56bb44215c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:03.050382 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a97991-69de-4c69-b8c9-0af8d9126a10 None admin] RBAC: Authorizing `identity:get_user(user_id=aa5b6bfda63641828423fc56bb44215c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:03.051881 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a97991-69de-4c69-b8c9-0af8d9126a10 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:03.053673 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 64/124] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:41:02 2022] GET /identity/v3/users/aa5b6bfda63641828423fc56bb44215c => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:03.054274 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a97991-69de-4c69-b8c9-0af8d9126a10 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:03.085979 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99057846-656e-4a0b-8fe0-54b95ed7901c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:03.086635 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99057846-656e-4a0b-8fe0-54b95ed7901c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:03.086866 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99057846-656e-4a0b-8fe0-54b95ed7901c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:03.087138 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99057846-656e-4a0b-8fe0-54b95ed7901c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:03.087894 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99057846-656e-4a0b-8fe0-54b95ed7901c None admin] RBAC: Adding query filter params (role.id=3e76264611ba49e6abbc019c0928e888, scope.project.id=93e707bfff714b1c80277c83a2ed2c93, user.id=4399c9bdccc742ea927325dd9b7b50b1) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:03.088207 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99057846-656e-4a0b-8fe0-54b95ed7901c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:03.089670 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99057846-656e-4a0b-8fe0-54b95ed7901c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:03.095614 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 61/125] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:41:02 2022] GET /identity/v3/role_assignments?user.id=4399c9bdccc742ea927325dd9b7b50b1&scope.project.id=93e707bfff714b1c80277c83a2ed2c93&role.id=3e76264611ba49e6abbc019c0928e888 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:03.096401 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99057846-656e-4a0b-8fe0-54b95ed7901c None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:03.170596 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:03.180072 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a97991-69de-4c69-b8c9-0af8d9126a10 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:03.226407 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0741ee-f925-499f-ab5c-3bc72950eccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:03.227035 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0741ee-f925-499f-ab5c-3bc72950eccb None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:03.227320 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0741ee-f925-499f-ab5c-3bc72950eccb None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:03.227596 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0741ee-f925-499f-ab5c-3bc72950eccb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:03.241347 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99057846-656e-4a0b-8fe0-54b95ed7901c None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:03.245793 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0741ee-f925-499f-ab5c-3bc72950eccb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:03.253615 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-5e0741ee-f925-499f-ab5c-3bc72950eccb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:41:03.253615 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:03.253615 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:03.253615 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:03.253615 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:03.253615 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:03.253615 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:03.253615 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:03.253615 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:03.253615 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:03.253615 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:03.253615 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:03.253615 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:03.253615 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:03.253615 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:03.253615 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:03.254561 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:03.254561 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:03.254561 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:03.254561 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:03.254561 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:03.254561 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:03.254561 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:03.254561 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:03.254561 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:03.254561 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:03.254561 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:03.254561 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:03.254561 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:03.254561 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:03.254561 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:03.254561 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:03.255326 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:03.255326 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:03.255326 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:03.255326 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:03.255326 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:03.255326 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:03.255326 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:03.255326 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:03.255326 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:03.255326 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:03.255326 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:41:03.255326 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:03.258239 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 65/126] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Aug 28 00:41:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:03.258860 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0741ee-f925-499f-ab5c-3bc72950eccb None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:03.287069 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59cb63-e66b-4124-a58a-f1d45fe6c3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:03.288012 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59cb63-e66b-4124-a58a-f1d45fe6c3ad None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:03.288491 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59cb63-e66b-4124-a58a-f1d45fe6c3ad None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:03.288996 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59cb63-e66b-4124-a58a-f1d45fe6c3ad None admin] PATH_INFO: `/v3/users/f0ea7ade0fdf4b01bc4d2a18f09385cb` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:03.290344 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59cb63-e66b-4124-a58a-f1d45fe6c3ad None admin] RBAC: Authorizing `identity:get_user(user_id=f0ea7ade0fdf4b01bc4d2a18f09385cb)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:03.292058 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59cb63-e66b-4124-a58a-f1d45fe6c3ad None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:03.293824 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 62/127] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:41:03 2022] GET /identity/v3/users/f0ea7ade0fdf4b01bc4d2a18f09385cb => generated 247 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:03.294645 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59cb63-e66b-4124-a58a-f1d45fe6c3ad None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:03.329397 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:03.373788 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0741ee-f925-499f-ab5c-3bc72950eccb None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:03.413274 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59cb63-e66b-4124-a58a-f1d45fe6c3ad None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:03.421709 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618e0fa-a70c-43fe-8a5c-0a6580ff3a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:03.422540 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618e0fa-a70c-43fe-8a5c-0a6580ff3a23 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:03.422922 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618e0fa-a70c-43fe-8a5c-0a6580ff3a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:03.423300 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618e0fa-a70c-43fe-8a5c-0a6580ff3a23 None admin] PATH_INFO: `/v3/projects/4e9f6d41f6a049858cfcfeb5f12fab19` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:03.425131 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6618e0fa-a70c-43fe-8a5c-0a6580ff3a23 None admin] RBAC: Authorizing `identity:get_project(project_id=4e9f6d41f6a049858cfcfeb5f12fab19)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:03.426919 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6618e0fa-a70c-43fe-8a5c-0a6580ff3a23 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:03.429143 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 66/128] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:03 2022] GET /identity/v3/projects/4e9f6d41f6a049858cfcfeb5f12fab19 => generated 312 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:03.430279 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618e0fa-a70c-43fe-8a5c-0a6580ff3a23 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:03.438220 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:03.453767 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428782a-0a52-40d4-9f0d-02556a63025a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:03.455102 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428782a-0a52-40d4-9f0d-02556a63025a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:03.455508 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428782a-0a52-40d4-9f0d-02556a63025a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:03.455922 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428782a-0a52-40d4-9f0d-02556a63025a None admin] PATH_INFO: `/v3/projects/93e707bfff714b1c80277c83a2ed2c93` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:03.457257 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428782a-0a52-40d4-9f0d-02556a63025a None admin] RBAC: Authorizing `identity:get_project(project_id=93e707bfff714b1c80277c83a2ed2c93)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:03.459373 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428782a-0a52-40d4-9f0d-02556a63025a None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:03.461069 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 63/129] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:03 2022] GET /identity/v3/projects/93e707bfff714b1c80277c83a2ed2c93 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:03.461878 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428782a-0a52-40d4-9f0d-02556a63025a None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:03.551326 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618e0fa-a70c-43fe-8a5c-0a6580ff3a23 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:03.570210 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428782a-0a52-40d4-9f0d-02556a63025a None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:03.579703 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:03.589034 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c8a64-c1c1-4405-9533-8e1bd8cb421a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:03.589999 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c8a64-c1c1-4405-9533-8e1bd8cb421a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:03.590500 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c8a64-c1c1-4405-9533-8e1bd8cb421a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:03.590962 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c8a64-c1c1-4405-9533-8e1bd8cb421a None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:03.591827 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c8a64-c1c1-4405-9533-8e1bd8cb421a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:03.592333 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c8a64-c1c1-4405-9533-8e1bd8cb421a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:03.594141 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c8a64-c1c1-4405-9533-8e1bd8cb421a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:03.603781 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 67/130] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:41:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:03.605006 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c8a64-c1c1-4405-9533-8e1bd8cb421a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:03.613773 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d464f75-91a5-4ce6-968f-cdb418f9f7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:03.614521 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d464f75-91a5-4ce6-968f-cdb418f9f7f8 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:03.614813 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d464f75-91a5-4ce6-968f-cdb418f9f7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:03.615105 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d464f75-91a5-4ce6-968f-cdb418f9f7f8 None admin] PATH_INFO: `/v3/projects/93e707bfff714b1c80277c83a2ed2c93` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:03.616287 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d464f75-91a5-4ce6-968f-cdb418f9f7f8 None admin] RBAC: Authorizing `identity:get_project(project_id=93e707bfff714b1c80277c83a2ed2c93)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:03.617810 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d464f75-91a5-4ce6-968f-cdb418f9f7f8 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:03.619744 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 64/131] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:03 2022] GET /identity/v3/projects/93e707bfff714b1c80277c83a2ed2c93 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:03.625081 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d464f75-91a5-4ce6-968f-cdb418f9f7f8 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:03.686245 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:03.714481 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c8a64-c1c1-4405-9533-8e1bd8cb421a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:03.729291 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d464f75-91a5-4ce6-968f-cdb418f9f7f8 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:03.751085 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e39f22-6c65-4913-ac86-d0ce42994197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:03.751761 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e39f22-6c65-4913-ac86-d0ce42994197 None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:03.752149 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e39f22-6c65-4913-ac86-d0ce42994197 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:03.752330 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e39f22-6c65-4913-ac86-d0ce42994197 None admin] PATH_INFO: `/v3/projects/4e9f6d41f6a049858cfcfeb5f12fab19/users/aa5b6bfda63641828423fc56bb44215c/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:03.754308 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e39f22-6c65-4913-ac86-d0ce42994197 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e9f6d41f6a049858cfcfeb5f12fab19, user_id=aa5b6bfda63641828423fc56bb44215c, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:03.755780 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e39f22-6c65-4913-ac86-d0ce42994197 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:03.765804 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f157e-07de-4af0-8796-4229d0af7596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:03.766503 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f157e-07de-4af0-8796-4229d0af7596 None admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:03.766789 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f157e-07de-4af0-8796-4229d0af7596 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:03.767068 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f157e-07de-4af0-8796-4229d0af7596 None admin] PATH_INFO: `/v3/projects/93e707bfff714b1c80277c83a2ed2c93/users/aa5b6bfda63641828423fc56bb44215c/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:03.768965 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f157e-07de-4af0-8796-4229d0af7596 None admin] RBAC: Authorizing `identity:create_grant(project_id=93e707bfff714b1c80277c83a2ed2c93, user_id=aa5b6bfda63641828423fc56bb44215c, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:03.770449 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 68/132] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Aug 28 00:41:03 2022] PUT /identity/v3/projects/4e9f6d41f6a049858cfcfeb5f12fab19/users/aa5b6bfda63641828423fc56bb44215c/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:41:03.770567 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f157e-07de-4af0-8796-4229d0af7596 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:03.774763 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e39f22-6c65-4913-ac86-d0ce42994197 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:03.804466 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 65/133] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Aug 28 00:41:03 2022] PUT /identity/v3/projects/93e707bfff714b1c80277c83a2ed2c93/users/aa5b6bfda63641828423fc56bb44215c/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:41:03.806212 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f157e-07de-4af0-8796-4229d0af7596 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:03.837966 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:03.915208 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e39f22-6c65-4913-ac86-d0ce42994197 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:03.964516 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949ca01-2e66-4189-93df-2affc4d6d5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:03.965774 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949ca01-2e66-4189-93df-2affc4d6d5a8 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:03.966084 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949ca01-2e66-4189-93df-2affc4d6d5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:03.966645 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949ca01-2e66-4189-93df-2affc4d6d5a8 None admin] PATH_INFO: `/v3/users/aa5b6bfda63641828423fc56bb44215c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:03.968147 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2949ca01-2e66-4189-93df-2affc4d6d5a8 None admin] RBAC: Authorizing `identity:get_user(user_id=aa5b6bfda63641828423fc56bb44215c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:03.970447 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2949ca01-2e66-4189-93df-2affc4d6d5a8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:03.972146 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 69/134] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:41:03 2022] GET /identity/v3/users/aa5b6bfda63641828423fc56bb44215c => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:03.973352 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a94a24-9f65-44d4-adba-5f61ba6856ed None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:03.973641 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a94a24-9f65-44d4-adba-5f61ba6856ed None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:03.973941 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a94a24-9f65-44d4-adba-5f61ba6856ed None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:03.978636 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 70/135] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:03.979274 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a94a24-9f65-44d4-adba-5f61ba6856ed None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:03.995792 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f157e-07de-4af0-8796-4229d0af7596 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:04.009578 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:04.079337 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c7b83-0b23-46f6-8e77-c8957aa7f3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:04.079949 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c7b83-0b23-46f6-8e77-c8957aa7f3a3 None admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:04.080235 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c7b83-0b23-46f6-8e77-c8957aa7f3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:04.080517 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c7b83-0b23-46f6-8e77-c8957aa7f3a3 None admin] PATH_INFO: `/v3/projects/93e707bfff714b1c80277c83a2ed2c93/users/f0ea7ade0fdf4b01bc4d2a18f09385cb/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:04.087217 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c7b83-0b23-46f6-8e77-c8957aa7f3a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=93e707bfff714b1c80277c83a2ed2c93, user_id=f0ea7ade0fdf4b01bc4d2a18f09385cb, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:04.088721 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c7b83-0b23-46f6-8e77-c8957aa7f3a3 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:04.114320 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 66/136] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Aug 28 00:41:03 2022] PUT /identity/v3/projects/93e707bfff714b1c80277c83a2ed2c93/users/f0ea7ade0fdf4b01bc4d2a18f09385cb/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:41:04.115640 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7759fae-5dec-488c-b608-ec86b51fa321 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:04.115929 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7759fae-5dec-488c-b608-ec86b51fa321 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:04.116238 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7759fae-5dec-488c-b608-ec86b51fa321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:04.123110 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a94a24-9f65-44d4-adba-5f61ba6856ed None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:04.155986 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-e7759fae-5dec-488c-b608-ec86b51fa321 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:04.160635 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e7759fae-5dec-488c-b608-ec86b51fa321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:04.163348 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:04.201790 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a5bca-19b0-43bb-b44a-38a3821cf83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:04.204187 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a5bca-19b0-43bb-b44a-38a3821cf83b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:04.204474 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a5bca-19b0-43bb-b44a-38a3821cf83b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:04.204755 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a5bca-19b0-43bb-b44a-38a3821cf83b None admin] PATH_INFO: `/v3/projects/93e707bfff714b1c80277c83a2ed2c93` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:04.209228 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a5bca-19b0-43bb-b44a-38a3821cf83b None admin] RBAC: Authorizing `identity:get_project(project_id=93e707bfff714b1c80277c83a2ed2c93)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:04.213398 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a5bca-19b0-43bb-b44a-38a3821cf83b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:04.215453 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 71/137] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:03 2022] GET /identity/v3/projects/93e707bfff714b1c80277c83a2ed2c93 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:04.222240 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a5bca-19b0-43bb-b44a-38a3821cf83b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:04.337086 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 67/138] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:04.387205 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a5bca-19b0-43bb-b44a-38a3821cf83b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:04.430693 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525a607-b766-40ea-84df-4325271bd788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:04.431420 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525a607-b766-40ea-84df-4325271bd788 None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:04.431707 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525a607-b766-40ea-84df-4325271bd788 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:04.431985 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525a607-b766-40ea-84df-4325271bd788 None admin] PATH_INFO: `/v3/projects/93e707bfff714b1c80277c83a2ed2c93/users/aa5b6bfda63641828423fc56bb44215c/roles/258091cadd094ad2a608d396036e8869` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:04.437341 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7525a607-b766-40ea-84df-4325271bd788 None admin] RBAC: Authorizing `identity:create_grant(project_id=93e707bfff714b1c80277c83a2ed2c93, user_id=aa5b6bfda63641828423fc56bb44215c, role_id=258091cadd094ad2a608d396036e8869)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:04.439058 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7525a607-b766-40ea-84df-4325271bd788 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:04.461505 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 72/139] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Aug 28 00:41:04 2022] PUT /identity/v3/projects/93e707bfff714b1c80277c83a2ed2c93/users/aa5b6bfda63641828423fc56bb44215c/roles/258091cadd094ad2a608d396036e8869 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:41:04.868866 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7759fae-5dec-488c-b608-ec86b51fa321 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:04.982384 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:04.986825 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7759fae-5dec-488c-b608-ec86b51fa321 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:05.022596 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb16b8-04ee-4b32-9f96-cedadfc2d47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:05.023235 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb16b8-04ee-4b32-9f96-cedadfc2d47e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:05.023515 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb16b8-04ee-4b32-9f96-cedadfc2d47e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:05.023788 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb16b8-04ee-4b32-9f96-cedadfc2d47e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:05.024886 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb16b8-04ee-4b32-9f96-cedadfc2d47e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:05.026450 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb16b8-04ee-4b32-9f96-cedadfc2d47e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:05.032702 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 68/140] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:41:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:05.034111 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525a607-b766-40ea-84df-4325271bd788 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:05.084425 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:05.165378 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525a607-b766-40ea-84df-4325271bd788 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:05.209835 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5e304-624b-4bb4-b94a-d63c4b4f3f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:05.210743 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5e304-624b-4bb4-b94a-d63c4b4f3f8b None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:05.211161 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5e304-624b-4bb4-b94a-d63c4b4f3f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:05.211567 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5e304-624b-4bb4-b94a-d63c4b4f3f8b None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:05.212372 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5e304-624b-4bb4-b94a-d63c4b4f3f8b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:05.218186 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5e304-624b-4bb4-b94a-d63c4b4f3f8b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:05.255916 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc30b2-7970-456f-9f85-6215b5205ce9 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:05.256221 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc30b2-7970-456f-9f85-6215b5205ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:05.256474 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc30b2-7970-456f-9f85-6215b5205ce9 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:05.258030 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 69/141] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:41:05.260594 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 73/142] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Aug 28 00:41:05 2022] POST /identity/v3/users => generated 283 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:41:05.262841 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d0d09-e216-44e9-b93a-29bca8f355f5 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:05.263127 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d0d09-e216-44e9-b93a-29bca8f355f5 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:05.263408 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d0d09-e216-44e9-b93a-29bca8f355f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:05.282761 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-3e2d0d09-e216-44e9-b93a-29bca8f355f5 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:05.284245 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3e2d0d09-e216-44e9-b93a-29bca8f355f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:05.356962 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 70/143] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:05.795439 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5e304-624b-4bb4-b94a-d63c4b4f3f8b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:05.925881 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5e304-624b-4bb4-b94a-d63c4b4f3f8b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:05.928121 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:05.976485 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60b2bd-d082-4228-9771-6123dcf1ac4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:05.977136 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60b2bd-d082-4228-9771-6123dcf1ac4e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:05.977415 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60b2bd-d082-4228-9771-6123dcf1ac4e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:05.977687 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60b2bd-d082-4228-9771-6123dcf1ac4e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:05.996166 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60b2bd-d082-4228-9771-6123dcf1ac4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:06.001410 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-ce60b2bd-d082-4228-9771-6123dcf1ac4e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:41:06.001410 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:06.001410 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:06.001410 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:06.001410 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:06.001410 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:06.001410 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:06.001410 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:06.001410 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:06.001410 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:06.001410 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:06.001410 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:06.001410 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:06.001410 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:06.001410 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:06.001410 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:06.002326 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:06.002326 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:06.002326 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:06.002326 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:06.002326 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:06.002326 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:06.002326 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:06.002326 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:06.002326 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:06.002326 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:06.002326 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:06.002326 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:06.002326 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:06.002326 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:06.002326 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:06.002326 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:06.003491 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:06.003491 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:06.003491 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:06.003491 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:06.003491 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:06.003491 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:06.003491 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:06.003491 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:06.003491 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:06.003491 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:06.003491 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:41:06.003491 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:06.003491 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 74/144] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:06.010249 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d0d09-e216-44e9-b93a-29bca8f355f5 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:06.134885 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:06.141796 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d0d09-e216-44e9-b93a-29bca8f355f5 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:06.188940 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a2d09-65a1-428e-a54a-eb58cf2137a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:06.189554 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a2d09-65a1-428e-a54a-eb58cf2137a6 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:06.189830 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a2d09-65a1-428e-a54a-eb58cf2137a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:06.190139 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a2d09-65a1-428e-a54a-eb58cf2137a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:06.190811 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a2d09-65a1-428e-a54a-eb58cf2137a6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:06.191111 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a2d09-65a1-428e-a54a-eb58cf2137a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:06.192489 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a2d09-65a1-428e-a54a-eb58cf2137a6 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:06.203483 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 71/145] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Aug 28 00:41:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:06.208982 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60b2bd-d082-4228-9771-6123dcf1ac4e None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:06.343151 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a213ca8-bf7e-4ea4-8647-df9f201c8845 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:06.343365 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a213ca8-bf7e-4ea4-8647-df9f201c8845 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:06.343648 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a213ca8-bf7e-4ea4-8647-df9f201c8845 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:06.345532 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 72/146] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:06.350245 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60b2bd-d082-4228-9771-6123dcf1ac4e None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:06.350963 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c5125-1d71-4af8-8f30-c395c732dfd3 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:06.351244 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c5125-1d71-4af8-8f30-c395c732dfd3 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:06.351524 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c5125-1d71-4af8-8f30-c395c732dfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:06.388939 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-243c5125-1d71-4af8-8f30-c395c732dfd3 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:06.390493 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-243c5125-1d71-4af8-8f30-c395c732dfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:06.390886 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ad4c0-f8bb-4350-9ee2-2cd6437c4c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:06.391537 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ad4c0-f8bb-4350-9ee2-2cd6437c4c8a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:06.391816 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ad4c0-f8bb-4350-9ee2-2cd6437c4c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:06.392091 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ad4c0-f8bb-4350-9ee2-2cd6437c4c8a None admin] PATH_INFO: `/v3/users/4399c9bdccc742ea927325dd9b7b50b1` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:06.393454 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ad4c0-f8bb-4350-9ee2-2cd6437c4c8a None admin] RBAC: Authorizing `identity:get_user(user_id=4399c9bdccc742ea927325dd9b7b50b1)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:06.395046 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ad4c0-f8bb-4350-9ee2-2cd6437c4c8a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:06.396998 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 75/147] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:41:06 2022] GET /identity/v3/users/4399c9bdccc742ea927325dd9b7b50b1 => generated 289 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:06.407342 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ad4c0-f8bb-4350-9ee2-2cd6437c4c8a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:06.447134 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:06.531922 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 73/148] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:41:06.591980 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ad4c0-f8bb-4350-9ee2-2cd6437c4c8a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:06.636106 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb32e23-87cb-4cb9-a5e9-7032bd754f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:06.636789 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb32e23-87cb-4cb9-a5e9-7032bd754f00 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:06.637070 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb32e23-87cb-4cb9-a5e9-7032bd754f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:06.637342 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb32e23-87cb-4cb9-a5e9-7032bd754f00 None admin] PATH_INFO: `/v3/projects/93e707bfff714b1c80277c83a2ed2c93` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:06.642676 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb32e23-87cb-4cb9-a5e9-7032bd754f00 None admin] RBAC: Authorizing `identity:get_project(project_id=93e707bfff714b1c80277c83a2ed2c93)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:06.644132 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb32e23-87cb-4cb9-a5e9-7032bd754f00 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:06.646122 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 76/149] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:06 2022] GET /identity/v3/projects/93e707bfff714b1c80277c83a2ed2c93 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:41:06.651903 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c5125-1d71-4af8-8f30-c395c732dfd3 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:06.775457 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:06.790908 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c5125-1d71-4af8-8f30-c395c732dfd3 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:06.832905 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df768900-1351-463a-af24-d1be8443a84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:06.833575 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df768900-1351-463a-af24-d1be8443a84d None admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:06.833874 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df768900-1351-463a-af24-d1be8443a84d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:06.834138 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df768900-1351-463a-af24-d1be8443a84d None admin] PATH_INFO: `/v3/projects/93e707bfff714b1c80277c83a2ed2c93/users/4399c9bdccc742ea927325dd9b7b50b1/roles/3e76264611ba49e6abbc019c0928e888` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:06.836310 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df768900-1351-463a-af24-d1be8443a84d None admin] RBAC: Authorizing `identity:create_grant(project_id=93e707bfff714b1c80277c83a2ed2c93, user_id=4399c9bdccc742ea927325dd9b7b50b1, role_id=3e76264611ba49e6abbc019c0928e888)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:06.837769 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df768900-1351-463a-af24-d1be8443a84d None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:06.858931 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 74/150] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Aug 28 00:41:06 2022] PUT /identity/v3/projects/93e707bfff714b1c80277c83a2ed2c93/users/4399c9bdccc742ea927325dd9b7b50b1/roles/3e76264611ba49e6abbc019c0928e888 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:41:06.969291 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012450f-63d9-4322-8b7b-893958a5b822 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:06.969905 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012450f-63d9-4322-8b7b-893958a5b822 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:06.970122 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012450f-63d9-4322-8b7b-893958a5b822 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:06.971749 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 77/151] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:06.977609 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55889c-e43a-4e07-9e10-7db65563a6e1 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:06.977913 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55889c-e43a-4e07-9e10-7db65563a6e1 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:06.978260 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55889c-e43a-4e07-9e10-7db65563a6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:07.007652 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-ba55889c-e43a-4e07-9e10-7db65563a6e1 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:07.009477 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ba55889c-e43a-4e07-9e10-7db65563a6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:07.104347 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 75/152] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:07.150064 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012450f-63d9-4322-8b7b-893958a5b822 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:07.265349 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:07.269714 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012450f-63d9-4322-8b7b-893958a5b822 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:07.309730 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ba8e0-123a-47e3-b969-1f1e1714a2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:07.310389 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ba8e0-123a-47e3-b969-1f1e1714a2c0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:07.310661 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ba8e0-123a-47e3-b969-1f1e1714a2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:07.310927 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ba8e0-123a-47e3-b969-1f1e1714a2c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:07.326939 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ba8e0-123a-47e3-b969-1f1e1714a2c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:07.332297 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-692ba8e0-123a-47e3-b969-1f1e1714a2c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:41:07.332297 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:07.332297 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:07.332297 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:07.332297 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:07.332297 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:07.332297 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:07.332297 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:07.332297 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:07.332297 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:07.332297 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:07.332297 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:07.332297 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:07.332297 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:07.332297 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:07.332297 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:07.334386 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:07.334386 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:07.334386 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:07.334386 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:07.334386 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:07.334386 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:07.334386 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:07.334386 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:07.334386 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:07.334386 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:07.334386 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:07.334386 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:07.334386 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:07.334386 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:07.334386 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:07.334386 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:07.336305 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:07.336305 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:07.336305 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:07.336305 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:07.336305 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:07.336305 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:07.336305 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:07.336305 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:07.336305 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:07.336305 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:07.336305 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:41:07.336305 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:07.336305 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 78/153] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:07.344037 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55889c-e43a-4e07-9e10-7db65563a6e1 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:07.450536 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:07.478662 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55889c-e43a-4e07-9e10-7db65563a6e1 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:07.517554 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5e821-b01d-483e-8026-34373d841f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:07.518118 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5e821-b01d-483e-8026-34373d841f93 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:07.518394 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5e821-b01d-483e-8026-34373d841f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:07.518661 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5e821-b01d-483e-8026-34373d841f93 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:07.519334 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5e821-b01d-483e-8026-34373d841f93 None admin] RBAC: Adding query filter params (name=member) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:07.519630 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5e821-b01d-483e-8026-34373d841f93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:07.521024 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5e821-b01d-483e-8026-34373d841f93 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:07.537373 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 76/154] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Aug 28 00:41:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:07.538270 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ba8e0-123a-47e3-b969-1f1e1714a2c0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:07.550247 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5e821-b01d-483e-8026-34373d841f93 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:07.709202 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ba8e0-123a-47e3-b969-1f1e1714a2c0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:07.762839 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbdc45-cf0f-4df2-96ab-f0514a02566c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:07.763936 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbdc45-cf0f-4df2-96ab-f0514a02566c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:07.764409 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbdc45-cf0f-4df2-96ab-f0514a02566c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:07.764904 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbdc45-cf0f-4df2-96ab-f0514a02566c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:07.785978 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5e821-b01d-483e-8026-34373d841f93 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:07.787404 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddbdc45-cf0f-4df2-96ab-f0514a02566c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:07.792768 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-8ddbdc45-cf0f-4df2-96ab-f0514a02566c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:41:07.792768 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:07.792768 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:07.792768 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:07.792768 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:07.792768 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:07.792768 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:07.792768 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:07.792768 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:07.792768 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:07.792768 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:07.792768 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:07.792768 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:07.792768 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:07.792768 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:07.792768 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:07.793631 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:07.793631 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:07.793631 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:07.793631 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:07.793631 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:07.793631 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:07.793631 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:07.793631 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:07.793631 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:07.793631 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:07.793631 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:07.793631 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:07.793631 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:07.793631 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:07.793631 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:07.793631 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:07.794640 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:07.794640 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:07.794640 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:07.794640 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:07.794640 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:07.794640 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:07.794640 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:07.794640 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:07.794640 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:07.794640 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:07.794640 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:41:07.794640 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:07.804054 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 79/155] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:07.805663 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16da71-6ffc-419c-a6ac-68d9bb45aff7 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:07.806165 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16da71-6ffc-419c-a6ac-68d9bb45aff7 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:07.806655 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16da71-6ffc-419c-a6ac-68d9bb45aff7 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:07.808665 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 80/156] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:07.810015 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35891e80-f4e4-49b8-b66e-9ef9906b4fb9 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:07.810499 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35891e80-f4e4-49b8-b66e-9ef9906b4fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:07.810958 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35891e80-f4e4-49b8-b66e-9ef9906b4fb9 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:07.819634 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 81/157] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:07 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:07.821168 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f90493-bc09-47bc-8958-e0b40cecdc57 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:07.821667 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f90493-bc09-47bc-8958-e0b40cecdc57 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:07.822203 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f90493-bc09-47bc-8958-e0b40cecdc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:07.828414 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b61f95-b838-4f71-b240-2913fc7b0f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:07.829059 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b61f95-b838-4f71-b240-2913fc7b0f9e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:07.829339 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b61f95-b838-4f71-b240-2913fc7b0f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:07.829613 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b61f95-b838-4f71-b240-2913fc7b0f9e None admin] PATH_INFO: `/v3/users/aa5b6bfda63641828423fc56bb44215c` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:07.830874 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b61f95-b838-4f71-b240-2913fc7b0f9e None admin] RBAC: Authorizing `identity:get_user(user_id=aa5b6bfda63641828423fc56bb44215c)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:07.832528 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b61f95-b838-4f71-b240-2913fc7b0f9e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:07.838409 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 77/158] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:41:07 2022] GET /identity/v3/users/aa5b6bfda63641828423fc56bb44215c => generated 275 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:07.838409 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b61f95-b838-4f71-b240-2913fc7b0f9e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:07.848481 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-17f90493-bc09-47bc-8958-e0b40cecdc57 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:07.850086 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-17f90493-bc09-47bc-8958-e0b40cecdc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:07.864738 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:07.866688 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:07.943477 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 82/159] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:07.945097 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ae808-6f7f-49e4-9e2a-1bc716546ff7 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:07.945578 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ae808-6f7f-49e4-9e2a-1bc716546ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:07.950171 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ae808-6f7f-49e4-9e2a-1bc716546ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:07.974181 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-986ae808-6f7f-49e4-9e2a-1bc716546ff7 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:07.975935 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-986ae808-6f7f-49e4-9e2a-1bc716546ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:08.075464 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 83/160] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:08.076634 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ae808-6f7f-49e4-9e2a-1bc716546ff7 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:08.088015 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b61f95-b838-4f71-b240-2913fc7b0f9e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:08.190576 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95844957-6939-486b-b797-b09399868ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:08.191200 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95844957-6939-486b-b797-b09399868ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:08.191521 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95844957-6939-486b-b797-b09399868ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:08.191734 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95844957-6939-486b-b797-b09399868ec4 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:08.192417 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95844957-6939-486b-b797-b09399868ec4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:08.192715 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95844957-6939-486b-b797-b09399868ec4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:08.193545 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:08.194349 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95844957-6939-486b-b797-b09399868ec4 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:08.215705 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 78/161] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Aug 28 00:41:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:08.222881 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95844957-6939-486b-b797-b09399868ec4 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:08.226753 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ae808-6f7f-49e4-9e2a-1bc716546ff7 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:08.272985 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4ccf8-db2c-43fe-af03-c9e1626a5bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:08.274477 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4ccf8-db2c-43fe-af03-c9e1626a5bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:08.274987 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4ccf8-db2c-43fe-af03-c9e1626a5bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:08.275453 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4ccf8-db2c-43fe-af03-c9e1626a5bf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:08.364059 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4ccf8-db2c-43fe-af03-c9e1626a5bf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:08.365914 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4ccf8-db2c-43fe-af03-c9e1626a5bf2 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:08.431941 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:08.451949 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:08.476649 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 84/162] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:41:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:41:08.482642 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4ccf8-db2c-43fe-af03-c9e1626a5bf2 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:08.545862 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95844957-6939-486b-b797-b09399868ec4 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:08.607108 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ced92-0211-406f-a1af-b58e0c754634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:08.607752 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ced92-0211-406f-a1af-b58e0c754634 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:08.608027 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ced92-0211-406f-a1af-b58e0c754634 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:08.608294 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ced92-0211-406f-a1af-b58e0c754634 None admin] PATH_INFO: `/v3/users/aa5b6bfda63641828423fc56bb44215c` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:08.617929 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ced92-0211-406f-a1af-b58e0c754634 None admin] RBAC: Authorizing `identity:get_user(user_id=aa5b6bfda63641828423fc56bb44215c)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:08.617929 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ced92-0211-406f-a1af-b58e0c754634 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:08.617929 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 79/163] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:41:08 2022] GET /identity/v3/users/aa5b6bfda63641828423fc56bb44215c => generated 275 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:08.623394 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ced92-0211-406f-a1af-b58e0c754634 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:08.637334 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4ccf8-db2c-43fe-af03-c9e1626a5bf2 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:08.690926 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea16c8-ca2a-48ec-98ee-aef56c21d309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:08.691958 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea16c8-ca2a-48ec-98ee-aef56c21d309 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:08.692460 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea16c8-ca2a-48ec-98ee-aef56c21d309 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:08.692995 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea16c8-ca2a-48ec-98ee-aef56c21d309 None admin] PATH_INFO: `/v3/projects/4e9f6d41f6a049858cfcfeb5f12fab19` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:08.694496 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea16c8-ca2a-48ec-98ee-aef56c21d309 None admin] RBAC: Authorizing `identity:get_project(project_id=4e9f6d41f6a049858cfcfeb5f12fab19)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:08.696164 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea16c8-ca2a-48ec-98ee-aef56c21d309 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:08.698255 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 85/164] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:08 2022] GET /identity/v3/projects/4e9f6d41f6a049858cfcfeb5f12fab19 => generated 312 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:08.699229 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea16c8-ca2a-48ec-98ee-aef56c21d309 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:08.750212 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:08.768546 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ced92-0211-406f-a1af-b58e0c754634 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:08.805952 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea16c8-ca2a-48ec-98ee-aef56c21d309 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:08.831207 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa4eba-06d3-4dad-89a7-9e2e618f8687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:08.831837 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa4eba-06d3-4dad-89a7-9e2e618f8687 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:08.832113 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa4eba-06d3-4dad-89a7-9e2e618f8687 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:08.832387 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa4eba-06d3-4dad-89a7-9e2e618f8687 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:08.846500 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:08.882670 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21890d77-8744-4d8a-9fc5-f440752309b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:08.883235 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21890d77-8744-4d8a-9fc5-f440752309b0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:08.883515 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21890d77-8744-4d8a-9fc5-f440752309b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:08.883787 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21890d77-8744-4d8a-9fc5-f440752309b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:08.906062 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21890d77-8744-4d8a-9fc5-f440752309b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:08.911153 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-21890d77-8744-4d8a-9fc5-f440752309b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:41:08.911153 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:08.911153 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:08.911153 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:08.911153 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:08.911153 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:08.911153 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:08.911153 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:08.911153 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:08.911153 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:08.911153 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:08.911153 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:08.911153 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:08.911153 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:08.911153 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:08.911153 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:08.912072 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:08.912072 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:08.912072 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:08.912072 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:08.912072 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:08.912072 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:08.912072 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:08.912072 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:08.912072 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:08.912072 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:08.912072 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:08.912072 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:08.912072 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:08.912072 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:08.912072 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:08.912072 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:08.912886 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:08.912886 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:08.912886 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:08.912886 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:08.912886 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:08.912886 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:08.912886 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:08.912886 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:08.912886 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:08.912886 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:08.912886 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:41:08.912886 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:08.912886 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 86/165] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:41:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:08.913863 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21890d77-8744-4d8a-9fc5-f440752309b0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:08.941458 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa4eba-06d3-4dad-89a7-9e2e618f8687 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:08.947226 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa4eba-06d3-4dad-89a7-9e2e618f8687 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:09.127522 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21890d77-8744-4d8a-9fc5-f440752309b0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:09.138061 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:09.141569 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 80/166] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:41:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:41:09.142539 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa4eba-06d3-4dad-89a7-9e2e618f8687 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:09.199507 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d1b33-61f9-49dc-a3b5-e90b9ae2bf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:09.200127 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d1b33-61f9-49dc-a3b5-e90b9ae2bf95 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:09.200406 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d1b33-61f9-49dc-a3b5-e90b9ae2bf95 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:09.200676 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d1b33-61f9-49dc-a3b5-e90b9ae2bf95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:09.201414 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d1b33-61f9-49dc-a3b5-e90b9ae2bf95 None admin] RBAC: Adding query filter params (role.id=2231e998e50146f4b53b832f2f88c1c8, scope.project.id=4e9f6d41f6a049858cfcfeb5f12fab19, user.id=aa5b6bfda63641828423fc56bb44215c) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:09.201717 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d1b33-61f9-49dc-a3b5-e90b9ae2bf95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:09.202089 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:09.204188 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d1b33-61f9-49dc-a3b5-e90b9ae2bf95 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:09.221326 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 87/167] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:41:08 2022] GET /identity/v3/role_assignments?user.id=aa5b6bfda63641828423fc56bb44215c&scope.project.id=4e9f6d41f6a049858cfcfeb5f12fab19&role.id=2231e998e50146f4b53b832f2f88c1c8 => generated 608 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:09.222666 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d1b33-61f9-49dc-a3b5-e90b9ae2bf95 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:09.298026 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa4eba-06d3-4dad-89a7-9e2e618f8687 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:09.345254 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232affc7-bee6-4d8e-b75f-a14ab66a403c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:09.345915 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232affc7-bee6-4d8e-b75f-a14ab66a403c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:09.346365 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232affc7-bee6-4d8e-b75f-a14ab66a403c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:09.346775 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232affc7-bee6-4d8e-b75f-a14ab66a403c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:09.357544 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232affc7-bee6-4d8e-b75f-a14ab66a403c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:09.362545 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-232affc7-bee6-4d8e-b75f-a14ab66a403c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:41:09.362545 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:09.362545 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:09.362545 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:09.362545 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:09.362545 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:09.362545 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:09.362545 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:09.362545 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:09.362545 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:09.362545 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:09.362545 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:09.362545 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:09.362545 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:09.362545 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:09.362545 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:09.363475 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:09.363475 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:09.363475 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:09.363475 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:09.363475 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:09.363475 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:09.363475 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:09.363475 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:09.363475 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:09.363475 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:09.363475 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:09.363475 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:09.363475 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:09.363475 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:09.363475 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:09.363475 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:09.364331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:09.364331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:09.364331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:09.364331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:09.364331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:09.364331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:09.364331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:09.364331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:09.364331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:09.364331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:09.364331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:41:09.364331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:09.366765 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 81/168] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Aug 28 00:41:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:09.367575 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232affc7-bee6-4d8e-b75f-a14ab66a403c None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:09.370952 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d1b33-61f9-49dc-a3b5-e90b9ae2bf95 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:09.413296 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5d5df-8216-4461-b623-b958f0be2d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:09.414702 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5d5df-8216-4461-b623-b958f0be2d66 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:09.415457 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5d5df-8216-4461-b623-b958f0be2d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:09.415936 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5d5df-8216-4461-b623-b958f0be2d66 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:09.417135 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5d5df-8216-4461-b623-b958f0be2d66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:09.418141 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5d5df-8216-4461-b623-b958f0be2d66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:09.420280 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5d5df-8216-4461-b623-b958f0be2d66 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:09.434116 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 88/169] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:09.436038 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e89763-acd9-4c84-ad13-1102b0db6d1f None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:09.436526 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e89763-acd9-4c84-ad13-1102b0db6d1f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:09.437890 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e89763-acd9-4c84-ad13-1102b0db6d1f None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:09.441048 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 89/170] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:09.443361 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e89763-acd9-4c84-ad13-1102b0db6d1f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:09.478770 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:09.483589 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232affc7-bee6-4d8e-b75f-a14ab66a403c None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:09.502563 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:09.522177 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e493e-9ac9-400c-9f09-20a4bbad8e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:09.523265 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e493e-9ac9-400c-9f09-20a4bbad8e96 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:09.523751 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e493e-9ac9-400c-9f09-20a4bbad8e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:09.524260 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e493e-9ac9-400c-9f09-20a4bbad8e96 None admin] PATH_INFO: `/v3/projects/93e707bfff714b1c80277c83a2ed2c93` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:09.525644 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e493e-9ac9-400c-9f09-20a4bbad8e96 None admin] RBAC: Authorizing `identity:get_project(project_id=93e707bfff714b1c80277c83a2ed2c93)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:09.527405 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e493e-9ac9-400c-9f09-20a4bbad8e96 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:09.540184 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 82/171] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:09 2022] GET /identity/v3/projects/93e707bfff714b1c80277c83a2ed2c93 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:09.541315 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e493e-9ac9-400c-9f09-20a4bbad8e96 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:09.642552 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e89763-acd9-4c84-ad13-1102b0db6d1f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:09.647195 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e493e-9ac9-400c-9f09-20a4bbad8e96 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:09.685047 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82513607-c252-452f-a5ca-143cca95bbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:09.686056 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82513607-c252-452f-a5ca-143cca95bbf3 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:09.686550 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82513607-c252-452f-a5ca-143cca95bbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:09.687059 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82513607-c252-452f-a5ca-143cca95bbf3 None admin] PATH_INFO: `/v3/users/f0ea7ade0fdf4b01bc4d2a18f09385cb` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:09.688644 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82513607-c252-452f-a5ca-143cca95bbf3 None admin] RBAC: Authorizing `identity:get_user(user_id=f0ea7ade0fdf4b01bc4d2a18f09385cb)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:09.690409 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82513607-c252-452f-a5ca-143cca95bbf3 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:09.692383 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 83/172] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:41:09 2022] GET /identity/v3/users/f0ea7ade0fdf4b01bc4d2a18f09385cb => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:09.693794 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed507786-bfe8-4308-a059-6dbe3ecbccb1 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:09.694422 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed507786-bfe8-4308-a059-6dbe3ecbccb1 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:09.694913 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed507786-bfe8-4308-a059-6dbe3ecbccb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:09.715576 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-ed507786-bfe8-4308-a059-6dbe3ecbccb1 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:09.717174 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ed507786-bfe8-4308-a059-6dbe3ecbccb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:09.730574 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e108578-3498-42d1-baa0-d767789eadb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:09.731213 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e108578-3498-42d1-baa0-d767789eadb0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:09.731479 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e108578-3498-42d1-baa0-d767789eadb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:09.731747 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e108578-3498-42d1-baa0-d767789eadb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:09.732423 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e108578-3498-42d1-baa0-d767789eadb0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:09.732719 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e108578-3498-42d1-baa0-d767789eadb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:09.734635 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e108578-3498-42d1-baa0-d767789eadb0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:09.750288 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:09.751715 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 90/173] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:41:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:09.752569 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e108578-3498-42d1-baa0-d767789eadb0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:09.808218 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 84/174] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:09.809413 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed507786-bfe8-4308-a059-6dbe3ecbccb1 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:09.922959 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed507786-bfe8-4308-a059-6dbe3ecbccb1 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:09.926205 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:09.936751 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e108578-3498-42d1-baa0-d767789eadb0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:09.967489 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c2e63-4986-49ab-8031-9193f7c2ffe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:09.968151 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c2e63-4986-49ab-8031-9193f7c2ffe0 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:09.968432 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c2e63-4986-49ab-8031-9193f7c2ffe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:09.968713 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c2e63-4986-49ab-8031-9193f7c2ffe0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:10.003169 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79372f6-84eb-4cd0-be4c-889848548c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:10.003786 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79372f6-84eb-4cd0-be4c-889848548c45 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:10.004058 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79372f6-84eb-4cd0-be4c-889848548c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:10.004320 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79372f6-84eb-4cd0-be4c-889848548c45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:10.005048 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79372f6-84eb-4cd0-be4c-889848548c45 None admin] RBAC: Adding query filter params (role.id=2231e998e50146f4b53b832f2f88c1c8, scope.project.id=93e707bfff714b1c80277c83a2ed2c93, user.id=aa5b6bfda63641828423fc56bb44215c) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:10.005349 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79372f6-84eb-4cd0-be4c-889848548c45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:10.006770 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:10.006878 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79372f6-84eb-4cd0-be4c-889848548c45 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:10.013248 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 91/175] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:41:09 2022] GET /identity/v3/role_assignments?user.id=aa5b6bfda63641828423fc56bb44215c&scope.project.id=93e707bfff714b1c80277c83a2ed2c93&role.id=2231e998e50146f4b53b832f2f88c1c8 => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:10.013879 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79372f6-84eb-4cd0-be4c-889848548c45 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:10.052533 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c2e63-4986-49ab-8031-9193f7c2ffe0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:10.055239 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c2e63-4986-49ab-8031-9193f7c2ffe0 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:10.190514 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 85/176] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:41:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:41:10.199921 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79372f6-84eb-4cd0-be4c-889848548c45 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:10.202691 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c2e63-4986-49ab-8031-9193f7c2ffe0 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:10.284215 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4184b-e2e0-4dba-bd7d-52d5a785ea2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:10.284907 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4184b-e2e0-4dba-bd7d-52d5a785ea2e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:10.285191 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4184b-e2e0-4dba-bd7d-52d5a785ea2e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:10.285461 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4184b-e2e0-4dba-bd7d-52d5a785ea2e None admin] PATH_INFO: `/v3/users/aa5b6bfda63641828423fc56bb44215c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:10.287865 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4184b-e2e0-4dba-bd7d-52d5a785ea2e None admin] RBAC: Authorizing `identity:get_user(user_id=aa5b6bfda63641828423fc56bb44215c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:10.290047 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4184b-e2e0-4dba-bd7d-52d5a785ea2e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:10.293578 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 92/177] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:41:10 2022] GET /identity/v3/users/aa5b6bfda63641828423fc56bb44215c => generated 275 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:10.299684 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4184b-e2e0-4dba-bd7d-52d5a785ea2e None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:10.334685 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:10.363024 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:10.423823 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c2e63-4986-49ab-8031-9193f7c2ffe0 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:10.482440 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4184b-e2e0-4dba-bd7d-52d5a785ea2e None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:10.487822 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e5194-7f8f-4178-a931-b5fae3174fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:10.488678 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e5194-7f8f-4178-a931-b5fae3174fbd None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:10.489122 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e5194-7f8f-4178-a931-b5fae3174fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:10.489546 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e5194-7f8f-4178-a931-b5fae3174fbd None admin] PATH_INFO: `/v3/projects/93e707bfff714b1c80277c83a2ed2c93` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:10.491076 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e5194-7f8f-4178-a931-b5fae3174fbd None admin] RBAC: Authorizing `identity:get_project(project_id=93e707bfff714b1c80277c83a2ed2c93)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:10.492522 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e5194-7f8f-4178-a931-b5fae3174fbd None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:10.494668 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 86/178] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:10 2022] GET /identity/v3/projects/93e707bfff714b1c80277c83a2ed2c93 => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:10.495992 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f17581-6bb9-4529-ae7d-ec6c260948fe None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:10.496275 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f17581-6bb9-4529-ae7d-ec6c260948fe None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:10.496582 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f17581-6bb9-4529-ae7d-ec6c260948fe None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:10.497808 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 87/179] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:10.502623 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f17581-6bb9-4529-ae7d-ec6c260948fe None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:10.526267 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d5ad6-98ad-45e1-acfc-147a5206758d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:10.526886 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d5ad6-98ad-45e1-acfc-147a5206758d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:10.527161 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d5ad6-98ad-45e1-acfc-147a5206758d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:10.527428 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d5ad6-98ad-45e1-acfc-147a5206758d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:10.594300 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d5ad6-98ad-45e1-acfc-147a5206758d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:10.596099 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d5ad6-98ad-45e1-acfc-147a5206758d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:10.606415 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f17581-6bb9-4529-ae7d-ec6c260948fe None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:10.622437 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:10.636415 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:10.641960 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99d5a3-1698-4418-9d6b-6f8c18a98adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:10.642571 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99d5a3-1698-4418-9d6b-6f8c18a98adc None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:10.642855 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99d5a3-1698-4418-9d6b-6f8c18a98adc None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:10.643154 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99d5a3-1698-4418-9d6b-6f8c18a98adc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:10.653285 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99d5a3-1698-4418-9d6b-6f8c18a98adc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:10.658218 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-ce99d5a3-1698-4418-9d6b-6f8c18a98adc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:41:10.658218 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:10.658218 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:10.658218 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:10.658218 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:10.658218 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:10.658218 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:10.658218 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:10.658218 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:10.658218 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:10.658218 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:10.658218 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:10.658218 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:10.658218 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:10.658218 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:10.658218 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:10.659219 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:10.659219 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:10.659219 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:10.659219 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:10.659219 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:10.659219 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:10.659219 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:10.659219 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:10.659219 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:10.659219 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:10.659219 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:10.659219 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:10.659219 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:10.659219 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:10.659219 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:10.659219 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:10.660007 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:10.660007 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:10.660007 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:10.660007 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:10.660007 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:10.660007 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:10.660007 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:10.660007 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:10.660007 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:10.660007 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:10.660007 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:41:10.660007 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:10.660007 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 88/180] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:41:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:10.660817 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e55e1-7e44-4a11-b908-9d19317eddf4 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:10.660817 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e55e1-7e44-4a11-b908-9d19317eddf4 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:10.661479 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e55e1-7e44-4a11-b908-9d19317eddf4 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:10.662914 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 89/181] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:10.663440 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e55e1-7e44-4a11-b908-9d19317eddf4 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:10.700043 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 93/182] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:41:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:41:10.703442 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65001136-295e-4c18-ad0f-b025472ecd4b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:10.703725 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65001136-295e-4c18-ad0f-b025472ecd4b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:10.703998 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65001136-295e-4c18-ad0f-b025472ecd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:10.722592 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-65001136-295e-4c18-ad0f-b025472ecd4b None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:10.723985 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-65001136-295e-4c18-ad0f-b025472ecd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:10.766825 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e55e1-7e44-4a11-b908-9d19317eddf4 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:10.790369 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 94/183] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:10.798104 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f8e28-92b5-4a9c-9a5f-97f48e907058 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:10.798377 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f8e28-92b5-4a9c-9a5f-97f48e907058 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:10.798652 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f8e28-92b5-4a9c-9a5f-97f48e907058 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:10.800052 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 95/184] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:10.800964 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f8e28-92b5-4a9c-9a5f-97f48e907058 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:10.805071 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68088e4a-501f-4ad5-b1e9-b9f957933ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:10.805806 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68088e4a-501f-4ad5-b1e9-b9f957933ffd None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:10.806134 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68088e4a-501f-4ad5-b1e9-b9f957933ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:10.806405 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68088e4a-501f-4ad5-b1e9-b9f957933ffd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:10.807136 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68088e4a-501f-4ad5-b1e9-b9f957933ffd None admin] RBAC: Adding query filter params (role.id=cc013581bb07418d9ec6a3a1d282ea53, scope.project.id=93e707bfff714b1c80277c83a2ed2c93, user.id=f0ea7ade0fdf4b01bc4d2a18f09385cb) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:10.807471 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68088e4a-501f-4ad5-b1e9-b9f957933ffd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:10.808914 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68088e4a-501f-4ad5-b1e9-b9f957933ffd None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:10.818191 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 90/185] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:41:10 2022] GET /identity/v3/role_assignments?user.id=f0ea7ade0fdf4b01bc4d2a18f09385cb&scope.project.id=93e707bfff714b1c80277c83a2ed2c93&role.id=cc013581bb07418d9ec6a3a1d282ea53 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:10.820287 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a82a8-6445-40d9-b54e-db12139e2d0f None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:10.820797 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a82a8-6445-40d9-b54e-db12139e2d0f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:10.821728 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a82a8-6445-40d9-b54e-db12139e2d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:10.847974 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-8c3a82a8-6445-40d9-b54e-db12139e2d0f None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:10.849602 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8c3a82a8-6445-40d9-b54e-db12139e2d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:10.878960 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:10.914376 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:10.935745 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 91/186] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:10.936771 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a82a8-6445-40d9-b54e-db12139e2d0f None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:10.947295 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f8e28-92b5-4a9c-9a5f-97f48e907058 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:10.987836 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16461bd6-cce3-4fa8-b8ae-b20f094c8111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:10.988788 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16461bd6-cce3-4fa8-b8ae-b20f094c8111 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:10.989282 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16461bd6-cce3-4fa8-b8ae-b20f094c8111 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:10.989769 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16461bd6-cce3-4fa8-b8ae-b20f094c8111 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:10.990662 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16461bd6-cce3-4fa8-b8ae-b20f094c8111 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:10.991272 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16461bd6-cce3-4fa8-b8ae-b20f094c8111 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:10.993648 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16461bd6-cce3-4fa8-b8ae-b20f094c8111 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:11.003087 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 96/187] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:11.004721 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad86872-048e-4a73-a9d7-5e5cf862f418 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:11.005209 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad86872-048e-4a73-a9d7-5e5cf862f418 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:11.005708 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad86872-048e-4a73-a9d7-5e5cf862f418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:11.029678 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-2ad86872-048e-4a73-a9d7-5e5cf862f418 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:11.031133 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2ad86872-048e-4a73-a9d7-5e5cf862f418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:11.095425 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a82a8-6445-40d9-b54e-db12139e2d0f None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:11.116088 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 97/188] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:11.118681 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad86872-048e-4a73-a9d7-5e5cf862f418 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:11.138621 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d114d0-3afb-443a-993c-5ff3bb701c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:11.139413 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d114d0-3afb-443a-993c-5ff3bb701c30 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:11.139684 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d114d0-3afb-443a-993c-5ff3bb701c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:11.140175 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d114d0-3afb-443a-993c-5ff3bb701c30 None admin] PATH_INFO: `/v3/projects/93e707bfff714b1c80277c83a2ed2c93` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:11.141673 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d114d0-3afb-443a-993c-5ff3bb701c30 None admin] RBAC: Authorizing `identity:get_project(project_id=93e707bfff714b1c80277c83a2ed2c93)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:11.143240 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d114d0-3afb-443a-993c-5ff3bb701c30 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:11.145017 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 92/189] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:10 2022] GET /identity/v3/projects/93e707bfff714b1c80277c83a2ed2c93 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:11.145924 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d114d0-3afb-443a-993c-5ff3bb701c30 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:11.184549 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:11.212662 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:11.256654 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad86872-048e-4a73-a9d7-5e5cf862f418 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:11.269631 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d114d0-3afb-443a-993c-5ff3bb701c30 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:11.294141 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253eb30-d575-4627-b052-0191046aeba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:11.294712 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253eb30-d575-4627-b052-0191046aeba3 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:11.294990 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253eb30-d575-4627-b052-0191046aeba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:11.295249 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253eb30-d575-4627-b052-0191046aeba3 None admin] PATH_INFO: `/v3/users/7c232e5ec09f4942aae01f9d187e0745` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:11.304984 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adaab4f-2d01-4619-97a3-2af68f18ad1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:11.305617 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adaab4f-2d01-4619-97a3-2af68f18ad1c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:11.305923 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adaab4f-2d01-4619-97a3-2af68f18ad1c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:11.306198 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adaab4f-2d01-4619-97a3-2af68f18ad1c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:11.307523 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adaab4f-2d01-4619-97a3-2af68f18ad1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:11.308978 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adaab4f-2d01-4619-97a3-2af68f18ad1c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:11.309354 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253eb30-d575-4627-b052-0191046aeba3 None admin] RBAC: Authorizing `identity:get_user(user_id=7c232e5ec09f4942aae01f9d187e0745)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:11.310796 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 93/190] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:41:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:11.311348 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adaab4f-2d01-4619-97a3-2af68f18ad1c None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:11.315473 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253eb30-d575-4627-b052-0191046aeba3 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:11.317207 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 98/191] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:41:11 2022] GET /identity/v3/users/7c232e5ec09f4942aae01f9d187e0745 => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:11.318004 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253eb30-d575-4627-b052-0191046aeba3 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:11.420591 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adaab4f-2d01-4619-97a3-2af68f18ad1c None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:11.431647 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253eb30-d575-4627-b052-0191046aeba3 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:11.438864 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:11.443826 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:11.456084 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c7738-58ea-4b85-a66e-05fe15fbb17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:11.456690 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c7738-58ea-4b85-a66e-05fe15fbb17c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:11.456987 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c7738-58ea-4b85-a66e-05fe15fbb17c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:11.457251 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c7738-58ea-4b85-a66e-05fe15fbb17c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:11.458011 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c7738-58ea-4b85-a66e-05fe15fbb17c None admin] RBAC: Adding query filter params (role.id=258091cadd094ad2a608d396036e8869, scope.project.id=93e707bfff714b1c80277c83a2ed2c93, user.id=aa5b6bfda63641828423fc56bb44215c) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:11.458313 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c7738-58ea-4b85-a66e-05fe15fbb17c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:11.459760 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c7738-58ea-4b85-a66e-05fe15fbb17c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:11.465453 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 94/192] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:41:11 2022] GET /identity/v3/role_assignments?user.id=aa5b6bfda63641828423fc56bb44215c&scope.project.id=93e707bfff714b1c80277c83a2ed2c93&role.id=258091cadd094ad2a608d396036e8869 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:11.465695 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7cfab-3449-40f2-b0f6-58682fa31500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:11.466231 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c7738-58ea-4b85-a66e-05fe15fbb17c None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:11.466327 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7cfab-3449-40f2-b0f6-58682fa31500 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:11.466617 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7cfab-3449-40f2-b0f6-58682fa31500 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:11.466883 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7cfab-3449-40f2-b0f6-58682fa31500 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:11.485263 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7cfab-3449-40f2-b0f6-58682fa31500 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:11.490291 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-e8a7cfab-3449-40f2-b0f6-58682fa31500 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:41:11.490291 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:11.490291 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:11.490291 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:11.490291 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:11.490291 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:11.490291 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:11.490291 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:11.490291 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:11.490291 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:11.490291 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:11.490291 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:11.490291 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:11.490291 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:11.490291 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:11.490291 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:11.491284 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:11.491284 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:11.491284 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:11.491284 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:11.491284 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:11.491284 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:11.491284 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:11.491284 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:11.491284 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:11.491284 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:11.491284 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:11.491284 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:11.491284 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:11.491284 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:11.491284 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:11.491284 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:11.494770 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:11.494770 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:11.494770 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:11.494770 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:11.494770 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:11.494770 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:11.494770 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:11.494770 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:11.494770 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:11.494770 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:11.494770 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:41:11.494770 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:11.494770 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 99/193] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:11.494770 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7cfab-3449-40f2-b0f6-58682fa31500 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:11.602999 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c7738-58ea-4b85-a66e-05fe15fbb17c None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:11.611080 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7cfab-3449-40f2-b0f6-58682fa31500 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:11.645154 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10550294-ec81-4f68-973f-ae9808a84d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:11.646548 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10550294-ec81-4f68-973f-ae9808a84d84 None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:11.646548 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10550294-ec81-4f68-973f-ae9808a84d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:11.646548 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10550294-ec81-4f68-973f-ae9808a84d84 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:11.646974 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10550294-ec81-4f68-973f-ae9808a84d84 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:11.648413 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10550294-ec81-4f68-973f-ae9808a84d84 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:11.653833 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a5a26-ca19-48c7-a94c-9e212ca50267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:11.654467 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a5a26-ca19-48c7-a94c-9e212ca50267 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:11.654744 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a5a26-ca19-48c7-a94c-9e212ca50267 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:11.655014 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a5a26-ca19-48c7-a94c-9e212ca50267 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:11.671248 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 95/194] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Aug 28 00:41:11 2022] POST /identity/v3/users => generated 297 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:41:11.674920 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10550294-ec81-4f68-973f-ae9808a84d84 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:11.708233 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:11.733805 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:11.751753 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a5a26-ca19-48c7-a94c-9e212ca50267 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:11.753298 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a5a26-ca19-48c7-a94c-9e212ca50267 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:11.801531 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10550294-ec81-4f68-973f-ae9808a84d84 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:11.845110 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe046b-2d7b-4810-8f19-1dc98f084646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:11.846126 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe046b-2d7b-4810-8f19-1dc98f084646 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:11.846563 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe046b-2d7b-4810-8f19-1dc98f084646 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:11.846985 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe046b-2d7b-4810-8f19-1dc98f084646 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:11.858796 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe046b-2d7b-4810-8f19-1dc98f084646 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:11.864024 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-51fe046b-2d7b-4810-8f19-1dc98f084646 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:41:11.864024 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:11.864024 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:11.864024 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:11.864024 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:11.864024 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:11.864024 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:11.864024 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:11.864024 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:11.864024 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:11.864024 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:11.864024 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:11.864024 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:11.864024 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:11.864024 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:11.864024 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:11.864891 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:11.864891 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:11.864891 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:11.864891 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:11.864891 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:11.864891 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:11.864891 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:11.864891 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:11.864891 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:11.864891 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:11.864891 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:11.864891 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:11.864891 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:11.864891 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:11.864891 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:11.864891 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:11.865673 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:11.865673 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:11.865673 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:11.865673 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:11.865673 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:11.865673 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:11.865673 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:11.865673 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:11.865673 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:11.865673 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:11.865673 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:41:11.865673 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:11.865673 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 96/195] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Aug 28 00:41:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:11.866353 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe046b-2d7b-4810-8f19-1dc98f084646 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:11.872955 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 100/196] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:41:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:41:11.873817 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a5a26-ca19-48c7-a94c-9e212ca50267 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:11.960718 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:11.989478 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe046b-2d7b-4810-8f19-1dc98f084646 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:11.999706 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:12.000313 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a5a26-ca19-48c7-a94c-9e212ca50267 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:12.036534 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852cad87-3ad7-4213-b8cc-b843920fceb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:12.037318 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cad87-3ad7-4213-b8cc-b843920fceb7 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:12.037530 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cad87-3ad7-4213-b8cc-b843920fceb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:12.037799 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cad87-3ad7-4213-b8cc-b843920fceb7 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:12.038504 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852cad87-3ad7-4213-b8cc-b843920fceb7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:12.038802 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852cad87-3ad7-4213-b8cc-b843920fceb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:12.040229 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852cad87-3ad7-4213-b8cc-b843920fceb7 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:12.045675 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc04174-36e2-4944-98ce-285e461a1e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:12.046531 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc04174-36e2-4944-98ce-285e461a1e3d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:12.046883 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc04174-36e2-4944-98ce-285e461a1e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:12.047280 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc04174-36e2-4944-98ce-285e461a1e3d None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:12.048101 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc04174-36e2-4944-98ce-285e461a1e3d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:12.048401 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc04174-36e2-4944-98ce-285e461a1e3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:12.049794 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc04174-36e2-4944-98ce-285e461a1e3d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:12.050390 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 97/197] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Aug 28 00:41:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:12.053622 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852cad87-3ad7-4213-b8cc-b843920fceb7 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:12.066088 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 101/198] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:41:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:12.066955 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc04174-36e2-4944-98ce-285e461a1e3d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:12.181181 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc04174-36e2-4944-98ce-285e461a1e3d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:12.181366 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852cad87-3ad7-4213-b8cc-b843920fceb7 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:12.216026 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132550a-89da-42d8-8719-f1d71f034ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:12.216779 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132550a-89da-42d8-8719-f1d71f034ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:12.217123 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132550a-89da-42d8-8719-f1d71f034ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:12.217464 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132550a-89da-42d8-8719-f1d71f034ee4 None admin] PATH_INFO: `/v3/users/4399c9bdccc742ea927325dd9b7b50b1` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:12.219073 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132550a-89da-42d8-8719-f1d71f034ee4 None admin] RBAC: Authorizing `identity:get_user(user_id=4399c9bdccc742ea927325dd9b7b50b1)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:12.221035 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132550a-89da-42d8-8719-f1d71f034ee4 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:12.223335 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 102/199] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:41:12 2022] GET /identity/v3/users/4399c9bdccc742ea927325dd9b7b50b1 => generated 289 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:12.224208 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132550a-89da-42d8-8719-f1d71f034ee4 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:12.228364 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320a5b1-9178-44bc-b10d-8ae9ca706a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:12.229174 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:12.230277 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320a5b1-9178-44bc-b10d-8ae9ca706a33 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:12.231183 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320a5b1-9178-44bc-b10d-8ae9ca706a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:12.231183 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320a5b1-9178-44bc-b10d-8ae9ca706a33 None admin] PATH_INFO: `/v3/projects/ad187f94c1d9456e9c97f78a7f686485` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:12.232459 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320a5b1-9178-44bc-b10d-8ae9ca706a33 None admin] RBAC: Authorizing `identity:get_project(project_id=ad187f94c1d9456e9c97f78a7f686485)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:12.234346 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320a5b1-9178-44bc-b10d-8ae9ca706a33 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:12.236086 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 98/200] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:12 2022] GET /identity/v3/projects/ad187f94c1d9456e9c97f78a7f686485 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:12.237003 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320a5b1-9178-44bc-b10d-8ae9ca706a33 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:12.276733 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:12.349264 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320a5b1-9178-44bc-b10d-8ae9ca706a33 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:12.357178 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132550a-89da-42d8-8719-f1d71f034ee4 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:12.386221 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689b268-589b-4dfa-a60b-9f0f75797769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:12.386843 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689b268-589b-4dfa-a60b-9f0f75797769 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:12.387124 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689b268-589b-4dfa-a60b-9f0f75797769 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:12.387396 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689b268-589b-4dfa-a60b-9f0f75797769 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:12.393665 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e67fef-1af2-47a6-a21d-322b63719ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:12.394577 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e67fef-1af2-47a6-a21d-322b63719ced None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:12.395055 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e67fef-1af2-47a6-a21d-322b63719ced None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:12.395524 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e67fef-1af2-47a6-a21d-322b63719ced None admin] PATH_INFO: `/v3/users/7c232e5ec09f4942aae01f9d187e0745` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:12.396939 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e67fef-1af2-47a6-a21d-322b63719ced None admin] RBAC: Authorizing `identity:get_user(user_id=7c232e5ec09f4942aae01f9d187e0745)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:12.398777 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e67fef-1af2-47a6-a21d-322b63719ced None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:12.401001 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 103/201] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:41:12 2022] GET /identity/v3/users/7c232e5ec09f4942aae01f9d187e0745 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:12.402002 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e67fef-1af2-47a6-a21d-322b63719ced None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:12.463922 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689b268-589b-4dfa-a60b-9f0f75797769 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:12.465446 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689b268-589b-4dfa-a60b-9f0f75797769 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:12.472862 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:12.498887 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:12.517094 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e67fef-1af2-47a6-a21d-322b63719ced None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:12.553303 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c691484-687d-48e8-99c9-fd9e9a618312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:12.554001 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c691484-687d-48e8-99c9-fd9e9a618312 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:12.554284 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c691484-687d-48e8-99c9-fd9e9a618312 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:12.554553 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c691484-687d-48e8-99c9-fd9e9a618312 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:12.555285 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c691484-687d-48e8-99c9-fd9e9a618312 None admin] RBAC: Adding query filter params (role.id=cc013581bb07418d9ec6a3a1d282ea53, scope.project.id=ad187f94c1d9456e9c97f78a7f686485, user.id=7c232e5ec09f4942aae01f9d187e0745) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:12.555591 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c691484-687d-48e8-99c9-fd9e9a618312 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:12.557263 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c691484-687d-48e8-99c9-fd9e9a618312 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:12.563360 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 104/202] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:41:12 2022] GET /identity/v3/role_assignments?user.id=7c232e5ec09f4942aae01f9d187e0745&scope.project.id=ad187f94c1d9456e9c97f78a7f686485&role.id=cc013581bb07418d9ec6a3a1d282ea53 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:12.564309 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c691484-687d-48e8-99c9-fd9e9a618312 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:12.578837 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 99/203] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:41:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:41:12.584995 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689b268-589b-4dfa-a60b-9f0f75797769 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:12.679139 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c691484-687d-48e8-99c9-fd9e9a618312 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:12.692712 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689b268-589b-4dfa-a60b-9f0f75797769 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:12.716671 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca250488-6a28-4190-8a30-8e927a3bc630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:12.717211 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca250488-6a28-4190-8a30-8e927a3bc630 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:12.717607 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca250488-6a28-4190-8a30-8e927a3bc630 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:12.717970 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca250488-6a28-4190-8a30-8e927a3bc630 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:12.725278 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:12.730711 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d059d7f-32d7-4baa-8375-934a772bbd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:12.731702 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d059d7f-32d7-4baa-8375-934a772bbd77 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:12.732298 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d059d7f-32d7-4baa-8375-934a772bbd77 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:12.732721 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d059d7f-32d7-4baa-8375-934a772bbd77 None admin] PATH_INFO: `/v3/projects/93e707bfff714b1c80277c83a2ed2c93` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:12.732834 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:12.735019 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d059d7f-32d7-4baa-8375-934a772bbd77 None admin] RBAC: Authorizing `identity:get_project(project_id=93e707bfff714b1c80277c83a2ed2c93)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:12.736884 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d059d7f-32d7-4baa-8375-934a772bbd77 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:12.743932 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 100/204] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:12 2022] GET /identity/v3/projects/93e707bfff714b1c80277c83a2ed2c93 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:12.745369 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d059d7f-32d7-4baa-8375-934a772bbd77 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:12.794142 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca250488-6a28-4190-8a30-8e927a3bc630 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:12.801874 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca250488-6a28-4190-8a30-8e927a3bc630 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:12.909405 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 105/205] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:41:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:41:12.912567 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca250488-6a28-4190-8a30-8e927a3bc630 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:12.916581 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d059d7f-32d7-4baa-8375-934a772bbd77 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:12.953568 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:12.959078 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb650e4-92a9-4e2a-b95a-707d0ffb14c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:12.960001 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb650e4-92a9-4e2a-b95a-707d0ffb14c2 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:12.960488 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb650e4-92a9-4e2a-b95a-707d0ffb14c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:12.960961 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb650e4-92a9-4e2a-b95a-707d0ffb14c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:12.961914 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb650e4-92a9-4e2a-b95a-707d0ffb14c2 None admin] RBAC: Adding query filter params (role.id=3e76264611ba49e6abbc019c0928e888, scope.project.id=93e707bfff714b1c80277c83a2ed2c93, user.id=4399c9bdccc742ea927325dd9b7b50b1) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:12.962545 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb650e4-92a9-4e2a-b95a-707d0ffb14c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:12.964385 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb650e4-92a9-4e2a-b95a-707d0ffb14c2 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:12.973418 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 101/206] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:41:12 2022] GET /identity/v3/role_assignments?user.id=4399c9bdccc742ea927325dd9b7b50b1&scope.project.id=93e707bfff714b1c80277c83a2ed2c93&role.id=3e76264611ba49e6abbc019c0928e888 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:41:13.057689 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca250488-6a28-4190-8a30-8e927a3bc630 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:13.095180 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f0f5d-924e-4d15-b1f5-d2f4e36d71be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:13.096248 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f0f5d-924e-4d15-b1f5-d2f4e36d71be None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:13.096728 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f0f5d-924e-4d15-b1f5-d2f4e36d71be None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:13.097192 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f0f5d-924e-4d15-b1f5-d2f4e36d71be None admin] PATH_INFO: `/v3/projects/ad187f94c1d9456e9c97f78a7f686485` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:13.098731 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f0f5d-924e-4d15-b1f5-d2f4e36d71be None admin] RBAC: Authorizing `identity:get_project(project_id=ad187f94c1d9456e9c97f78a7f686485)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:13.100423 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f0f5d-924e-4d15-b1f5-d2f4e36d71be None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:13.107349 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 106/207] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:12 2022] GET /identity/v3/projects/ad187f94c1d9456e9c97f78a7f686485 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:13.109281 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb650e4-92a9-4e2a-b95a-707d0ffb14c2 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:13.191989 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:13.235778 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb650e4-92a9-4e2a-b95a-707d0ffb14c2 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:13.270158 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a01cb-5688-4049-b705-96301d24e9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:13.271124 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a01cb-5688-4049-b705-96301d24e9b9 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:13.271620 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a01cb-5688-4049-b705-96301d24e9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:13.272084 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a01cb-5688-4049-b705-96301d24e9b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:13.273023 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a01cb-5688-4049-b705-96301d24e9b9 None admin] RBAC: Adding query filter params (role.id=258091cadd094ad2a608d396036e8869, scope.project.id=ad187f94c1d9456e9c97f78a7f686485, user.id=7c232e5ec09f4942aae01f9d187e0745) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:13.273524 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a01cb-5688-4049-b705-96301d24e9b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:13.275186 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a01cb-5688-4049-b705-96301d24e9b9 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:13.285966 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 102/208] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:41:13 2022] GET /identity/v3/role_assignments?user.id=7c232e5ec09f4942aae01f9d187e0745&scope.project.id=ad187f94c1d9456e9c97f78a7f686485&role.id=258091cadd094ad2a608d396036e8869 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:13.894089 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f18cf6-904a-4755-b8f4-8b0428d521ec None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:13.894595 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f18cf6-904a-4755-b8f4-8b0428d521ec None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:13.894595 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f18cf6-904a-4755-b8f4-8b0428d521ec None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:13.896113 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 107/209] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:13.901538 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b053d-8334-4014-9bcc-c34b58c53a08 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:13.901831 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b053d-8334-4014-9bcc-c34b58c53a08 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:13.902134 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b053d-8334-4014-9bcc-c34b58c53a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:13.921538 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc161c13-35a8-4fb1-ab85-faee2c3651fd None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:13.921910 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc161c13-35a8-4fb1-ab85-faee2c3651fd None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:13.922141 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc161c13-35a8-4fb1-ab85-faee2c3651fd None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:13.923610 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 108/210] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:13.924060 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-1c8b053d-8334-4014-9bcc-c34b58c53a08 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:13.925294 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1c8b053d-8334-4014-9bcc-c34b58c53a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:13.929488 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd420a3-8f06-4904-ab95-3c1c8f3bf65e None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:13.929764 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd420a3-8f06-4904-ab95-3c1c8f3bf65e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:13.930064 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd420a3-8f06-4904-ab95-3c1c8f3bf65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:13.952030 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-5fd420a3-8f06-4904-ab95-3c1c8f3bf65e None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:13.953976 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5fd420a3-8f06-4904-ab95-3c1c8f3bf65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:14.009683 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 103/211] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:41:14.042054 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 109/212] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:41:14.280989 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b053d-8334-4014-9bcc-c34b58c53a08 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:14.309487 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd420a3-8f06-4904-ab95-3c1c8f3bf65e None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:14.337404 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:14.341063 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:14.384513 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b053d-8334-4014-9bcc-c34b58c53a08 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:14.420508 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd420a3-8f06-4904-ab95-3c1c8f3bf65e None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:14.421687 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ec902-f60b-47f5-a076-61fcbfc76173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:14.422548 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ec902-f60b-47f5-a076-61fcbfc76173 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:14.422830 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ec902-f60b-47f5-a076-61fcbfc76173 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:14.423100 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ec902-f60b-47f5-a076-61fcbfc76173 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:14.436626 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463ec902-f60b-47f5-a076-61fcbfc76173 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:14.443041 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-463ec902-f60b-47f5-a076-61fcbfc76173 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:41:14.443041 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:14.443041 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:14.443041 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:14.443041 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:14.443041 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:14.443041 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:14.443041 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:14.443041 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:14.443041 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:14.443041 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:14.443041 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:14.443041 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:14.443041 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:14.443041 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:14.443041 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:14.443900 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:14.443900 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:14.443900 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:14.443900 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:14.443900 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:14.443900 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:14.443900 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:14.443900 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:14.443900 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:14.443900 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:14.443900 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:14.443900 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:14.443900 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:14.443900 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:14.443900 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:14.443900 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:14.444668 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:14.444668 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:14.444668 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:14.444668 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:14.444668 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:14.444668 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:14.444668 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:14.444668 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:14.444668 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:14.444668 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:14.444668 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:41:14.444668 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:14.449460 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 104/213] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:14.450723 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ec902-f60b-47f5-a076-61fcbfc76173 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:14.461980 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7133e1a-3914-4193-90da-1d5631b0d326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:14.462923 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7133e1a-3914-4193-90da-1d5631b0d326 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:14.463298 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7133e1a-3914-4193-90da-1d5631b0d326 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:14.463665 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7133e1a-3914-4193-90da-1d5631b0d326 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:14.464899 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7133e1a-3914-4193-90da-1d5631b0d326 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:14.466614 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7133e1a-3914-4193-90da-1d5631b0d326 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:14.468729 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 110/214] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:41:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:14.474548 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7133e1a-3914-4193-90da-1d5631b0d326 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:14.567511 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ec902-f60b-47f5-a076-61fcbfc76173 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:14.581508 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:14.585147 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:14.592610 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7133e1a-3914-4193-90da-1d5631b0d326 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:14.603374 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5f6d0-700a-4adf-b97f-b20aa41bfe18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:14.604173 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5f6d0-700a-4adf-b97f-b20aa41bfe18 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:14.604410 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5f6d0-700a-4adf-b97f-b20aa41bfe18 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:14.604632 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5f6d0-700a-4adf-b97f-b20aa41bfe18 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:14.605315 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5f6d0-700a-4adf-b97f-b20aa41bfe18 None admin] RBAC: Adding query filter params (name=member) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:14.605617 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5f6d0-700a-4adf-b97f-b20aa41bfe18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:14.607162 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5f6d0-700a-4adf-b97f-b20aa41bfe18 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:14.616217 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 105/215] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Aug 28 00:41:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:14.621647 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5f6d0-700a-4adf-b97f-b20aa41bfe18 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:14.632943 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d1439-0821-4cda-a757-c2949207a17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:14.633909 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d1439-0821-4cda-a757-c2949207a17e None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:14.634398 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d1439-0821-4cda-a757-c2949207a17e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:14.634971 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d1439-0821-4cda-a757-c2949207a17e None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:14.635853 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d1439-0821-4cda-a757-c2949207a17e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:14.637617 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d1439-0821-4cda-a757-c2949207a17e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:14.664435 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 111/216] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Aug 28 00:41:14 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:41:14.733478 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5f6d0-700a-4adf-b97f-b20aa41bfe18 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:14.771282 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a5b14-a117-4115-8747-ed9ad78505b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:14.771937 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a5b14-a117-4115-8747-ed9ad78505b5 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:14.772217 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a5b14-a117-4115-8747-ed9ad78505b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:14.772491 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a5b14-a117-4115-8747-ed9ad78505b5 None admin] PATH_INFO: `/v3/users/5eeb00b561af408fa4dce2fecc569aa1` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:14.788113 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a5b14-a117-4115-8747-ed9ad78505b5 None admin] RBAC: Authorizing `identity:get_user(user_id=5eeb00b561af408fa4dce2fecc569aa1)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:14.789533 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a5b14-a117-4115-8747-ed9ad78505b5 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:14.791323 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 106/217] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:41:14 2022] GET /identity/v3/users/5eeb00b561af408fa4dce2fecc569aa1 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:14.797232 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d1439-0821-4cda-a757-c2949207a17e None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:14.855551 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcb23f-5557-41be-b7c0-590964061a4c None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:14.855855 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcb23f-5557-41be-b7c0-590964061a4c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:14.856095 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcb23f-5557-41be-b7c0-590964061a4c None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:14.857640 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 107/218] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:41:14.863158 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ded80-d48b-492d-a5fe-e1026c1276aa None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:14.863444 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ded80-d48b-492d-a5fe-e1026c1276aa None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:14.863719 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ded80-d48b-492d-a5fe-e1026c1276aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:14.887933 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-795ded80-d48b-492d-a5fe-e1026c1276aa None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:14.889137 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-795ded80-d48b-492d-a5fe-e1026c1276aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:14.923947 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d1439-0821-4cda-a757-c2949207a17e None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:14.924880 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:14.974390 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 108/219] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:14.977426 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed7f3a-0da7-4566-8420-d1bcffd63836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:14.978094 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed7f3a-0da7-4566-8420-d1bcffd63836 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:14.978373 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed7f3a-0da7-4566-8420-d1bcffd63836 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:14.978645 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed7f3a-0da7-4566-8420-d1bcffd63836 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:15.003697 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:15.057509 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed7f3a-0da7-4566-8420-d1bcffd63836 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:15.058953 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed7f3a-0da7-4566-8420-d1bcffd63836 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:15.168120 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 112/220] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:41:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:41:15.174049 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ded80-d48b-492d-a5fe-e1026c1276aa None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:15.268821 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed7f3a-0da7-4566-8420-d1bcffd63836 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:15.289002 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ded80-d48b-492d-a5fe-e1026c1276aa None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:15.331098 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3965a-7273-40cc-8ad2-8088bd28be9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:15.332107 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3965a-7273-40cc-8ad2-8088bd28be9e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:15.332384 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3965a-7273-40cc-8ad2-8088bd28be9e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:15.332654 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3965a-7273-40cc-8ad2-8088bd28be9e None admin] PATH_INFO: `/v3/projects/ad187f94c1d9456e9c97f78a7f686485` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:15.334467 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3965a-7273-40cc-8ad2-8088bd28be9e None admin] RBAC: Authorizing `identity:get_project(project_id=ad187f94c1d9456e9c97f78a7f686485)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:15.336250 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3965a-7273-40cc-8ad2-8088bd28be9e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:15.339142 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 109/221] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:15 2022] GET /identity/v3/projects/ad187f94c1d9456e9c97f78a7f686485 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:15.340341 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:15.341436 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4eb62a-f813-4944-9e1d-da3f48beeefe None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:15.341695 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4eb62a-f813-4944-9e1d-da3f48beeefe None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:15.341987 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4eb62a-f813-4944-9e1d-da3f48beeefe None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:15.343861 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 110/222] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:15.345276 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4eb62a-f813-4944-9e1d-da3f48beeefe None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:15.394690 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:15.398509 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed7f3a-0da7-4566-8420-d1bcffd63836 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:15.436052 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f604b6-3c63-47f7-9efd-69692739f9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:15.437372 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f604b6-3c63-47f7-9efd-69692739f9df None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:15.437863 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f604b6-3c63-47f7-9efd-69692739f9df None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:15.438206 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f604b6-3c63-47f7-9efd-69692739f9df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:15.449776 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f604b6-3c63-47f7-9efd-69692739f9df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:15.455393 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-e8f604b6-3c63-47f7-9efd-69692739f9df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:41:15.455393 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:15.455393 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:15.455393 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:15.455393 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:15.455393 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:15.455393 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:15.455393 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:15.455393 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:15.455393 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:15.455393 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:15.455393 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:15.455393 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:15.455393 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:15.455393 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:15.455393 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:15.456472 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:15.456472 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:15.456472 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:15.456472 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:15.456472 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:15.456472 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:15.456472 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:15.456472 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:15.456472 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:15.456472 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:15.456472 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:15.456472 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:15.456472 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:15.456472 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:15.456472 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:15.456472 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:15.457459 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:15.457459 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:15.457459 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:15.457459 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:15.457459 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:15.457459 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:15.457459 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:15.457459 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:15.457459 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:15.457459 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:15.457459 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:41:15.457459 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:15.463735 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 113/223] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:41:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:15.463735 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec459d-e4ee-4504-967c-715427b32e80 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:15.463735 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec459d-e4ee-4504-967c-715427b32e80 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:15.463735 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec459d-e4ee-4504-967c-715427b32e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:15.481001 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a4ec459d-e4ee-4504-967c-715427b32e80 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:15.482356 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a4ec459d-e4ee-4504-967c-715427b32e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:15.485024 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4eb62a-f813-4944-9e1d-da3f48beeefe None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:15.543143 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b42a2-cbfb-4c75-901e-ec7703ecb780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:15.544448 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b42a2-cbfb-4c75-901e-ec7703ecb780 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:15.545096 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b42a2-cbfb-4c75-901e-ec7703ecb780 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:15.545707 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b42a2-cbfb-4c75-901e-ec7703ecb780 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:15.546909 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b42a2-cbfb-4c75-901e-ec7703ecb780 None admin] RBAC: Adding query filter params (role.id=2231e998e50146f4b53b832f2f88c1c8, scope.project.id=ad187f94c1d9456e9c97f78a7f686485, user.id=5eeb00b561af408fa4dce2fecc569aa1) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:15.547475 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b42a2-cbfb-4c75-901e-ec7703ecb780 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:15.549264 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b42a2-cbfb-4c75-901e-ec7703ecb780 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:15.556511 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 111/224] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:41:15 2022] GET /identity/v3/role_assignments?user.id=5eeb00b561af408fa4dce2fecc569aa1&scope.project.id=ad187f94c1d9456e9c97f78a7f686485&role.id=2231e998e50146f4b53b832f2f88c1c8 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:15.557608 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b42a2-cbfb-4c75-901e-ec7703ecb780 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:15.557910 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 114/225] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:15.676452 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:15.683943 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b42a2-cbfb-4c75-901e-ec7703ecb780 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:15.726348 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96347703-3f21-48fd-a004-cfdd55d89cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:15.727287 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96347703-3f21-48fd-a004-cfdd55d89cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:15.727732 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96347703-3f21-48fd-a004-cfdd55d89cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:15.728189 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96347703-3f21-48fd-a004-cfdd55d89cb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:15.729015 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96347703-3f21-48fd-a004-cfdd55d89cb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:15.729495 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96347703-3f21-48fd-a004-cfdd55d89cb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:15.731120 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96347703-3f21-48fd-a004-cfdd55d89cb1 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:15.744277 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 112/226] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:15.750186 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec459d-e4ee-4504-967c-715427b32e80 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:15.803397 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:15.867403 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec459d-e4ee-4504-967c-715427b32e80 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:15.905007 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15130af8-31a6-454e-b2ed-8d5b7dfc8183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:15.905761 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15130af8-31a6-454e-b2ed-8d5b7dfc8183 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:15.906163 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15130af8-31a6-454e-b2ed-8d5b7dfc8183 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:15.906438 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15130af8-31a6-454e-b2ed-8d5b7dfc8183 None admin] PATH_INFO: `/v3/users/7c232e5ec09f4942aae01f9d187e0745` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:15.907570 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15130af8-31a6-454e-b2ed-8d5b7dfc8183 None admin] RBAC: Authorizing `identity:get_user(user_id=7c232e5ec09f4942aae01f9d187e0745)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:15.909174 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15130af8-31a6-454e-b2ed-8d5b7dfc8183 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:15.910517 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96347703-3f21-48fd-a004-cfdd55d89cb1 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:15.910796 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 115/227] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:41:15 2022] GET /identity/v3/users/7c232e5ec09f4942aae01f9d187e0745 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:15.916713 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15130af8-31a6-454e-b2ed-8d5b7dfc8183 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:16.058725 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96347703-3f21-48fd-a004-cfdd55d89cb1 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:16.086540 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15130af8-31a6-454e-b2ed-8d5b7dfc8183 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:16.103268 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:16.121650 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b417f92-5c72-45f9-8173-a2cb1feb0e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:16.122858 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b417f92-5c72-45f9-8173-a2cb1feb0e21 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:16.123335 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b417f92-5c72-45f9-8173-a2cb1feb0e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:16.123824 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b417f92-5c72-45f9-8173-a2cb1feb0e21 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:16.138093 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b417f92-5c72-45f9-8173-a2cb1feb0e21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:16.144560 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-1b417f92-5c72-45f9-8173-a2cb1feb0e21 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:41:16.144560 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:16.144560 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:16.144560 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:16.144560 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:16.144560 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:16.144560 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:16.144560 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:16.144560 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:16.144560 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:16.144560 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:16.144560 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:16.144560 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:16.144560 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:16.144560 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:16.144560 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:16.145477 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:16.145477 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:16.145477 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:16.145477 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:16.145477 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:16.145477 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:16.145477 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:16.145477 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:16.145477 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:16.145477 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:16.145477 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:16.145477 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:16.145477 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:16.145477 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:16.145477 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:16.145477 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:16.146302 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:16.146302 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:16.146302 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:16.146302 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:16.146302 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:16.146302 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:16.146302 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:16.146302 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:16.146302 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:16.146302 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:16.146302 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:41:16.146302 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:16.148955 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 113/228] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Aug 28 00:41:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:41:16.154631 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b417f92-5c72-45f9-8173-a2cb1feb0e21 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:16.166054 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56dd7f6-9952-4211-b25c-bfe2db342a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:16.166702 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dd7f6-9952-4211-b25c-bfe2db342a3d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:16.166981 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dd7f6-9952-4211-b25c-bfe2db342a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:16.167595 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dd7f6-9952-4211-b25c-bfe2db342a3d None admin] PATH_INFO: `/v3/projects/ad187f94c1d9456e9c97f78a7f686485` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:16.170558 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56dd7f6-9952-4211-b25c-bfe2db342a3d None admin] RBAC: Authorizing `identity:get_project(project_id=ad187f94c1d9456e9c97f78a7f686485)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:16.173364 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56dd7f6-9952-4211-b25c-bfe2db342a3d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:16.181548 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 116/229] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:15 2022] GET /identity/v3/projects/ad187f94c1d9456e9c97f78a7f686485 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:41:16.187298 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56dd7f6-9952-4211-b25c-bfe2db342a3d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:16.210212 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:16.297404 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56dd7f6-9952-4211-b25c-bfe2db342a3d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:16.332739 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d3d4e-1dec-440d-bdb3-106ddc4449c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:16.333792 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d3d4e-1dec-440d-bdb3-106ddc4449c5 None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:16.334302 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d3d4e-1dec-440d-bdb3-106ddc4449c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:16.334764 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d3d4e-1dec-440d-bdb3-106ddc4449c5 None admin] PATH_INFO: `/v3/projects/ad187f94c1d9456e9c97f78a7f686485/users/7c232e5ec09f4942aae01f9d187e0745/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:16.336962 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d3d4e-1dec-440d-bdb3-106ddc4449c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad187f94c1d9456e9c97f78a7f686485, user_id=7c232e5ec09f4942aae01f9d187e0745, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:16.338749 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d3d4e-1dec-440d-bdb3-106ddc4449c5 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:16.375752 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 117/230] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Aug 28 00:41:16 2022] PUT /identity/v3/projects/ad187f94c1d9456e9c97f78a7f686485/users/7c232e5ec09f4942aae01f9d187e0745/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:41:16.387533 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b417f92-5c72-45f9-8173-a2cb1feb0e21 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:16.431023 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2075513-ed98-4398-b5a0-00193b25fcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:16.431709 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2075513-ed98-4398-b5a0-00193b25fcd9 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:16.431988 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2075513-ed98-4398-b5a0-00193b25fcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:16.432341 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2075513-ed98-4398-b5a0-00193b25fcd9 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:16.433127 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2075513-ed98-4398-b5a0-00193b25fcd9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:16.433436 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2075513-ed98-4398-b5a0-00193b25fcd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:16.434985 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2075513-ed98-4398-b5a0-00193b25fcd9 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:16.448864 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 114/231] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:41:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:16.454463 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d3d4e-1dec-440d-bdb3-106ddc4449c5 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:16.522989 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:16.626514 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d3d4e-1dec-440d-bdb3-106ddc4449c5 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:16.666345 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784cbae-d1b0-4a4f-8c6d-9192a75ab330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:16.667388 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784cbae-d1b0-4a4f-8c6d-9192a75ab330 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:16.667862 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784cbae-d1b0-4a4f-8c6d-9192a75ab330 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:16.668327 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784cbae-d1b0-4a4f-8c6d-9192a75ab330 None admin] PATH_INFO: `/v3/users/7c232e5ec09f4942aae01f9d187e0745` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:16.669689 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784cbae-d1b0-4a4f-8c6d-9192a75ab330 None admin] RBAC: Authorizing `identity:get_user(user_id=7c232e5ec09f4942aae01f9d187e0745)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:16.671536 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784cbae-d1b0-4a4f-8c6d-9192a75ab330 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:16.673340 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 118/232] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:41:16 2022] GET /identity/v3/users/7c232e5ec09f4942aae01f9d187e0745 => generated 283 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:16.678873 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2075513-ed98-4398-b5a0-00193b25fcd9 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:16.776932 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:16.801728 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2075513-ed98-4398-b5a0-00193b25fcd9 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:16.843337 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552facdf-6e97-4913-bb3c-f499f2e07dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:16.844717 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552facdf-6e97-4913-bb3c-f499f2e07dfa None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:16.845193 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552facdf-6e97-4913-bb3c-f499f2e07dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:16.845656 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552facdf-6e97-4913-bb3c-f499f2e07dfa None admin] PATH_INFO: `/v3/projects/ad187f94c1d9456e9c97f78a7f686485` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:16.847106 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552facdf-6e97-4913-bb3c-f499f2e07dfa None admin] RBAC: Authorizing `identity:get_project(project_id=ad187f94c1d9456e9c97f78a7f686485)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:16.848775 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552facdf-6e97-4913-bb3c-f499f2e07dfa None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:16.850955 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 115/233] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:16 2022] GET /identity/v3/projects/ad187f94c1d9456e9c97f78a7f686485 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:41:16.859208 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784cbae-d1b0-4a4f-8c6d-9192a75ab330 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:16.988619 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784cbae-d1b0-4a4f-8c6d-9192a75ab330 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:16.990953 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:17.035343 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e9009-93eb-4b37-8da7-fe9ba8f1ec39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:17.036016 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e9009-93eb-4b37-8da7-fe9ba8f1ec39 None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:17.036296 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e9009-93eb-4b37-8da7-fe9ba8f1ec39 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:17.036569 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e9009-93eb-4b37-8da7-fe9ba8f1ec39 None admin] PATH_INFO: `/v3/projects/ad187f94c1d9456e9c97f78a7f686485/users/7c232e5ec09f4942aae01f9d187e0745/roles/258091cadd094ad2a608d396036e8869` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:17.043608 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e9009-93eb-4b37-8da7-fe9ba8f1ec39 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad187f94c1d9456e9c97f78a7f686485, user_id=7c232e5ec09f4942aae01f9d187e0745, role_id=258091cadd094ad2a608d396036e8869)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:17.045419 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e9009-93eb-4b37-8da7-fe9ba8f1ec39 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:17.069391 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 119/234] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Aug 28 00:41:16 2022] PUT /identity/v3/projects/ad187f94c1d9456e9c97f78a7f686485/users/7c232e5ec09f4942aae01f9d187e0745/roles/258091cadd094ad2a608d396036e8869 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:41:17.278400 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e321ab-ba21-46bf-aa9c-a2bd8cc8f1f7 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:17.279099 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e321ab-ba21-46bf-aa9c-a2bd8cc8f1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:17.279597 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e321ab-ba21-46bf-aa9c-a2bd8cc8f1f7 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:17.281248 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 116/235] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:17.286834 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08561e8d-a1b3-4b2f-a59b-2836b91d14a3 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:17.287286 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08561e8d-a1b3-4b2f-a59b-2836b91d14a3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:17.287463 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08561e8d-a1b3-4b2f-a59b-2836b91d14a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:17.309257 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-08561e8d-a1b3-4b2f-a59b-2836b91d14a3 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:17.310503 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-08561e8d-a1b3-4b2f-a59b-2836b91d14a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:17.390618 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 120/236] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:17.433456 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1281ba-303b-47c2-b570-fec49a37af79 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:17.434431 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1281ba-303b-47c2-b570-fec49a37af79 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:17.434903 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1281ba-303b-47c2-b570-fec49a37af79 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:17.436546 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 117/237] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:17.442569 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a71574-35ac-4b5e-abe2-0db7f7afb47f None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:17.443102 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a71574-35ac-4b5e-abe2-0db7f7afb47f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:17.443571 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a71574-35ac-4b5e-abe2-0db7f7afb47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:17.463171 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-26a71574-35ac-4b5e-abe2-0db7f7afb47f None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:17.464701 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-26a71574-35ac-4b5e-abe2-0db7f7afb47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:17.540977 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 121/238] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:17.825817 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1281ba-303b-47c2-b570-fec49a37af79 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:17.838526 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a71574-35ac-4b5e-abe2-0db7f7afb47f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:17.886776 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:17.968643 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1281ba-303b-47c2-b570-fec49a37af79 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:17.972575 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a71574-35ac-4b5e-abe2-0db7f7afb47f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:18.008454 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c1d21-c2da-4760-8e5b-553707ad3d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:18.008874 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5eca0f-adcd-4fd4-bc5d-1f7ab354f139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:18.009083 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c1d21-c2da-4760-8e5b-553707ad3d90 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:18.009363 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c1d21-c2da-4760-8e5b-553707ad3d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:18.009632 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c1d21-c2da-4760-8e5b-553707ad3d90 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:18.010312 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5eca0f-adcd-4fd4-bc5d-1f7ab354f139 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:18.010779 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5eca0f-adcd-4fd4-bc5d-1f7ab354f139 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:18.011357 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5eca0f-adcd-4fd4-bc5d-1f7ab354f139 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:18.012747 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5eca0f-adcd-4fd4-bc5d-1f7ab354f139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:18.014505 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5eca0f-adcd-4fd4-bc5d-1f7ab354f139 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:18.016913 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 122/239] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:41:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:18.018408 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118872e-45ec-4f6c-8e61-0b2a8a16ad1f None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:18.018906 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118872e-45ec-4f6c-8e61-0b2a8a16ad1f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:18.019368 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118872e-45ec-4f6c-8e61-0b2a8a16ad1f None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:18.021018 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 123/240] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:18.022332 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118872e-45ec-4f6c-8e61-0b2a8a16ad1f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:18.029677 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c1d21-c2da-4760-8e5b-553707ad3d90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:18.036527 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-5b6c1d21-c2da-4760-8e5b-553707ad3d90 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:41:18.036527 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:18.036527 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:18.036527 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:18.036527 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:18.036527 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:18.036527 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:18.036527 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:18.036527 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:18.036527 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:18.036527 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:18.036527 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:18.036527 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:18.036527 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:18.036527 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:18.036527 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:18.037462 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:18.037462 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:18.037462 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:18.037462 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:18.037462 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:18.037462 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:18.037462 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:18.037462 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:18.037462 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:18.037462 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:18.037462 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:18.037462 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:18.037462 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:18.037462 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:18.037462 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:18.037462 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:18.043458 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:18.043458 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:18.043458 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:18.043458 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:18.043458 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:18.043458 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:18.043458 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:18.043458 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:18.043458 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:18.043458 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:18.043458 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:41:18.043458 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:18.043458 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 118/241] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:18.043458 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626724e1-00fe-4745-ae91-a7322c017674 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:18.044272 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626724e1-00fe-4745-ae91-a7322c017674 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:18.044272 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626724e1-00fe-4745-ae91-a7322c017674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:18.064881 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-626724e1-00fe-4745-ae91-a7322c017674 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:18.066316 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-626724e1-00fe-4745-ae91-a7322c017674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:18.075801 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:18.137295 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:18.149695 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118872e-45ec-4f6c-8e61-0b2a8a16ad1f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:18.153976 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 119/242] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:18.155108 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626724e1-00fe-4745-ae91-a7322c017674 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:18.224184 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c8f09-af51-4f69-8b59-3684fb53951a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:18.226522 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c8f09-af51-4f69-8b59-3684fb53951a None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:18.227157 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c8f09-af51-4f69-8b59-3684fb53951a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:18.228396 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c8f09-af51-4f69-8b59-3684fb53951a None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:18.229271 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c8f09-af51-4f69-8b59-3684fb53951a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:18.231970 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c8f09-af51-4f69-8b59-3684fb53951a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:18.276836 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 124/243] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Aug 28 00:41:18 2022] POST /identity/v3/users => generated 293 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:41:18.336788 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626724e1-00fe-4745-ae91-a7322c017674 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:18.386765 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73826e-f9e1-4f14-a38b-9c44b6823349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:18.387969 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73826e-f9e1-4f14-a38b-9c44b6823349 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:18.388444 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73826e-f9e1-4f14-a38b-9c44b6823349 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:18.388905 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73826e-f9e1-4f14-a38b-9c44b6823349 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:18.390256 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73826e-f9e1-4f14-a38b-9c44b6823349 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:18.390835 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73826e-f9e1-4f14-a38b-9c44b6823349 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:18.392581 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73826e-f9e1-4f14-a38b-9c44b6823349 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:18.402250 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 120/244] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Aug 28 00:41:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:18.408816 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c8f09-af51-4f69-8b59-3684fb53951a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:18.510554 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73826e-f9e1-4f14-a38b-9c44b6823349 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:18.514395 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:18.526672 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c8f09-af51-4f69-8b59-3684fb53951a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:18.567795 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9c911-b30b-4f53-b988-4c2e2313a76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:18.568440 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9c911-b30b-4f53-b988-4c2e2313a76f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:18.568776 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9c911-b30b-4f53-b988-4c2e2313a76f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:18.569047 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9c911-b30b-4f53-b988-4c2e2313a76f None admin] PATH_INFO: `/v3/users/8d9f95b18c714d1da8f479e5d5b9862f` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:18.585654 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9c911-b30b-4f53-b988-4c2e2313a76f None admin] RBAC: Authorizing `identity:get_user(user_id=8d9f95b18c714d1da8f479e5d5b9862f)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:18.587406 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9c911-b30b-4f53-b988-4c2e2313a76f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:18.589264 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 125/245] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:41:18 2022] GET /identity/v3/users/8d9f95b18c714d1da8f479e5d5b9862f => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:41:18.596547 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9c911-b30b-4f53-b988-4c2e2313a76f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:18.606645 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:18.631403 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73826e-f9e1-4f14-a38b-9c44b6823349 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:18.665948 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dfdb43-6197-464a-b3b8-2ad3860b404a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:18.666911 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfdb43-6197-464a-b3b8-2ad3860b404a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:18.667384 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfdb43-6197-464a-b3b8-2ad3860b404a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:18.667850 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfdb43-6197-464a-b3b8-2ad3860b404a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:18.678855 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dfdb43-6197-464a-b3b8-2ad3860b404a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:18.685333 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-21dfdb43-6197-464a-b3b8-2ad3860b404a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:41:18.685333 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:18.685333 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:18.685333 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:18.685333 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:18.685333 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:18.685333 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:18.685333 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:18.685333 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:18.685333 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:18.685333 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:18.685333 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:18.685333 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:18.685333 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:18.685333 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:18.685333 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:18.686250 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:18.686250 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:18.686250 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:18.686250 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:18.686250 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:18.686250 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:18.686250 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:18.686250 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:18.686250 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:18.686250 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:18.686250 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:18.686250 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:18.686250 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:18.686250 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:18.686250 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:18.686250 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:18.687309 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:18.687309 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:18.687309 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:18.687309 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:18.687309 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:18.687309 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:18.687309 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:18.687309 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:18.687309 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:18.687309 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:18.687309 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:41:18.687309 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:18.693971 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 121/246] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:41:18.696008 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dfdb43-6197-464a-b3b8-2ad3860b404a None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:18.710667 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9c911-b30b-4f53-b988-4c2e2313a76f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:18.750242 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e1f2d-40ab-46d0-be7a-b5c2a5c70dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:18.751077 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e1f2d-40ab-46d0-be7a-b5c2a5c70dcf None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:18.751077 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e1f2d-40ab-46d0-be7a-b5c2a5c70dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:18.751251 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e1f2d-40ab-46d0-be7a-b5c2a5c70dcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:18.769741 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:18.812110 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dfdb43-6197-464a-b3b8-2ad3860b404a None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:18.833825 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e1f2d-40ab-46d0-be7a-b5c2a5c70dcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:18.835403 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e1f2d-40ab-46d0-be7a-b5c2a5c70dcf None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:18.846196 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:18.849019 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a8be9-b1a6-4a49-854f-873845c0155f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:18.849728 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a8be9-b1a6-4a49-854f-873845c0155f None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:18.850090 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a8be9-b1a6-4a49-854f-873845c0155f None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:18.850594 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a8be9-b1a6-4a49-854f-873845c0155f None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:18.851319 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a8be9-b1a6-4a49-854f-873845c0155f None admin] RBAC: Adding query filter params (name=member) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:18.851630 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a8be9-b1a6-4a49-854f-873845c0155f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:18.853144 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a8be9-b1a6-4a49-854f-873845c0155f None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:18.863172 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 122/247] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Aug 28 00:41:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:18.864510 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298286f9-bf38-4b67-aeb5-7b4027110a80 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:18.864802 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298286f9-bf38-4b67-aeb5-7b4027110a80 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:18.865076 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298286f9-bf38-4b67-aeb5-7b4027110a80 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:18.871960 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 123/248] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:18.873248 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298286f9-bf38-4b67-aeb5-7b4027110a80 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:18.957923 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 126/249] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:41:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 00:41:18.958960 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6df940-0ac7-4352-9482-1ba8f664271a None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:18.959244 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6df940-0ac7-4352-9482-1ba8f664271a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:18.959514 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6df940-0ac7-4352-9482-1ba8f664271a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:18.979005 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-2d6df940-0ac7-4352-9482-1ba8f664271a None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:18.980198 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2d6df940-0ac7-4352-9482-1ba8f664271a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:18.997161 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298286f9-bf38-4b67-aeb5-7b4027110a80 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:19.028263 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:19.042176 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b66b3-7563-4c10-bedc-ac0899489074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:19.042815 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b66b3-7563-4c10-bedc-ac0899489074 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:19.043098 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b66b3-7563-4c10-bedc-ac0899489074 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:19.043803 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b66b3-7563-4c10-bedc-ac0899489074 None admin] PATH_INFO: `/v3/users/5eeb00b561af408fa4dce2fecc569aa1` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:19.045322 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b66b3-7563-4c10-bedc-ac0899489074 None admin] RBAC: Authorizing `identity:get_user(user_id=5eeb00b561af408fa4dce2fecc569aa1)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:19.047913 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b66b3-7563-4c10-bedc-ac0899489074 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:19.050660 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 124/250] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:41:18 2022] GET /identity/v3/users/5eeb00b561af408fa4dce2fecc569aa1 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:19.051882 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b66b3-7563-4c10-bedc-ac0899489074 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:19.062939 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 127/251] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:19.063828 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6df940-0ac7-4352-9482-1ba8f664271a None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:19.126274 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:19.183942 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b66b3-7563-4c10-bedc-ac0899489074 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:19.205662 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6df940-0ac7-4352-9482-1ba8f664271a None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:19.218855 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264a81e-b887-4f08-8756-5fc465120aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:19.219885 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264a81e-b887-4f08-8756-5fc465120aac None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:19.220257 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264a81e-b887-4f08-8756-5fc465120aac None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:19.220633 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264a81e-b887-4f08-8756-5fc465120aac None admin] PATH_INFO: `/v3/projects/ad187f94c1d9456e9c97f78a7f686485` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:19.221897 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264a81e-b887-4f08-8756-5fc465120aac None admin] RBAC: Authorizing `identity:get_project(project_id=ad187f94c1d9456e9c97f78a7f686485)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:19.223513 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264a81e-b887-4f08-8756-5fc465120aac None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:19.225167 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 125/252] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:19 2022] GET /identity/v3/projects/ad187f94c1d9456e9c97f78a7f686485 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:19.233632 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264a81e-b887-4f08-8756-5fc465120aac None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:19.243103 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba67a2-e511-4b9b-8eec-49844a64b2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:19.243755 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba67a2-e511-4b9b-8eec-49844a64b2ba None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:19.244033 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba67a2-e511-4b9b-8eec-49844a64b2ba None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:19.244306 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba67a2-e511-4b9b-8eec-49844a64b2ba None admin] PATH_INFO: `/v3/projects/ad187f94c1d9456e9c97f78a7f686485` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:19.245444 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba67a2-e511-4b9b-8eec-49844a64b2ba None admin] RBAC: Authorizing `identity:get_project(project_id=ad187f94c1d9456e9c97f78a7f686485)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:19.247286 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba67a2-e511-4b9b-8eec-49844a64b2ba None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:19.249238 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 128/253] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:19 2022] GET /identity/v3/projects/ad187f94c1d9456e9c97f78a7f686485 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:19.256626 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba67a2-e511-4b9b-8eec-49844a64b2ba None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:19.362035 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:19.434450 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264a81e-b887-4f08-8756-5fc465120aac None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:19.477578 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba67a2-e511-4b9b-8eec-49844a64b2ba None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:19.480015 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:19.481566 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cfddb-95a1-4dc8-933e-47cd804bc07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:19.482706 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cfddb-95a1-4dc8-933e-47cd804bc07e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:19.482971 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cfddb-95a1-4dc8-933e-47cd804bc07e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:19.483852 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cfddb-95a1-4dc8-933e-47cd804bc07e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:19.484843 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379cfddb-95a1-4dc8-933e-47cd804bc07e None admin] RBAC: Adding query filter params (role.id=3e76264611ba49e6abbc019c0928e888, scope.project.id=ad187f94c1d9456e9c97f78a7f686485, user.id=8d9f95b18c714d1da8f479e5d5b9862f) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:19.485351 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379cfddb-95a1-4dc8-933e-47cd804bc07e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:19.487113 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379cfddb-95a1-4dc8-933e-47cd804bc07e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:19.503300 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 126/254] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:41:19 2022] GET /identity/v3/role_assignments?user.id=8d9f95b18c714d1da8f479e5d5b9862f&scope.project.id=ad187f94c1d9456e9c97f78a7f686485&role.id=3e76264611ba49e6abbc019c0928e888 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:19.504495 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cfddb-95a1-4dc8-933e-47cd804bc07e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:19.515831 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78ff58-f448-4d3b-a436-100a51bce62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:19.516509 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78ff58-f448-4d3b-a436-100a51bce62e None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:19.516788 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78ff58-f448-4d3b-a436-100a51bce62e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:19.517057 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78ff58-f448-4d3b-a436-100a51bce62e None admin] PATH_INFO: `/v3/projects/ad187f94c1d9456e9c97f78a7f686485/users/5eeb00b561af408fa4dce2fecc569aa1/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:19.519123 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78ff58-f448-4d3b-a436-100a51bce62e None admin] RBAC: Authorizing `identity:create_grant(project_id=ad187f94c1d9456e9c97f78a7f686485, user_id=5eeb00b561af408fa4dce2fecc569aa1, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:19.520708 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78ff58-f448-4d3b-a436-100a51bce62e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:19.544827 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 129/255] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Aug 28 00:41:19 2022] PUT /identity/v3/projects/ad187f94c1d9456e9c97f78a7f686485/users/5eeb00b561af408fa4dce2fecc569aa1/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:41:19.683587 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cfddb-95a1-4dc8-933e-47cd804bc07e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:19.714296 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:19.726111 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec301c-bbed-45a3-a8da-4f868808e114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:19.727102 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec301c-bbed-45a3-a8da-4f868808e114 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:19.727637 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec301c-bbed-45a3-a8da-4f868808e114 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:19.728157 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec301c-bbed-45a3-a8da-4f868808e114 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:19.740737 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec301c-bbed-45a3-a8da-4f868808e114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:19.746761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-97ec301c-bbed-45a3-a8da-4f868808e114 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:41:19.746761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:19.746761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:19.746761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:19.746761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:19.746761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:19.746761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:19.746761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:19.746761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:19.746761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:19.746761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:19.746761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:19.746761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:19.746761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:19.746761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:19.746761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:19.747630 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:19.747630 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:19.747630 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:19.747630 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:19.747630 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:19.747630 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:19.747630 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:19.747630 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:19.747630 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:19.747630 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:19.747630 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:19.747630 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:19.747630 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:19.747630 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:19.747630 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:19.747630 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:19.748426 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:19.748426 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:19.748426 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:19.748426 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:19.748426 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:19.748426 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:19.748426 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:19.748426 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:19.748426 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:19.748426 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:19.748426 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:41:19.748426 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:19.751444 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 127/256] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:41:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:19.757139 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78ff58-f448-4d3b-a436-100a51bce62e None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:19.814843 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd703d16-2d0d-413b-ade1-34f520f975cb None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:19.815453 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd703d16-2d0d-413b-ade1-34f520f975cb None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:19.815922 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd703d16-2d0d-413b-ade1-34f520f975cb None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:19.817470 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 128/257] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:41:19.831717 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cafea6-ebc1-4e9d-90bd-8ac56e4746b6 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:19.832343 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cafea6-ebc1-4e9d-90bd-8ac56e4746b6 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:19.832822 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cafea6-ebc1-4e9d-90bd-8ac56e4746b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:19.870890 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-97cafea6-ebc1-4e9d-90bd-8ac56e4746b6 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:19.872562 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-97cafea6-ebc1-4e9d-90bd-8ac56e4746b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:19.912484 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78ff58-f448-4d3b-a436-100a51bce62e None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:19.961974 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2714126-02fd-4aa9-9ffe-c6ad023f1654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:19.962593 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2714126-02fd-4aa9-9ffe-c6ad023f1654 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:19.962873 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2714126-02fd-4aa9-9ffe-c6ad023f1654 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:19.963146 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2714126-02fd-4aa9-9ffe-c6ad023f1654 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:19.963825 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2714126-02fd-4aa9-9ffe-c6ad023f1654 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:19.964129 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2714126-02fd-4aa9-9ffe-c6ad023f1654 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:19.965526 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2714126-02fd-4aa9-9ffe-c6ad023f1654 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:19.987206 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 130/258] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:19.993061 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2714126-02fd-4aa9-9ffe-c6ad023f1654 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:20.044691 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 129/259] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:41:20.053130 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:20.144106 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2714126-02fd-4aa9-9ffe-c6ad023f1654 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:20.195151 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a726c1-c5ac-4e73-aff5-df9f9300abab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:20.196146 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a726c1-c5ac-4e73-aff5-df9f9300abab None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:20.196621 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a726c1-c5ac-4e73-aff5-df9f9300abab None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:20.197086 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a726c1-c5ac-4e73-aff5-df9f9300abab None admin] PATH_INFO: `/v3/users/7c232e5ec09f4942aae01f9d187e0745` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:20.198494 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a726c1-c5ac-4e73-aff5-df9f9300abab None admin] RBAC: Authorizing `identity:get_user(user_id=7c232e5ec09f4942aae01f9d187e0745)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:20.200182 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a726c1-c5ac-4e73-aff5-df9f9300abab None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:20.202002 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 131/260] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:41:19 2022] GET /identity/v3/users/7c232e5ec09f4942aae01f9d187e0745 => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:20.208432 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cafea6-ebc1-4e9d-90bd-8ac56e4746b6 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:20.323764 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cafea6-ebc1-4e9d-90bd-8ac56e4746b6 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:20.343481 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:20.363997 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8ca0d-69c3-4bc5-8d6b-9b0c98d481b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:20.364613 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8ca0d-69c3-4bc5-8d6b-9b0c98d481b0 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:20.364897 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8ca0d-69c3-4bc5-8d6b-9b0c98d481b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:20.365164 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8ca0d-69c3-4bc5-8d6b-9b0c98d481b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:20.442657 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef8ca0d-69c3-4bc5-8d6b-9b0c98d481b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:20.444190 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef8ca0d-69c3-4bc5-8d6b-9b0c98d481b0 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:20.583331 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 130/261] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:41:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:41:20.588552 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a726c1-c5ac-4e73-aff5-df9f9300abab None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:20.602857 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8ca0d-69c3-4bc5-8d6b-9b0c98d481b0 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:20.633367 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:20.734619 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:20.745724 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a726c1-c5ac-4e73-aff5-df9f9300abab None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:20.764658 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8ca0d-69c3-4bc5-8d6b-9b0c98d481b0 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:20.806320 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f51d2b-35c8-41bb-a2bd-8391c649ee98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:20.806956 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f51d2b-35c8-41bb-a2bd-8391c649ee98 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:20.807235 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f51d2b-35c8-41bb-a2bd-8391c649ee98 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:20.807512 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f51d2b-35c8-41bb-a2bd-8391c649ee98 None admin] PATH_INFO: `/v3/projects/ad187f94c1d9456e9c97f78a7f686485` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:20.809673 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f51d2b-35c8-41bb-a2bd-8391c649ee98 None admin] RBAC: Authorizing `identity:get_project(project_id=ad187f94c1d9456e9c97f78a7f686485)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:20.811173 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f51d2b-35c8-41bb-a2bd-8391c649ee98 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:20.812898 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 132/262] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:20 2022] GET /identity/v3/projects/ad187f94c1d9456e9c97f78a7f686485 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:20.822228 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f51d2b-35c8-41bb-a2bd-8391c649ee98 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:20.845427 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb40a1-252a-4220-be85-c32d8364545b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:20.846029 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb40a1-252a-4220-be85-c32d8364545b None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:20.846309 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb40a1-252a-4220-be85-c32d8364545b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:20.846583 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb40a1-252a-4220-be85-c32d8364545b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:20.878046 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb40a1-252a-4220-be85-c32d8364545b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:20.883062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-8cfb40a1-252a-4220-be85-c32d8364545b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:41:20.883062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:20.883062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:20.883062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:20.883062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:20.883062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:20.883062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:20.883062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:20.883062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:20.883062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:20.883062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:20.883062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:20.883062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:20.883062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:20.883062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:20.883062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:20.883957 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:20.883957 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:20.883957 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:20.883957 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:20.883957 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:20.883957 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:20.883957 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:20.883957 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:20.883957 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:20.883957 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:20.883957 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:20.883957 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:20.883957 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:20.883957 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:20.883957 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:20.883957 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:20.885152 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:20.885152 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:20.885152 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:20.885152 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:20.885152 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:20.885152 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:20.885152 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:20.885152 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:20.885152 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:20.885152 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:20.885152 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:41:20.885152 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:20.885152 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 131/263] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Aug 28 00:41:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:20.895876 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb40a1-252a-4220-be85-c32d8364545b None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:21.013375 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f51d2b-35c8-41bb-a2bd-8391c649ee98 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:21.054411 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a52b2-281f-40be-85ab-98da8e8a7157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:21.054888 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a52b2-281f-40be-85ab-98da8e8a7157 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:21.055169 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a52b2-281f-40be-85ab-98da8e8a7157 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:21.055441 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a52b2-281f-40be-85ab-98da8e8a7157 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:21.056185 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a52b2-281f-40be-85ab-98da8e8a7157 None admin] RBAC: Adding query filter params (role.id=cc013581bb07418d9ec6a3a1d282ea53, scope.project.id=ad187f94c1d9456e9c97f78a7f686485, user.id=7c232e5ec09f4942aae01f9d187e0745) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:21.056493 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a52b2-281f-40be-85ab-98da8e8a7157 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:21.058005 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a52b2-281f-40be-85ab-98da8e8a7157 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:21.084441 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 133/264] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:41:20 2022] GET /identity/v3/role_assignments?user.id=7c232e5ec09f4942aae01f9d187e0745&scope.project.id=ad187f94c1d9456e9c97f78a7f686485&role.id=cc013581bb07418d9ec6a3a1d282ea53 => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:21.102822 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:21.116356 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb40a1-252a-4220-be85-c32d8364545b None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:21.168112 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4624c7b-7bd5-48fb-9460-6a2cafa9a040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:21.174588 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4624c7b-7bd5-48fb-9460-6a2cafa9a040 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:21.174879 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4624c7b-7bd5-48fb-9460-6a2cafa9a040 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:21.175159 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4624c7b-7bd5-48fb-9460-6a2cafa9a040 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:21.175857 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4624c7b-7bd5-48fb-9460-6a2cafa9a040 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:21.176161 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4624c7b-7bd5-48fb-9460-6a2cafa9a040 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:21.177590 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4624c7b-7bd5-48fb-9460-6a2cafa9a040 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:21.187224 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 132/265] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:41:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:21.192875 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a52b2-281f-40be-85ab-98da8e8a7157 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:21.232123 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:21.316341 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a52b2-281f-40be-85ab-98da8e8a7157 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:21.365077 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f52da-758e-42f8-8b93-945d93c2c83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:21.365643 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f52da-758e-42f8-8b93-945d93c2c83e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:21.365945 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f52da-758e-42f8-8b93-945d93c2c83e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:21.366220 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f52da-758e-42f8-8b93-945d93c2c83e None admin] PATH_INFO: `/v3/users/7c232e5ec09f4942aae01f9d187e0745` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:21.367388 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f52da-758e-42f8-8b93-945d93c2c83e None admin] RBAC: Authorizing `identity:get_user(user_id=7c232e5ec09f4942aae01f9d187e0745)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:21.368865 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f52da-758e-42f8-8b93-945d93c2c83e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:21.370497 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 134/266] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:41:21 2022] GET /identity/v3/users/7c232e5ec09f4942aae01f9d187e0745 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:21.376249 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4624c7b-7bd5-48fb-9460-6a2cafa9a040 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:21.544720 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4624c7b-7bd5-48fb-9460-6a2cafa9a040 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:21.590813 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a581bcf-f84b-4700-bad5-2e68ca76ac32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:21.591489 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a581bcf-f84b-4700-bad5-2e68ca76ac32 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:21.591767 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a581bcf-f84b-4700-bad5-2e68ca76ac32 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:21.592034 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a581bcf-f84b-4700-bad5-2e68ca76ac32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:21.604363 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:21.677818 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a581bcf-f84b-4700-bad5-2e68ca76ac32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:21.679526 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a581bcf-f84b-4700-bad5-2e68ca76ac32 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:21.797908 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 133/267] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:41:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:41:21.803510 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f52da-758e-42f8-8b93-945d93c2c83e None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:21.809975 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2a799-90e6-489d-ae65-dce67a0cfe40 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:21.810259 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2a799-90e6-489d-ae65-dce67a0cfe40 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:21.810531 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2a799-90e6-489d-ae65-dce67a0cfe40 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:21.811933 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 134/268] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:41:21.812949 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7b462-4037-4d42-883a-2570ee42daa0 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:21.813221 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7b462-4037-4d42-883a-2570ee42daa0 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:21.813485 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7b462-4037-4d42-883a-2570ee42daa0 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:21.814912 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 135/269] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:21.819956 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954aba41-94d2-43d6-a19d-082637da9f27 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:21.820231 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954aba41-94d2-43d6-a19d-082637da9f27 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:21.820498 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954aba41-94d2-43d6-a19d-082637da9f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:21.849005 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-954aba41-94d2-43d6-a19d-082637da9f27 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:21.850851 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-954aba41-94d2-43d6-a19d-082637da9f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:21.889143 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:21.916015 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:21.923167 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f52da-758e-42f8-8b93-945d93c2c83e None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:21.939930 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 136/270] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:41:21.941131 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf5a0a-10b6-4e9f-979d-c1f30483751c None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:21.941410 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf5a0a-10b6-4e9f-979d-c1f30483751c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:21.941674 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf5a0a-10b6-4e9f-979d-c1f30483751c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:21.960771 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-9ddf5a0a-10b6-4e9f-979d-c1f30483751c None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:21.961980 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9ddf5a0a-10b6-4e9f-979d-c1f30483751c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:21.989851 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd692b5c-fb33-4328-8ac3-eb1d47f35dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:21.990506 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd692b5c-fb33-4328-8ac3-eb1d47f35dee None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:21.990790 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd692b5c-fb33-4328-8ac3-eb1d47f35dee None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:21.991058 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd692b5c-fb33-4328-8ac3-eb1d47f35dee None admin] PATH_INFO: `/v3/projects/ad187f94c1d9456e9c97f78a7f686485` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:21.992981 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd692b5c-fb33-4328-8ac3-eb1d47f35dee None admin] RBAC: Authorizing `identity:get_project(project_id=ad187f94c1d9456e9c97f78a7f686485)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:21.994489 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd692b5c-fb33-4328-8ac3-eb1d47f35dee None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:21.997701 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 135/271] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:21 2022] GET /identity/v3/projects/ad187f94c1d9456e9c97f78a7f686485 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:22.005203 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd692b5c-fb33-4328-8ac3-eb1d47f35dee None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:22.087111 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 137/272] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:22.148258 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e20d8-8b1e-440a-b4c9-88df35361ea2 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:22.148623 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd692b5c-fb33-4328-8ac3-eb1d47f35dee None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:22.149079 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e20d8-8b1e-440a-b4c9-88df35361ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:22.149542 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e20d8-8b1e-440a-b4c9-88df35361ea2 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:22.154960 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 138/273] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:41:22.156982 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff308ce-dad4-4d5a-8750-33141e82cd23 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:22.157471 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff308ce-dad4-4d5a-8750-33141e82cd23 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:22.157975 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff308ce-dad4-4d5a-8750-33141e82cd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:22.177100 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-cff308ce-dad4-4d5a-8750-33141e82cd23 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:22.178866 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-cff308ce-dad4-4d5a-8750-33141e82cd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:22.183720 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc751e7-9ae5-4e0c-9f45-b7718075ef7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:22.184330 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc751e7-9ae5-4e0c-9f45-b7718075ef7d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:22.184604 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc751e7-9ae5-4e0c-9f45-b7718075ef7d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:22.184868 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc751e7-9ae5-4e0c-9f45-b7718075ef7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:22.185594 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc751e7-9ae5-4e0c-9f45-b7718075ef7d None admin] RBAC: Adding query filter params (role.id=258091cadd094ad2a608d396036e8869, scope.project.id=ad187f94c1d9456e9c97f78a7f686485, user.id=7c232e5ec09f4942aae01f9d187e0745) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:22.185920 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc751e7-9ae5-4e0c-9f45-b7718075ef7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:22.187499 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc751e7-9ae5-4e0c-9f45-b7718075ef7d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:22.194204 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 136/274] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:41:22 2022] GET /identity/v3/role_assignments?user.id=7c232e5ec09f4942aae01f9d187e0745&scope.project.id=ad187f94c1d9456e9c97f78a7f686485&role.id=258091cadd094ad2a608d396036e8869 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:22.252648 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22aeea-cc59-4acd-8cc7-43185a0b3fc6 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:22.253166 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22aeea-cc59-4acd-8cc7-43185a0b3fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:22.253546 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22aeea-cc59-4acd-8cc7-43185a0b3fc6 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:22.258195 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 139/275] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:41:22.259659 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 137/276] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:22.278686 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa3332-e5b4-4a91-967c-523da634f8e2 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:22.279309 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa3332-e5b4-4a91-967c-523da634f8e2 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:22.279802 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa3332-e5b4-4a91-967c-523da634f8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:22.307152 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-e0aa3332-e5b4-4a91-967c-523da634f8e2 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:22.308288 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e0aa3332-e5b4-4a91-967c-523da634f8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:22.311345 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22aeea-cc59-4acd-8cc7-43185a0b3fc6 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:22.341136 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:22.379188 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:22.396764 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 140/277] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:41:22.453068 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa3332-e5b4-4a91-967c-523da634f8e2 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:22.467110 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22aeea-cc59-4acd-8cc7-43185a0b3fc6 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:22.513144 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667ac08-6ea7-4077-a2c8-c24ec96bf042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:22.514086 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667ac08-6ea7-4077-a2c8-c24ec96bf042 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:22.514374 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667ac08-6ea7-4077-a2c8-c24ec96bf042 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:22.514785 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667ac08-6ea7-4077-a2c8-c24ec96bf042 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:22.516070 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667ac08-6ea7-4077-a2c8-c24ec96bf042 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:22.518030 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667ac08-6ea7-4077-a2c8-c24ec96bf042 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:22.520045 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 138/278] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:41:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:22.526749 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667ac08-6ea7-4077-a2c8-c24ec96bf042 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:22.598512 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa3332-e5b4-4a91-967c-523da634f8e2 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:22.639471 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a03b08-4189-4dcf-85b9-fd4b625a7cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:22.640193 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a03b08-4189-4dcf-85b9-fd4b625a7cbb None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:22.640466 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a03b08-4189-4dcf-85b9-fd4b625a7cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:22.640733 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a03b08-4189-4dcf-85b9-fd4b625a7cbb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:22.647256 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:22.652338 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a03b08-4189-4dcf-85b9-fd4b625a7cbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:22.654561 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667ac08-6ea7-4077-a2c8-c24ec96bf042 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:22.657721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-a3a03b08-4189-4dcf-85b9-fd4b625a7cbb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:41:22.657721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:22.657721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:22.657721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:22.657721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:22.657721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:22.657721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:22.657721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:22.657721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:22.657721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:22.657721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:22.657721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:22.657721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:22.657721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:22.657721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:22.657721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:22.658644 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:22.658644 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:22.658644 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:22.658644 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:22.658644 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:22.658644 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:22.658644 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:22.658644 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:22.658644 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:22.658644 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:22.658644 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:22.658644 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:22.658644 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:22.658644 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:22.658644 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:22.658644 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:22.664370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:22.664370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:22.664370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:22.664370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:22.664370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:22.664370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:22.664370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:22.664370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:22.664370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:22.664370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:22.664370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:41:22.664370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:22.664370 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 141/279] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:41:22.664370 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a03b08-4189-4dcf-85b9-fd4b625a7cbb None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:22.683924 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:22.693945 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42efe66e-313b-4abf-b55e-a2b3e5550d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:22.694567 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efe66e-313b-4abf-b55e-a2b3e5550d27 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:22.694848 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efe66e-313b-4abf-b55e-a2b3e5550d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:22.695121 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efe66e-313b-4abf-b55e-a2b3e5550d27 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:22.695774 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42efe66e-313b-4abf-b55e-a2b3e5550d27 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:22.697226 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42efe66e-313b-4abf-b55e-a2b3e5550d27 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:22.717522 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 139/280] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Aug 28 00:41:22 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:41:22.718246 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42efe66e-313b-4abf-b55e-a2b3e5550d27 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:22.778484 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a03b08-4189-4dcf-85b9-fd4b625a7cbb None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:22.820884 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85586e9a-7e59-4ef2-806a-4287c8d69b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:22.821549 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85586e9a-7e59-4ef2-806a-4287c8d69b6f None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:22.821805 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85586e9a-7e59-4ef2-806a-4287c8d69b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:22.822112 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85586e9a-7e59-4ef2-806a-4287c8d69b6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:22.827105 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42efe66e-313b-4abf-b55e-a2b3e5550d27 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:22.836636 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85586e9a-7e59-4ef2-806a-4287c8d69b6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:22.842081 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-85586e9a-7e59-4ef2-806a-4287c8d69b6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:41:22.842081 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:22.842081 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:22.842081 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:22.842081 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:22.842081 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:22.842081 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:22.842081 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:22.842081 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:22.842081 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:22.842081 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:22.842081 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:22.842081 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:22.842081 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:22.842081 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:22.842081 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:22.843830 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:22.843830 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:22.843830 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:22.843830 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:22.843830 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:22.843830 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:22.843830 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:22.843830 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:22.843830 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:22.843830 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:22.843830 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:22.843830 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:22.843830 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:22.843830 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:22.843830 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:22.843830 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:22.844967 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:22.844967 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:22.844967 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:22.844967 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:22.844967 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:22.844967 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:22.844967 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:22.844967 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:22.844967 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:22.844967 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:22.844967 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:41:22.844967 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:22.844967 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 142/281] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:22.845614 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85586e9a-7e59-4ef2-806a-4287c8d69b6f None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:22.887150 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ef16f-f08c-421c-84a5-4505a3985992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:22.887887 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ef16f-f08c-421c-84a5-4505a3985992 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:22.888873 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ef16f-f08c-421c-84a5-4505a3985992 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:22.888873 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ef16f-f08c-421c-84a5-4505a3985992 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:22.889218 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ef16f-f08c-421c-84a5-4505a3985992 None admin] RBAC: Adding query filter params (name=member) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:22.889824 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ef16f-f08c-421c-84a5-4505a3985992 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:22.891584 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ef16f-f08c-421c-84a5-4505a3985992 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:22.901064 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 140/282] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Aug 28 00:41:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:22.906647 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ef16f-f08c-421c-84a5-4505a3985992 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:22.924793 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:22.943242 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:22.973239 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85586e9a-7e59-4ef2-806a-4287c8d69b6f None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:23.016884 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0d29a-0406-4f9d-b983-3cb2fb768a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:23.017866 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0d29a-0406-4f9d-b983-3cb2fb768a4b None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:23.018314 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0d29a-0406-4f9d-b983-3cb2fb768a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:23.018750 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0d29a-0406-4f9d-b983-3cb2fb768a4b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:23.031392 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0d29a-0406-4f9d-b983-3cb2fb768a4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:23.036293 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-04e0d29a-0406-4f9d-b983-3cb2fb768a4b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:41:23.036293 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:23.036293 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:23.036293 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:23.036293 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:23.036293 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:23.036293 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:23.036293 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:23.036293 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:23.036293 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:23.036293 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:23.036293 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:23.036293 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:23.036293 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:23.036293 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:23.036293 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:23.037179 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:23.037179 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:23.037179 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:23.037179 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:23.037179 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:23.037179 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:23.037179 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:23.037179 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:23.037179 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:23.037179 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:23.037179 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:23.037179 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:23.037179 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:23.037179 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:23.037179 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:23.037179 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:23.037991 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:23.037991 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:23.037991 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:23.037991 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:23.037991 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:23.037991 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:23.037991 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:23.037991 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:23.037991 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:23.037991 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:23.037991 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:41:23.037991 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:23.038575 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ef16f-f08c-421c-84a5-4505a3985992 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:23.038645 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 143/283] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:23.038645 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0d29a-0406-4f9d-b983-3cb2fb768a4b None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:23.081272 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68f406-f86a-429a-bf74-b40e7221800c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:23.081909 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68f406-f86a-429a-bf74-b40e7221800c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:23.082189 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68f406-f86a-429a-bf74-b40e7221800c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:23.082454 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68f406-f86a-429a-bf74-b40e7221800c None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:23.083117 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68f406-f86a-429a-bf74-b40e7221800c None admin] RBAC: Adding query filter params (name=member) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:23.083409 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68f406-f86a-429a-bf74-b40e7221800c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:23.084887 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68f406-f86a-429a-bf74-b40e7221800c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:23.096579 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 141/284] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Aug 28 00:41:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:23.097259 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68f406-f86a-429a-bf74-b40e7221800c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:23.159601 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0d29a-0406-4f9d-b983-3cb2fb768a4b None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:23.196281 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:23.197236 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f18742-20f9-45ab-bdf9-54716931145e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:23.197902 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f18742-20f9-45ab-bdf9-54716931145e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:23.198183 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f18742-20f9-45ab-bdf9-54716931145e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:23.198451 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f18742-20f9-45ab-bdf9-54716931145e None admin] PATH_INFO: `/v3/users/c6a4d077df474200ab0fd0de783b02d2` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:23.207552 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:23.217168 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f18742-20f9-45ab-bdf9-54716931145e None admin] RBAC: Authorizing `identity:get_user(user_id=c6a4d077df474200ab0fd0de783b02d2)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:23.219126 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f18742-20f9-45ab-bdf9-54716931145e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:23.221306 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 144/285] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:41:23 2022] GET /identity/v3/users/c6a4d077df474200ab0fd0de783b02d2 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:23.222216 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f18742-20f9-45ab-bdf9-54716931145e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:23.230395 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68f406-f86a-429a-bf74-b40e7221800c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:23.272002 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bf4aa-b933-4824-9e37-b82ca7051f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:23.273024 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bf4aa-b933-4824-9e37-b82ca7051f61 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:23.273500 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bf4aa-b933-4824-9e37-b82ca7051f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:23.274012 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bf4aa-b933-4824-9e37-b82ca7051f61 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:23.274892 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521bf4aa-b933-4824-9e37-b82ca7051f61 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:23.275399 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521bf4aa-b933-4824-9e37-b82ca7051f61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:23.277269 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521bf4aa-b933-4824-9e37-b82ca7051f61 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:23.287838 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 142/286] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Aug 28 00:41:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:23.289830 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bf4aa-b933-4824-9e37-b82ca7051f61 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:23.342831 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f18742-20f9-45ab-bdf9-54716931145e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:23.387669 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7d1ba-f367-4fb4-afd8-96fe92a08bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:23.388364 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7d1ba-f367-4fb4-afd8-96fe92a08bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:23.388643 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7d1ba-f367-4fb4-afd8-96fe92a08bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:23.388911 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7d1ba-f367-4fb4-afd8-96fe92a08bc5 None admin] PATH_INFO: `/v3/users/5eeb00b561af408fa4dce2fecc569aa1` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:23.390699 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7d1ba-f367-4fb4-afd8-96fe92a08bc5 None admin] RBAC: Authorizing `identity:get_user(user_id=5eeb00b561af408fa4dce2fecc569aa1)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:23.392452 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7d1ba-f367-4fb4-afd8-96fe92a08bc5 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:23.398062 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 145/287] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:41:23 2022] GET /identity/v3/users/5eeb00b561af408fa4dce2fecc569aa1 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:23.399209 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7d1ba-f367-4fb4-afd8-96fe92a08bc5 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:23.409540 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bf4aa-b933-4824-9e37-b82ca7051f61 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:23.446780 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7e05f-6718-47e0-80df-2959b0486a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:23.447772 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7e05f-6718-47e0-80df-2959b0486a37 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:23.448265 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7e05f-6718-47e0-80df-2959b0486a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:23.448779 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7e05f-6718-47e0-80df-2959b0486a37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:23.449699 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7e05f-6718-47e0-80df-2959b0486a37 None admin] RBAC: Adding query filter params (role.id=2231e998e50146f4b53b832f2f88c1c8, user.id=c6a4d077df474200ab0fd0de783b02d2, scope.system=all) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:23.450223 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7e05f-6718-47e0-80df-2959b0486a37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:23.451871 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7e05f-6718-47e0-80df-2959b0486a37 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:23.455419 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:23.460870 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 143/288] 10.222.0.52 () {56 vars in 1308 bytes} [Sun Aug 28 00:41:23 2022] GET /identity/v3/role_assignments?user.id=c6a4d077df474200ab0fd0de783b02d2&scope.system=all&role.id=2231e998e50146f4b53b832f2f88c1c8 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:23.473414 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7e05f-6718-47e0-80df-2959b0486a37 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:23.512229 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:23.588073 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7d1ba-f367-4fb4-afd8-96fe92a08bc5 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:23.631902 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bb3e4-d83c-43d1-a283-e568e4a69a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:23.632555 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bb3e4-d83c-43d1-a283-e568e4a69a37 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:23.632833 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bb3e4-d83c-43d1-a283-e568e4a69a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:23.633104 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bb3e4-d83c-43d1-a283-e568e4a69a37 None admin] PATH_INFO: `/v3/users/8d9f95b18c714d1da8f479e5d5b9862f` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:23.634301 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190bb3e4-d83c-43d1-a283-e568e4a69a37 None admin] RBAC: Authorizing `identity:get_user(user_id=8d9f95b18c714d1da8f479e5d5b9862f)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:23.635876 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190bb3e4-d83c-43d1-a283-e568e4a69a37 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:23.637491 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 146/289] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:41:23 2022] GET /identity/v3/users/8d9f95b18c714d1da8f479e5d5b9862f => generated 297 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:23.647632 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bb3e4-d83c-43d1-a283-e568e4a69a37 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:23.694248 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7e05f-6718-47e0-80df-2959b0486a37 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:23.758860 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba63456-e867-4bfe-9ea4-dd1d9abcdb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:23.759476 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba63456-e867-4bfe-9ea4-dd1d9abcdb2c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:23.759749 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba63456-e867-4bfe-9ea4-dd1d9abcdb2c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:23.760019 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba63456-e867-4bfe-9ea4-dd1d9abcdb2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:23.806941 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bb3e4-d83c-43d1-a283-e568e4a69a37 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:23.862250 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:23.872211 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:23.872702 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906e108-a641-4efa-8ea3-6a952df305c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:23.873327 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906e108-a641-4efa-8ea3-6a952df305c2 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:23.873646 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906e108-a641-4efa-8ea3-6a952df305c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:23.874253 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906e108-a641-4efa-8ea3-6a952df305c2 None admin] PATH_INFO: `/v3/projects/ad187f94c1d9456e9c97f78a7f686485` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:23.875774 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8906e108-a641-4efa-8ea3-6a952df305c2 None admin] RBAC: Authorizing `identity:get_project(project_id=ad187f94c1d9456e9c97f78a7f686485)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:23.877237 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8906e108-a641-4efa-8ea3-6a952df305c2 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:23.884968 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 147/290] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:23 2022] GET /identity/v3/projects/ad187f94c1d9456e9c97f78a7f686485 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:23.885737 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba63456-e867-4bfe-9ea4-dd1d9abcdb2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:23.887264 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba63456-e867-4bfe-9ea4-dd1d9abcdb2c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:23.891319 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906e108-a641-4efa-8ea3-6a952df305c2 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:24.022759 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 144/291] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:41:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:41:24.028228 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba63456-e867-4bfe-9ea4-dd1d9abcdb2c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:24.029237 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906e108-a641-4efa-8ea3-6a952df305c2 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:24.066153 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d035c3e4-00c8-47ad-bf81-d362ad46c816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:24.066740 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d035c3e4-00c8-47ad-bf81-d362ad46c816 None admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:24.067018 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d035c3e4-00c8-47ad-bf81-d362ad46c816 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:24.067292 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d035c3e4-00c8-47ad-bf81-d362ad46c816 None admin] PATH_INFO: `/v3/projects/ad187f94c1d9456e9c97f78a7f686485/users/8d9f95b18c714d1da8f479e5d5b9862f/roles/3e76264611ba49e6abbc019c0928e888` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:24.069244 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d035c3e4-00c8-47ad-bf81-d362ad46c816 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad187f94c1d9456e9c97f78a7f686485, user_id=8d9f95b18c714d1da8f479e5d5b9862f, role_id=3e76264611ba49e6abbc019c0928e888)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:24.070748 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d035c3e4-00c8-47ad-bf81-d362ad46c816 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:24.088396 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 148/292] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Aug 28 00:41:23 2022] PUT /identity/v3/projects/ad187f94c1d9456e9c97f78a7f686485/users/8d9f95b18c714d1da8f479e5d5b9862f/roles/3e76264611ba49e6abbc019c0928e888 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:41:24.174429 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:24.178269 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba63456-e867-4bfe-9ea4-dd1d9abcdb2c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:24.215986 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75611cef-6476-401c-9c51-725df11ec8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:24.216630 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75611cef-6476-401c-9c51-725df11ec8fb None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:24.216961 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75611cef-6476-401c-9c51-725df11ec8fb None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:24.217233 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75611cef-6476-401c-9c51-725df11ec8fb None admin] PATH_INFO: `/v3/projects/ad187f94c1d9456e9c97f78a7f686485` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:24.218467 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75611cef-6476-401c-9c51-725df11ec8fb None admin] RBAC: Authorizing `identity:get_project(project_id=ad187f94c1d9456e9c97f78a7f686485)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:24.220331 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75611cef-6476-401c-9c51-725df11ec8fb None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:24.222496 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 145/293] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:24 2022] GET /identity/v3/projects/ad187f94c1d9456e9c97f78a7f686485 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:41:24.231156 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d035c3e4-00c8-47ad-bf81-d362ad46c816 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:24.297973 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:24.354248 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d035c3e4-00c8-47ad-bf81-d362ad46c816 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:24.392192 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127b386-5ce8-4fd7-ada6-5bc6c92371a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:24.392809 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127b386-5ce8-4fd7-ada6-5bc6c92371a0 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:24.393091 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127b386-5ce8-4fd7-ada6-5bc6c92371a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:24.393363 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127b386-5ce8-4fd7-ada6-5bc6c92371a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:24.394125 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127b386-5ce8-4fd7-ada6-5bc6c92371a0 None admin] RBAC: Adding query filter params (role.id=2231e998e50146f4b53b832f2f88c1c8, scope.project.id=ad187f94c1d9456e9c97f78a7f686485, user.id=5eeb00b561af408fa4dce2fecc569aa1) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:24.394436 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127b386-5ce8-4fd7-ada6-5bc6c92371a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:24.395899 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127b386-5ce8-4fd7-ada6-5bc6c92371a0 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:24.402241 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 149/294] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:41:24 2022] GET /identity/v3/role_assignments?user.id=5eeb00b561af408fa4dce2fecc569aa1&scope.project.id=ad187f94c1d9456e9c97f78a7f686485&role.id=2231e998e50146f4b53b832f2f88c1c8 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:24.879296 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b890abe-12a2-4fe0-bcc5-7840e0320e03 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:24.879810 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b890abe-12a2-4fe0-bcc5-7840e0320e03 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:24.879810 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b890abe-12a2-4fe0-bcc5-7840e0320e03 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:24.881405 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 146/295] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:24.886923 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549834e-fdda-4342-a924-6638dbda5ba1 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:24.887420 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549834e-fdda-4342-a924-6638dbda5ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:24.887572 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549834e-fdda-4342-a924-6638dbda5ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:24.908348 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-7549834e-fdda-4342-a924-6638dbda5ba1 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:24.909573 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-7549834e-fdda-4342-a924-6638dbda5ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:24.993133 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 150/296] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:25.171740 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748539d0-b233-4ab8-a2de-17af3550cc3f None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:25.172037 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748539d0-b233-4ab8-a2de-17af3550cc3f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:25.172193 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748539d0-b233-4ab8-a2de-17af3550cc3f None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:25.173518 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 147/297] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:25.179005 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddcb84-3b23-4b02-bd7a-4811e5b34655 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:25.179292 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddcb84-3b23-4b02-bd7a-4811e5b34655 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:25.179563 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddcb84-3b23-4b02-bd7a-4811e5b34655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:25.197639 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-36ddcb84-3b23-4b02-bd7a-4811e5b34655 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:25.198848 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-36ddcb84-3b23-4b02-bd7a-4811e5b34655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:25.250103 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:25.267860 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 151/298] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:25.275080 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748539d0-b233-4ab8-a2de-17af3550cc3f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:25.383965 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748539d0-b233-4ab8-a2de-17af3550cc3f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:25.419210 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7a7d1-0b2a-4d0b-9a66-c000bcc4e76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:25.419849 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7a7d1-0b2a-4d0b-9a66-c000bcc4e76f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:25.420133 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7a7d1-0b2a-4d0b-9a66-c000bcc4e76f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:25.420399 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7a7d1-0b2a-4d0b-9a66-c000bcc4e76f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:25.431126 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd7a7d1-0b2a-4d0b-9a66-c000bcc4e76f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:25.435965 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-3dd7a7d1-0b2a-4d0b-9a66-c000bcc4e76f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:41:25.435965 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:25.435965 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:25.435965 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:25.435965 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:25.435965 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:25.435965 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:25.435965 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:25.435965 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:25.435965 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:25.435965 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:25.435965 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:25.435965 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:25.435965 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:25.435965 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:25.435965 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:25.436862 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:25.436862 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:25.436862 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:25.436862 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:25.436862 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:25.436862 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:25.436862 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:25.436862 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:25.436862 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:25.436862 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:25.436862 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:25.436862 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:25.436862 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:25.436862 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:25.436862 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:25.436862 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:25.437684 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:25.437684 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:25.437684 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:25.437684 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:25.437684 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:25.437684 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:25.437684 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:25.437684 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:25.437684 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:25.437684 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:25.437684 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:41:25.437684 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:25.437684 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 148/299] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:25.447017 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddcb84-3b23-4b02-bd7a-4811e5b34655 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:25.555456 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddcb84-3b23-4b02-bd7a-4811e5b34655 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:25.569247 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7a7d1-0b2a-4d0b-9a66-c000bcc4e76f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:25.591961 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdf695-a5e1-4d22-95dc-049bd1975fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:25.592851 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdf695-a5e1-4d22-95dc-049bd1975fce None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:25.593089 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdf695-a5e1-4d22-95dc-049bd1975fce None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:25.593338 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdf695-a5e1-4d22-95dc-049bd1975fce None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:25.594103 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bdf695-a5e1-4d22-95dc-049bd1975fce None admin] RBAC: Adding query filter params (name=reader) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:25.594714 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bdf695-a5e1-4d22-95dc-049bd1975fce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:25.596098 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bdf695-a5e1-4d22-95dc-049bd1975fce None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:25.600873 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:25.605730 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 152/300] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Aug 28 00:41:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:25.612352 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdf695-a5e1-4d22-95dc-049bd1975fce None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:25.667742 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:25.689737 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7a7d1-0b2a-4d0b-9a66-c000bcc4e76f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:25.724419 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdf695-a5e1-4d22-95dc-049bd1975fce None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:25.726160 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81441c-d6b3-4381-81bb-522ecde1f3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:25.727498 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81441c-d6b3-4381-81bb-522ecde1f3c3 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:25.727498 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81441c-d6b3-4381-81bb-522ecde1f3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:25.727498 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81441c-d6b3-4381-81bb-522ecde1f3c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:25.728433 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb81441c-d6b3-4381-81bb-522ecde1f3c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:25.729926 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb81441c-d6b3-4381-81bb-522ecde1f3c3 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:25.731502 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 149/301] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:41:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:25.732615 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47602697-b0b0-4986-b3b8-a01bd6b827a3 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:25.732896 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47602697-b0b0-4986-b3b8-a01bd6b827a3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:25.733312 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47602697-b0b0-4986-b3b8-a01bd6b827a3 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:25.734652 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 150/302] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:25.739326 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47602697-b0b0-4986-b3b8-a01bd6b827a3 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:25.765512 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0606ef1-6a7f-4654-983b-46b62115929d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:25.766178 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0606ef1-6a7f-4654-983b-46b62115929d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:25.766463 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0606ef1-6a7f-4654-983b-46b62115929d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:25.766735 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0606ef1-6a7f-4654-983b-46b62115929d None admin] PATH_INFO: `/v3/users/05616fedce2d4d18b5dbcc8188cb2970` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:25.780565 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0606ef1-6a7f-4654-983b-46b62115929d None admin] RBAC: Authorizing `identity:get_user(user_id=05616fedce2d4d18b5dbcc8188cb2970)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:25.782184 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0606ef1-6a7f-4654-983b-46b62115929d None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:25.784088 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 153/303] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:41:25 2022] GET /identity/v3/users/05616fedce2d4d18b5dbcc8188cb2970 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:25.789991 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae017baf-94be-4318-b5fd-fcca8641f7d6 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:25.790275 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae017baf-94be-4318-b5fd-fcca8641f7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:25.790549 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae017baf-94be-4318-b5fd-fcca8641f7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:25.808380 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-ae017baf-94be-4318-b5fd-fcca8641f7d6 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:25.809601 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ae017baf-94be-4318-b5fd-fcca8641f7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:25.839106 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:25.847374 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47602697-b0b0-4986-b3b8-a01bd6b827a3 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:25.878584 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 154/304] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:25.879207 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae017baf-94be-4318-b5fd-fcca8641f7d6 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:25.895461 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a521c5-e0bd-4188-bb02-36f8ff4db5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:25.896831 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a521c5-e0bd-4188-bb02-36f8ff4db5cb None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:25.897109 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a521c5-e0bd-4188-bb02-36f8ff4db5cb None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:25.897385 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a521c5-e0bd-4188-bb02-36f8ff4db5cb None admin] PATH_INFO: `/v3/groups` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:25.898052 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a521c5-e0bd-4188-bb02-36f8ff4db5cb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:25.899722 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a521c5-e0bd-4188-bb02-36f8ff4db5cb None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:25.917876 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 151/305] 10.222.0.52 () {60 vars in 1134 bytes} [Sun Aug 28 00:41:25 2022] POST /identity/v3/groups => generated 229 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:41:25.924765 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:26.008827 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae017baf-94be-4318-b5fd-fcca8641f7d6 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:26.047700 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bdda0-2bbd-41ca-bb89-e96bc0b8f86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:26.048365 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bdda0-2bbd-41ca-bb89-e96bc0b8f86d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:26.048721 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bdda0-2bbd-41ca-bb89-e96bc0b8f86d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:26.048997 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bdda0-2bbd-41ca-bb89-e96bc0b8f86d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:26.049808 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9bdda0-2bbd-41ca-bb89-e96bc0b8f86d None admin] RBAC: Adding query filter params (role.id=3e76264611ba49e6abbc019c0928e888, user.id=05616fedce2d4d18b5dbcc8188cb2970, scope.system=all) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:26.050152 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9bdda0-2bbd-41ca-bb89-e96bc0b8f86d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:26.051629 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9bdda0-2bbd-41ca-bb89-e96bc0b8f86d None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:26.058109 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 155/306] 10.222.0.52 () {56 vars in 1308 bytes} [Sun Aug 28 00:41:25 2022] GET /identity/v3/role_assignments?user.id=05616fedce2d4d18b5dbcc8188cb2970&scope.system=all&role.id=3e76264611ba49e6abbc019c0928e888 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:26.169258 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a521c5-e0bd-4188-bb02-36f8ff4db5cb None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:26.276093 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a521c5-e0bd-4188-bb02-36f8ff4db5cb None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:26.303483 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76b1bf-4701-492e-8179-980dc24a8715 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:26.303830 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76b1bf-4701-492e-8179-980dc24a8715 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:26.304062 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76b1bf-4701-492e-8179-980dc24a8715 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:26.305623 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 156/307] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:26.310703 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c97fc1-aeaf-43b3-b375-a6c3cd3ec813 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:26.310986 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c97fc1-aeaf-43b3-b375-a6c3cd3ec813 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:26.311258 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c97fc1-aeaf-43b3-b375-a6c3cd3ec813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:26.317188 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bed2a1-33c7-477d-b921-7080cc737b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:26.318131 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bed2a1-33c7-477d-b921-7080cc737b3d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:26.318627 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bed2a1-33c7-477d-b921-7080cc737b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:26.319095 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bed2a1-33c7-477d-b921-7080cc737b3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:26.330522 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bed2a1-33c7-477d-b921-7080cc737b3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:26.332579 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-82c97fc1-aeaf-43b3-b375-a6c3cd3ec813 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:26.333766 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-82c97fc1-aeaf-43b3-b375-a6c3cd3ec813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:26.336703 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-42bed2a1-33c7-477d-b921-7080cc737b3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:41:26.336703 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:26.336703 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:26.336703 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:26.336703 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:26.336703 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:26.336703 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:26.336703 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:26.336703 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:26.336703 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:26.336703 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:26.336703 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:26.336703 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:26.336703 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:26.336703 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:26.336703 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:26.337581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:26.337581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:26.337581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:26.337581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:26.337581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:26.337581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:26.337581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:26.337581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:26.337581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:26.337581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:26.337581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:26.337581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:26.337581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:26.337581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:26.337581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:26.337581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:26.338468 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:26.338468 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:26.338468 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:26.338468 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:26.338468 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:26.338468 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:26.338468 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:26.338468 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:26.338468 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:26.338468 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:26.338468 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:41:26.338468 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:26.340709 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 152/308] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:26.347066 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bed2a1-33c7-477d-b921-7080cc737b3d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:26.369239 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:26.409881 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 157/309] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:26.461904 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bed2a1-33c7-477d-b921-7080cc737b3d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:26.497214 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb802d-bf56-4c61-ba20-4b68b8707453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:26.497824 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb802d-bf56-4c61-ba20-4b68b8707453 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:26.498126 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb802d-bf56-4c61-ba20-4b68b8707453 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:26.498392 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb802d-bf56-4c61-ba20-4b68b8707453 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:26.499204 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb802d-bf56-4c61-ba20-4b68b8707453 None admin] RBAC: Adding query filter params (name=member) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:26.499677 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb802d-bf56-4c61-ba20-4b68b8707453 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:26.501094 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb802d-bf56-4c61-ba20-4b68b8707453 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:26.510027 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 153/310] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Aug 28 00:41:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:41:26.515963 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c97fc1-aeaf-43b3-b375-a6c3cd3ec813 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:26.545158 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:26.622477 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c97fc1-aeaf-43b3-b375-a6c3cd3ec813 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:26.658633 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1221466-8efc-4c49-a525-a445f7de1f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:26.659520 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1221466-8efc-4c49-a525-a445f7de1f47 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:26.659945 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1221466-8efc-4c49-a525-a445f7de1f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:26.660360 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1221466-8efc-4c49-a525-a445f7de1f47 None admin] PATH_INFO: `/v3/users/c6a4d077df474200ab0fd0de783b02d2` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:26.661676 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1221466-8efc-4c49-a525-a445f7de1f47 None admin] RBAC: Authorizing `identity:get_user(user_id=c6a4d077df474200ab0fd0de783b02d2)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:26.663296 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1221466-8efc-4c49-a525-a445f7de1f47 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:26.665319 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 158/311] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:41:26 2022] GET /identity/v3/users/c6a4d077df474200ab0fd0de783b02d2 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:26.671146 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb802d-bf56-4c61-ba20-4b68b8707453 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:26.680924 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1221466-8efc-4c49-a525-a445f7de1f47 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:26.761368 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:26.785328 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb802d-bf56-4c61-ba20-4b68b8707453 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:26.792016 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:26.799537 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1221466-8efc-4c49-a525-a445f7de1f47 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:26.819329 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6f403-0647-401b-a7e0-0f408856b738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:26.819985 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6f403-0647-401b-a7e0-0f408856b738 None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:26.820260 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6f403-0647-401b-a7e0-0f408856b738 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:26.820533 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6f403-0647-401b-a7e0-0f408856b738 None admin] PATH_INFO: `/v3/system/users/c6a4d077df474200ab0fd0de783b02d2/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:26.821951 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6f403-0647-401b-a7e0-0f408856b738 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c6a4d077df474200ab0fd0de783b02d2, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:26.823351 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6f403-0647-401b-a7e0-0f408856b738 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:26.841879 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 154/312] 10.222.0.52 () {58 vars in 1334 bytes} [Sun Aug 28 00:41:26 2022] PUT /identity/v3/system/users/c6a4d077df474200ab0fd0de783b02d2/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:41:26.842107 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d4cdf-672a-4add-b6b4-643bd137b44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:26.842398 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d4cdf-672a-4add-b6b4-643bd137b44d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:26.842616 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d4cdf-672a-4add-b6b4-643bd137b44d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:26.842954 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d4cdf-672a-4add-b6b4-643bd137b44d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:26.856247 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d4cdf-672a-4add-b6b4-643bd137b44d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:26.862045 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-9b6d4cdf-672a-4add-b6b4-643bd137b44d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:41:26.862045 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:26.862045 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:26.862045 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:26.862045 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:26.862045 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:26.862045 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:26.862045 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:26.862045 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:26.862045 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:26.862045 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:26.862045 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:26.862045 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:26.862045 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:26.862045 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:26.862045 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:26.863061 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:26.863061 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:26.863061 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:26.863061 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:26.863061 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:26.863061 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:26.863061 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:26.863061 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:26.863061 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:26.863061 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:26.863061 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:26.863061 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:26.863061 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:26.863061 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:26.863061 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:26.863061 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:26.863858 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:26.863858 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:26.863858 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:26.863858 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:26.863858 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:26.863858 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:26.863858 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:26.863858 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:26.863858 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:26.863858 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:26.863858 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:41:26.863858 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:26.863858 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 159/313] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:41:26.869274 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6f403-0647-401b-a7e0-0f408856b738 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:26.980423 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6f403-0647-401b-a7e0-0f408856b738 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:27.018096 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2bb9e-6fd3-4b3f-839c-6769e80ec5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:27.018445 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2bb9e-6fd3-4b3f-839c-6769e80ec5ba None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:27.018625 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2bb9e-6fd3-4b3f-839c-6769e80ec5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:27.018903 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2bb9e-6fd3-4b3f-839c-6769e80ec5ba None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:27.019610 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2bb9e-6fd3-4b3f-839c-6769e80ec5ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:27.019914 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2bb9e-6fd3-4b3f-839c-6769e80ec5ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:27.021320 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2bb9e-6fd3-4b3f-839c-6769e80ec5ba None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:27.030582 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 155/314] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Aug 28 00:41:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:27.035825 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d4cdf-672a-4add-b6b4-643bd137b44d None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:27.150342 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d4cdf-672a-4add-b6b4-643bd137b44d None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:27.185119 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb34651-6f09-45dc-bb7a-bc38abd9f111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:27.185750 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb34651-6f09-45dc-bb7a-bc38abd9f111 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:27.186049 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb34651-6f09-45dc-bb7a-bc38abd9f111 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:27.186413 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb34651-6f09-45dc-bb7a-bc38abd9f111 None admin] PATH_INFO: `/v3/users/8d9f95b18c714d1da8f479e5d5b9862f` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:27.187586 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb34651-6f09-45dc-bb7a-bc38abd9f111 None admin] RBAC: Authorizing `identity:get_user(user_id=8d9f95b18c714d1da8f479e5d5b9862f)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:27.189037 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb34651-6f09-45dc-bb7a-bc38abd9f111 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:27.190964 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 160/315] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:41:27 2022] GET /identity/v3/users/8d9f95b18c714d1da8f479e5d5b9862f => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:41:27.196787 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2bb9e-6fd3-4b3f-839c-6769e80ec5ba None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:27.202419 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:27.300622 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2bb9e-6fd3-4b3f-839c-6769e80ec5ba None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:27.334173 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46c717-8782-48ba-91b6-f37f205832ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:27.334785 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46c717-8782-48ba-91b6-f37f205832ce None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:27.335057 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46c717-8782-48ba-91b6-f37f205832ce None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:27.335322 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46c717-8782-48ba-91b6-f37f205832ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:27.404405 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46c717-8782-48ba-91b6-f37f205832ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:27.405990 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46c717-8782-48ba-91b6-f37f205832ce None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:27.409453 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:27.513484 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 156/316] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:41:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:41:27.518855 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb34651-6f09-45dc-bb7a-bc38abd9f111 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:27.546524 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:27.627661 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb34651-6f09-45dc-bb7a-bc38abd9f111 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:27.662809 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9856bf-7be3-41f4-865b-87ebfcfc557a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:27.663678 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9856bf-7be3-41f4-865b-87ebfcfc557a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:27.664091 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9856bf-7be3-41f4-865b-87ebfcfc557a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:27.664495 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9856bf-7be3-41f4-865b-87ebfcfc557a None admin] PATH_INFO: `/v3/projects/ad187f94c1d9456e9c97f78a7f686485` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:27.665745 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9856bf-7be3-41f4-865b-87ebfcfc557a None admin] RBAC: Authorizing `identity:get_project(project_id=ad187f94c1d9456e9c97f78a7f686485)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:27.667341 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9856bf-7be3-41f4-865b-87ebfcfc557a None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:27.669447 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 161/317] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:27 2022] GET /identity/v3/projects/ad187f94c1d9456e9c97f78a7f686485 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:27.676259 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46c717-8782-48ba-91b6-f37f205832ce None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:27.779520 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46c717-8782-48ba-91b6-f37f205832ce None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:27.782048 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:27.815909 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff935739-d08b-401a-aac7-672fc705b547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:27.816514 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff935739-d08b-401a-aac7-672fc705b547 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:27.816793 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff935739-d08b-401a-aac7-672fc705b547 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:27.817060 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff935739-d08b-401a-aac7-672fc705b547 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:27.817787 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff935739-d08b-401a-aac7-672fc705b547 None admin] RBAC: Adding query filter params (role.id=3e76264611ba49e6abbc019c0928e888, scope.project.id=ad187f94c1d9456e9c97f78a7f686485, user.id=8d9f95b18c714d1da8f479e5d5b9862f) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:27.818125 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff935739-d08b-401a-aac7-672fc705b547 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:27.819561 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff935739-d08b-401a-aac7-672fc705b547 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:27.826100 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 157/318] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:41:27 2022] GET /identity/v3/role_assignments?user.id=8d9f95b18c714d1da8f479e5d5b9862f&scope.project.id=ad187f94c1d9456e9c97f78a7f686485&role.id=3e76264611ba49e6abbc019c0928e888 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:27.934240 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeaaa26-157d-4ba9-9251-8c4d041f7985 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:27.934431 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeaaa26-157d-4ba9-9251-8c4d041f7985 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:27.934831 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeaaa26-157d-4ba9-9251-8c4d041f7985 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:27.936619 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 162/319] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:27.942558 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018937fe-e05c-45a3-904b-8a3e23619345 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:27.942844 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018937fe-e05c-45a3-904b-8a3e23619345 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:27.943098 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018937fe-e05c-45a3-904b-8a3e23619345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:27.962725 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-018937fe-e05c-45a3-904b-8a3e23619345 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:27.963953 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-018937fe-e05c-45a3-904b-8a3e23619345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:28.039516 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efee89f-bc39-42e9-8015-b73b6ae9adc6 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:28.040016 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efee89f-bc39-42e9-8015-b73b6ae9adc6 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:28.040131 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 158/320] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:28.040470 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efee89f-bc39-42e9-8015-b73b6ae9adc6 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:28.041441 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 163/321] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:41:28.047691 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f04810-f528-4410-b9e9-7fb58a1c8171 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:28.047973 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f04810-f528-4410-b9e9-7fb58a1c8171 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:28.048244 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f04810-f528-4410-b9e9-7fb58a1c8171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:28.068018 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f5f04810-f528-4410-b9e9-7fb58a1c8171 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:28.069554 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f5f04810-f528-4410-b9e9-7fb58a1c8171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:28.139661 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 159/322] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:28.312564 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efee89f-bc39-42e9-8015-b73b6ae9adc6 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:28.406576 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:28.407248 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f04810-f528-4410-b9e9-7fb58a1c8171 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:28.417800 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efee89f-bc39-42e9-8015-b73b6ae9adc6 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:28.435098 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:28.455616 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21fb9e-bd87-4f55-9300-0ab98a344ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:28.456252 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21fb9e-bd87-4f55-9300-0ab98a344ddb None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:28.456526 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21fb9e-bd87-4f55-9300-0ab98a344ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:28.456792 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21fb9e-bd87-4f55-9300-0ab98a344ddb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:28.457920 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d21fb9e-bd87-4f55-9300-0ab98a344ddb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:28.459388 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d21fb9e-bd87-4f55-9300-0ab98a344ddb None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:28.460974 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 164/323] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:41:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:28.466332 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21fb9e-bd87-4f55-9300-0ab98a344ddb None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:28.513966 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f04810-f528-4410-b9e9-7fb58a1c8171 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:28.557114 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08d06e-9cb7-402a-85e6-3a9814555afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:28.557743 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08d06e-9cb7-402a-85e6-3a9814555afd None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:28.558123 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08d06e-9cb7-402a-85e6-3a9814555afd None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:28.558391 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08d06e-9cb7-402a-85e6-3a9814555afd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:28.568699 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08d06e-9cb7-402a-85e6-3a9814555afd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:28.573689 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-ee08d06e-9cb7-402a-85e6-3a9814555afd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:41:28.573689 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:28.573689 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:28.573689 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:28.573689 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:28.573689 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:28.573689 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:28.573689 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:28.573689 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:28.573689 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:28.573689 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:28.573689 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:28.573689 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:28.573689 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:28.573689 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:28.573689 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:28.574791 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:28.574791 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:28.574791 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:28.574791 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:28.574791 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:28.574791 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:28.574791 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:28.574791 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:28.574791 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:28.574791 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:28.574791 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:28.574791 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:28.574791 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:28.574791 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:28.574791 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:28.574791 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:28.575711 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:28.575711 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:28.575711 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:28.575711 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:28.575711 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:28.575711 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:28.575711 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:28.575711 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:28.575711 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:28.575711 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:28.575711 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:41:28.575711 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:28.575711 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 160/324] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:41:28.580395 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21fb9e-bd87-4f55-9300-0ab98a344ddb None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:28.580697 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08d06e-9cb7-402a-85e6-3a9814555afd None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:28.618955 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5a033-9bd9-4e0a-96db-dcbbfee97994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:28.619589 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5a033-9bd9-4e0a-96db-dcbbfee97994 None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:28.619877 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5a033-9bd9-4e0a-96db-dcbbfee97994 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:28.620146 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5a033-9bd9-4e0a-96db-dcbbfee97994 None admin] PATH_INFO: `/v3/groups` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:28.620780 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5a033-9bd9-4e0a-96db-dcbbfee97994 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:28.622254 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5a033-9bd9-4e0a-96db-dcbbfee97994 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:28.641896 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 165/325] 10.222.0.52 () {60 vars in 1134 bytes} [Sun Aug 28 00:41:28 2022] POST /identity/v3/groups => generated 226 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:41:28.679697 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:28.694211 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08d06e-9cb7-402a-85e6-3a9814555afd None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:28.731846 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665ec84-e1d3-4495-8990-9dd7c81b9e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:28.732461 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665ec84-e1d3-4495-8990-9dd7c81b9e66 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:28.732702 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665ec84-e1d3-4495-8990-9dd7c81b9e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:28.733013 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665ec84-e1d3-4495-8990-9dd7c81b9e66 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:28.734101 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665ec84-e1d3-4495-8990-9dd7c81b9e66 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:28.734411 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665ec84-e1d3-4495-8990-9dd7c81b9e66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:28.735840 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665ec84-e1d3-4495-8990-9dd7c81b9e66 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:28.745263 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 161/326] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Aug 28 00:41:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:41:28.751407 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5a033-9bd9-4e0a-96db-dcbbfee97994 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:28.775257 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:28.863967 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5a033-9bd9-4e0a-96db-dcbbfee97994 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:28.902231 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91bec1-511d-4aa0-ad57-4791f442a58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:28.902870 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91bec1-511d-4aa0-ad57-4791f442a58d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:28.903138 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91bec1-511d-4aa0-ad57-4791f442a58d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:28.903405 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91bec1-511d-4aa0-ad57-4791f442a58d None admin] PATH_INFO: `/v3/users/05616fedce2d4d18b5dbcc8188cb2970` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:28.904525 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91bec1-511d-4aa0-ad57-4791f442a58d None admin] RBAC: Authorizing `identity:get_user(user_id=05616fedce2d4d18b5dbcc8188cb2970)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:28.906071 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91bec1-511d-4aa0-ad57-4791f442a58d None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:28.907841 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 166/327] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:41:28 2022] GET /identity/v3/users/05616fedce2d4d18b5dbcc8188cb2970 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:28.913492 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665ec84-e1d3-4495-8990-9dd7c81b9e66 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:28.922081 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d07d7f-8eb8-4ced-8ce9-a3d3b89a750a None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:28.922366 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d07d7f-8eb8-4ced-8ce9-a3d3b89a750a None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:28.922643 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d07d7f-8eb8-4ced-8ce9-a3d3b89a750a None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:28.924582 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 167/328] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:28.931431 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4618012-181d-4ba4-8468-3634dc612446 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:28.931863 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4618012-181d-4ba4-8468-3634dc612446 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:28.932140 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4618012-181d-4ba4-8468-3634dc612446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:28.955264 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-b4618012-181d-4ba4-8468-3634dc612446 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:28.956637 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b4618012-181d-4ba4-8468-3634dc612446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:29.039194 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 168/329] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:29.039735 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665ec84-e1d3-4495-8990-9dd7c81b9e66 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:29.078117 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6036c-bba1-4a7f-9466-82225f49b9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:29.079559 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6036c-bba1-4a7f-9466-82225f49b9bc None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:29.079838 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6036c-bba1-4a7f-9466-82225f49b9bc None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:29.080109 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6036c-bba1-4a7f-9466-82225f49b9bc None admin] PATH_INFO: `/v3/system/users/05616fedce2d4d18b5dbcc8188cb2970/roles/3e76264611ba49e6abbc019c0928e888` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:29.082494 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6036c-bba1-4a7f-9466-82225f49b9bc None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=05616fedce2d4d18b5dbcc8188cb2970, role_id=3e76264611ba49e6abbc019c0928e888)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:29.083875 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6036c-bba1-4a7f-9466-82225f49b9bc None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:29.095023 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 162/330] 10.222.0.52 () {58 vars in 1334 bytes} [Sun Aug 28 00:41:28 2022] PUT /identity/v3/system/users/05616fedce2d4d18b5dbcc8188cb2970/roles/3e76264611ba49e6abbc019c0928e888 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:41:29.315496 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4618012-181d-4ba4-8468-3634dc612446 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:29.335647 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:29.421735 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4618012-181d-4ba4-8468-3634dc612446 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:29.457498 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a265fa4-2aa6-4702-b051-dadfa0d6c251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:29.458410 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a265fa4-2aa6-4702-b051-dadfa0d6c251 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:29.458828 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a265fa4-2aa6-4702-b051-dadfa0d6c251 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:29.459239 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a265fa4-2aa6-4702-b051-dadfa0d6c251 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:29.470520 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a265fa4-2aa6-4702-b051-dadfa0d6c251 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:29.475684 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-0a265fa4-2aa6-4702-b051-dadfa0d6c251 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:41:29.475684 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:29.475684 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:29.475684 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:29.475684 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:29.475684 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:29.475684 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:29.475684 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:29.475684 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:29.475684 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:29.475684 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:29.475684 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:29.475684 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:29.475684 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:29.475684 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:29.475684 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:29.476769 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:29.476769 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:29.476769 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:29.476769 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:29.476769 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:29.476769 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:29.476769 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:29.476769 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:29.476769 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:29.476769 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:29.476769 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:29.476769 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:29.476769 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:29.476769 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:29.476769 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:29.476769 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:29.477762 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:29.477762 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:29.477762 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:29.477762 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:29.477762 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:29.477762 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:29.477762 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:29.477762 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:29.477762 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:29.477762 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:29.477762 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:41:29.477762 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:29.479727 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 169/331] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:29.486085 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6036c-bba1-4a7f-9466-82225f49b9bc None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:29.503818 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:29.627505 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6036c-bba1-4a7f-9466-82225f49b9bc None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:29.663660 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1d84e-8e7d-4e89-b769-caffa1fe971f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:29.664276 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1d84e-8e7d-4e89-b769-caffa1fe971f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:29.664556 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1d84e-8e7d-4e89-b769-caffa1fe971f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:29.664827 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1d84e-8e7d-4e89-b769-caffa1fe971f None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:29.665627 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1d84e-8e7d-4e89-b769-caffa1fe971f None admin] RBAC: Adding query filter params (name=member) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:29.665965 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1d84e-8e7d-4e89-b769-caffa1fe971f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:29.667427 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1d84e-8e7d-4e89-b769-caffa1fe971f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:29.676570 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 163/332] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Aug 28 00:41:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:29.682231 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a265fa4-2aa6-4702-b051-dadfa0d6c251 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:29.788866 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:29.816427 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a265fa4-2aa6-4702-b051-dadfa0d6c251 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:29.860086 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361ae45-9ed1-4a80-ad70-c53c521c60a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:29.860780 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361ae45-9ed1-4a80-ad70-c53c521c60a6 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:29.861065 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361ae45-9ed1-4a80-ad70-c53c521c60a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:29.861342 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361ae45-9ed1-4a80-ad70-c53c521c60a6 None admin] PATH_INFO: `/v3/users/c6a4d077df474200ab0fd0de783b02d2` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:29.862515 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361ae45-9ed1-4a80-ad70-c53c521c60a6 None admin] RBAC: Authorizing `identity:get_user(user_id=c6a4d077df474200ab0fd0de783b02d2)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:29.863992 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361ae45-9ed1-4a80-ad70-c53c521c60a6 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:29.866049 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 170/333] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:41:29 2022] GET /identity/v3/users/c6a4d077df474200ab0fd0de783b02d2 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:29.871975 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1d84e-8e7d-4e89-b769-caffa1fe971f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:29.976043 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:30.005863 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1d84e-8e7d-4e89-b769-caffa1fe971f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:30.042104 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d1534-30e8-435e-97f0-34eb62c5e26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:30.042718 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d1534-30e8-435e-97f0-34eb62c5e26e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:30.042994 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d1534-30e8-435e-97f0-34eb62c5e26e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:30.043279 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d1534-30e8-435e-97f0-34eb62c5e26e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:30.044224 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d1534-30e8-435e-97f0-34eb62c5e26e None admin] RBAC: Adding query filter params (role.id=2231e998e50146f4b53b832f2f88c1c8, user.id=c6a4d077df474200ab0fd0de783b02d2, scope.system=all) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:30.044543 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d1534-30e8-435e-97f0-34eb62c5e26e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:30.046159 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d1534-30e8-435e-97f0-34eb62c5e26e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:30.059333 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 164/334] 10.222.0.52 () {56 vars in 1308 bytes} [Sun Aug 28 00:41:29 2022] GET /identity/v3/role_assignments?user.id=c6a4d077df474200ab0fd0de783b02d2&scope.system=all&role.id=2231e998e50146f4b53b832f2f88c1c8 => generated 510 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:30.909407 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99300a24-1381-4a4f-9b69-5aea3e1bdf1e None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:30.909975 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99300a24-1381-4a4f-9b69-5aea3e1bdf1e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:30.909975 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99300a24-1381-4a4f-9b69-5aea3e1bdf1e None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:30.911698 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 171/335] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:30.917222 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2090ab3-4f97-4d98-ab35-a015b1cb6abc None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:30.917730 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2090ab3-4f97-4d98-ab35-a015b1cb6abc None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:30.917806 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2090ab3-4f97-4d98-ab35-a015b1cb6abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:30.941007 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b2090ab3-4f97-4d98-ab35-a015b1cb6abc None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:30.942276 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b2090ab3-4f97-4d98-ab35-a015b1cb6abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:31.023425 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 165/336] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:31.179469 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd15eb-c2d3-4411-a2a4-5d9a3e838ec9 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:31.179764 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd15eb-c2d3-4411-a2a4-5d9a3e838ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:31.179924 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd15eb-c2d3-4411-a2a4-5d9a3e838ec9 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:31.181295 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 172/337] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:31.186800 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fa094-16f3-4a09-9b73-abb8902978b8 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:31.187089 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fa094-16f3-4a09-9b73-abb8902978b8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:31.187366 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fa094-16f3-4a09-9b73-abb8902978b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:31.207404 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-395fa094-16f3-4a09-9b73-abb8902978b8 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:31.208592 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-395fa094-16f3-4a09-9b73-abb8902978b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:31.279713 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:31.289123 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 166/338] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:31.349108 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd15eb-c2d3-4411-a2a4-5d9a3e838ec9 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:31.464922 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd15eb-c2d3-4411-a2a4-5d9a3e838ec9 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:31.500631 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acf633-830c-4a3f-bd0c-e43166ea3854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:31.501275 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acf633-830c-4a3f-bd0c-e43166ea3854 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:31.501579 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acf633-830c-4a3f-bd0c-e43166ea3854 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:31.501867 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acf633-830c-4a3f-bd0c-e43166ea3854 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:31.512536 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9acf633-830c-4a3f-bd0c-e43166ea3854 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:31.517832 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-e9acf633-830c-4a3f-bd0c-e43166ea3854 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:41:31.517832 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:31.517832 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:31.517832 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:31.517832 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:31.517832 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:31.517832 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:31.517832 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:31.517832 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:31.517832 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:31.517832 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:31.517832 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:31.517832 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:31.517832 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:31.517832 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:31.517832 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:31.518775 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:31.518775 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:31.518775 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:31.518775 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:31.518775 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:31.518775 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:31.518775 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:31.518775 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:31.518775 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:31.518775 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:31.518775 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:31.518775 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:31.518775 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:31.518775 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:31.518775 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:31.518775 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:31.519586 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:31.519586 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:31.519586 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:31.519586 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:31.519586 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:31.519586 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:31.519586 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:31.519586 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:31.519586 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:31.519586 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:31.519586 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:41:31.519586 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:31.519586 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 173/339] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:31.524953 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395fa094-16f3-4a09-9b73-abb8902978b8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:31.664531 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395fa094-16f3-4a09-9b73-abb8902978b8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:31.706286 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac6415-49ff-402a-8a5c-9b41363ded8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:31.706891 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac6415-49ff-402a-8a5c-9b41363ded8b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:31.707166 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac6415-49ff-402a-8a5c-9b41363ded8b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:31.707427 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac6415-49ff-402a-8a5c-9b41363ded8b None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:31.708078 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac6415-49ff-402a-8a5c-9b41363ded8b None admin] RBAC: Adding query filter params (name=member) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:31.708376 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac6415-49ff-402a-8a5c-9b41363ded8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:31.709771 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac6415-49ff-402a-8a5c-9b41363ded8b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:31.721914 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 167/340] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Aug 28 00:41:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:31.727957 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acf633-830c-4a3f-bd0c-e43166ea3854 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:31.744125 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:31.799364 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac6415-49ff-402a-8a5c-9b41363ded8b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:31.879300 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:31.886751 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acf633-830c-4a3f-bd0c-e43166ea3854 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:31.939712 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac6415-49ff-402a-8a5c-9b41363ded8b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:31.941984 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453589fb-1c5d-4ba1-b551-8df72e1b1239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:31.942608 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453589fb-1c5d-4ba1-b551-8df72e1b1239 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:31.942980 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453589fb-1c5d-4ba1-b551-8df72e1b1239 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:31.943250 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453589fb-1c5d-4ba1-b551-8df72e1b1239 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:32.004601 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df547c6-d7a0-4674-b08b-7283703e0f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:32.005169 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df547c6-d7a0-4674-b08b-7283703e0f6c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:32.005597 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df547c6-d7a0-4674-b08b-7283703e0f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:32.005888 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df547c6-d7a0-4674-b08b-7283703e0f6c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:32.030972 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df547c6-d7a0-4674-b08b-7283703e0f6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:32.037746 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-0df547c6-d7a0-4674-b08b-7283703e0f6c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:41:32.037746 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:32.037746 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:32.037746 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:32.037746 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:32.037746 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:32.037746 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:32.037746 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:32.037746 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:32.037746 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:32.037746 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:32.037746 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:32.037746 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:32.037746 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:32.037746 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:32.037746 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:32.038660 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:32.038660 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:32.038660 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:32.038660 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:32.038660 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:32.038660 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:32.038660 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:32.038660 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:32.038660 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:32.038660 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:32.038660 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:32.038660 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:32.038660 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:32.038660 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:32.038660 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:32.038660 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:32.039439 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:32.039439 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:32.039439 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:32.039439 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:32.039439 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:32.039439 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:32.039439 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:32.039439 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:32.039439 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:32.039439 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:32.039439 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:41:32.039439 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:32.039439 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 168/341] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Aug 28 00:41:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:41:32.046778 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df547c6-d7a0-4674-b08b-7283703e0f6c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:32.070463 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453589fb-1c5d-4ba1-b551-8df72e1b1239 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:32.072180 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453589fb-1c5d-4ba1-b551-8df72e1b1239 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:32.081664 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:32.188772 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 174/342] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:41:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:41:32.190543 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490ff9b-9196-420b-bfb0-746e0d36135b None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:32.190964 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490ff9b-9196-420b-bfb0-746e0d36135b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:32.191395 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490ff9b-9196-420b-bfb0-746e0d36135b None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:32.192930 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 175/343] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:32.195719 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490ff9b-9196-420b-bfb0-746e0d36135b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:32.257144 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df547c6-d7a0-4674-b08b-7283703e0f6c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:32.276841 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:32.298160 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60dcef5-e1af-4549-a154-4641c5789522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:32.299031 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dcef5-e1af-4549-a154-4641c5789522 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:32.299444 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dcef5-e1af-4549-a154-4641c5789522 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:32.299847 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dcef5-e1af-4549-a154-4641c5789522 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:32.300643 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60dcef5-e1af-4549-a154-4641c5789522 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:32.301079 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60dcef5-e1af-4549-a154-4641c5789522 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:32.302752 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60dcef5-e1af-4549-a154-4641c5789522 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:32.312534 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 169/344] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:41:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:41:32.318379 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a85b1-1770-4600-90a4-ed10753d3e2c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:32.318379 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a85b1-1770-4600-90a4-ed10753d3e2c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:32.318558 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a85b1-1770-4600-90a4-ed10753d3e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:32.334436 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490ff9b-9196-420b-bfb0-746e0d36135b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:32.339323 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-8b6a85b1-1770-4600-90a4-ed10753d3e2c None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:32.340661 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8b6a85b1-1770-4600-90a4-ed10753d3e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:32.342847 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:32.377432 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8f196-f879-40ac-9ac7-bca7b82c0560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:32.377877 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8f196-f879-40ac-9ac7-bca7b82c0560 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:32.378146 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8f196-f879-40ac-9ac7-bca7b82c0560 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:32.378411 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8f196-f879-40ac-9ac7-bca7b82c0560 None admin] PATH_INFO: `/v3/projects/93e707bfff714b1c80277c83a2ed2c93` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:32.379540 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f8f196-f879-40ac-9ac7-bca7b82c0560 None admin] RBAC: Authorizing `identity:get_project(project_id=93e707bfff714b1c80277c83a2ed2c93)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:32.380978 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f8f196-f879-40ac-9ac7-bca7b82c0560 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:32.385873 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 176/345] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:32 2022] GET /identity/v3/projects/93e707bfff714b1c80277c83a2ed2c93 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:32.385873 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4df4fb-c492-4c8d-85c1-87e90b029283 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:32.385873 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4df4fb-c492-4c8d-85c1-87e90b029283 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:32.385873 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4df4fb-c492-4c8d-85c1-87e90b029283 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:32.386356 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 177/346] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:32.386676 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4df4fb-c492-4c8d-85c1-87e90b029283 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:32.427453 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 170/347] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:32.429097 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac63e9-5a0a-429e-b2fb-9b2f3d0fe388 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:32.429610 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac63e9-5a0a-429e-b2fb-9b2f3d0fe388 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:32.430126 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac63e9-5a0a-429e-b2fb-9b2f3d0fe388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:32.455188 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-4dac63e9-5a0a-429e-b2fb-9b2f3d0fe388 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:32.456685 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4dac63e9-5a0a-429e-b2fb-9b2f3d0fe388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:32.503667 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4df4fb-c492-4c8d-85c1-87e90b029283 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:32.570510 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9652b9-b7b5-4ccb-83fd-1d1ce3ef696d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:32.571120 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9652b9-b7b5-4ccb-83fd-1d1ce3ef696d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:32.571396 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9652b9-b7b5-4ccb-83fd-1d1ce3ef696d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:32.571662 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9652b9-b7b5-4ccb-83fd-1d1ce3ef696d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:32.585926 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 171/348] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:32.586804 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac63e9-5a0a-429e-b2fb-9b2f3d0fe388 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:32.662191 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:32.670319 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:32.710038 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9652b9-b7b5-4ccb-83fd-1d1ce3ef696d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:32.711511 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9652b9-b7b5-4ccb-83fd-1d1ce3ef696d None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:32.806573 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac63e9-5a0a-429e-b2fb-9b2f3d0fe388 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:32.851345 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 178/349] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:41:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:41:32.870230 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ace28d-247b-401a-b02d-e8c911153eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:32.870856 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ace28d-247b-401a-b02d-e8c911153eba None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:32.871127 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ace28d-247b-401a-b02d-e8c911153eba None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:32.871393 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ace28d-247b-401a-b02d-e8c911153eba None admin] PATH_INFO: `/v3/groups/b5a1d67be7bf41008790f84c11b698d9` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:32.874287 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9652b9-b7b5-4ccb-83fd-1d1ce3ef696d None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:32.893206 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ace28d-247b-401a-b02d-e8c911153eba None admin] RBAC: Authorizing `identity:get_group(group_id=b5a1d67be7bf41008790f84c11b698d9)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:32.894711 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ace28d-247b-401a-b02d-e8c911153eba None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:32.896379 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 172/350] 10.222.0.52 () {56 vars in 1180 bytes} [Sun Aug 28 00:41:32 2022] GET /identity/v3/groups/b5a1d67be7bf41008790f84c11b698d9 => generated 226 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:32.902382 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ace28d-247b-401a-b02d-e8c911153eba None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:32.986225 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:33.012984 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9652b9-b7b5-4ccb-83fd-1d1ce3ef696d None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:33.053639 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0171ff-51c8-4eec-82b8-1dde45c694a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:33.054312 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0171ff-51c8-4eec-82b8-1dde45c694a8 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:33.054593 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0171ff-51c8-4eec-82b8-1dde45c694a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:33.054862 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0171ff-51c8-4eec-82b8-1dde45c694a8 None admin] PATH_INFO: `/v3/projects/93e707bfff714b1c80277c83a2ed2c93` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:33.056030 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0171ff-51c8-4eec-82b8-1dde45c694a8 None admin] RBAC: Authorizing `identity:get_project(project_id=93e707bfff714b1c80277c83a2ed2c93)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:33.057529 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0171ff-51c8-4eec-82b8-1dde45c694a8 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:33.059518 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 179/351] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:32 2022] GET /identity/v3/projects/93e707bfff714b1c80277c83a2ed2c93 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:41:33.060298 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0171ff-51c8-4eec-82b8-1dde45c694a8 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:33.080018 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ace28d-247b-401a-b02d-e8c911153eba None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:33.081618 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:33.124661 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49526037-fc9a-4d3d-a991-9acd3a9f8252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:33.125683 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49526037-fc9a-4d3d-a991-9acd3a9f8252 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:33.125997 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49526037-fc9a-4d3d-a991-9acd3a9f8252 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:33.126526 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49526037-fc9a-4d3d-a991-9acd3a9f8252 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:33.127266 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49526037-fc9a-4d3d-a991-9acd3a9f8252 None admin] RBAC: Adding query filter params (group.id=b5a1d67be7bf41008790f84c11b698d9, role.id=2231e998e50146f4b53b832f2f88c1c8, scope.project.id=93e707bfff714b1c80277c83a2ed2c93) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:33.127572 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49526037-fc9a-4d3d-a991-9acd3a9f8252 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:33.129451 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49526037-fc9a-4d3d-a991-9acd3a9f8252 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:33.137675 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 173/352] 10.222.0.52 () {56 vars in 1376 bytes} [Sun Aug 28 00:41:32 2022] GET /identity/v3/role_assignments?group.id=b5a1d67be7bf41008790f84c11b698d9&scope.project.id=93e707bfff714b1c80277c83a2ed2c93&role.id=2231e998e50146f4b53b832f2f88c1c8 => generated 260 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:33.139062 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49526037-fc9a-4d3d-a991-9acd3a9f8252 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:33.173157 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0171ff-51c8-4eec-82b8-1dde45c694a8 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:33.213747 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e77e07-1e12-4046-b97b-239707470c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:33.214440 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e77e07-1e12-4046-b97b-239707470c54 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:33.214722 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e77e07-1e12-4046-b97b-239707470c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:33.214997 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e77e07-1e12-4046-b97b-239707470c54 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:33.228389 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e77e07-1e12-4046-b97b-239707470c54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:33.236824 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-78e77e07-1e12-4046-b97b-239707470c54 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:41:33.236824 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:33.236824 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:33.236824 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:33.236824 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:33.236824 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:33.236824 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:33.236824 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:33.236824 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:33.236824 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:33.236824 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:33.236824 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:33.236824 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:33.236824 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:33.236824 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:33.236824 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:33.237828 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:33.237828 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:33.237828 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:33.237828 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:33.237828 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:33.237828 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:33.237828 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:33.237828 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:33.237828 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:33.237828 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:33.237828 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:33.237828 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:33.237828 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:33.237828 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:33.237828 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:33.237828 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:33.238691 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:33.238691 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:33.238691 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:33.238691 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:33.238691 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:33.238691 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:33.238691 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:33.238691 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:33.238691 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:33.238691 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:33.238691 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:41:33.238691 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:33.238691 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 180/353] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:33.239365 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e77e07-1e12-4046-b97b-239707470c54 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:33.242943 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:33.295771 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49526037-fc9a-4d3d-a991-9acd3a9f8252 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:33.341554 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0fe00-2f3f-4ab2-8880-1d100681c075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:33.342196 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0fe00-2f3f-4ab2-8880-1d100681c075 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:33.342502 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0fe00-2f3f-4ab2-8880-1d100681c075 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:33.342885 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0fe00-2f3f-4ab2-8880-1d100681c075 None admin] PATH_INFO: `/v3/groups/b5a1d67be7bf41008790f84c11b698d9` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:33.345248 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0fe00-2f3f-4ab2-8880-1d100681c075 None admin] RBAC: Authorizing `identity:get_group(group_id=b5a1d67be7bf41008790f84c11b698d9)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:33.346889 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0fe00-2f3f-4ab2-8880-1d100681c075 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:33.348692 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 174/354] 10.222.0.52 () {56 vars in 1180 bytes} [Sun Aug 28 00:41:33 2022] GET /identity/v3/groups/b5a1d67be7bf41008790f84c11b698d9 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:33.349861 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015722d-d4cd-42a0-8f6e-5072d488ff3a None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:33.350140 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015722d-d4cd-42a0-8f6e-5072d488ff3a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:33.350412 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015722d-d4cd-42a0-8f6e-5072d488ff3a None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:33.351843 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 175/355] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:33.352405 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015722d-d4cd-42a0-8f6e-5072d488ff3a None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:33.363814 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e77e07-1e12-4046-b97b-239707470c54 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:33.399205 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:33.409666 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c98b2-d0ca-4e7a-98ca-d961aa38a12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:33.410363 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c98b2-d0ca-4e7a-98ca-d961aa38a12a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:33.410637 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c98b2-d0ca-4e7a-98ca-d961aa38a12a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:33.410900 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c98b2-d0ca-4e7a-98ca-d961aa38a12a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:33.423382 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c98b2-d0ca-4e7a-98ca-d961aa38a12a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:33.428263 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-899c98b2-d0ca-4e7a-98ca-d961aa38a12a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:41:33.428263 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:33.428263 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:33.428263 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:33.428263 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:33.428263 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:33.428263 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:33.428263 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:33.428263 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:33.428263 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:33.428263 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:33.428263 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:33.428263 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:33.428263 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:33.428263 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:33.428263 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:33.429341 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:33.429341 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:33.429341 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:33.429341 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:33.429341 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:33.429341 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:33.429341 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:33.429341 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:33.429341 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:33.429341 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:33.429341 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:33.429341 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:33.429341 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:33.429341 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:33.429341 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:33.429341 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:33.430310 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:33.430310 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:33.430310 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:33.430310 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:33.430310 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:33.430310 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:33.430310 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:33.430310 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:33.430310 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:33.430310 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:33.430310 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:41:33.430310 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:33.430310 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 181/356] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:33.431010 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c98b2-d0ca-4e7a-98ca-d961aa38a12a None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:33.495370 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015722d-d4cd-42a0-8f6e-5072d488ff3a None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:33.501513 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:33.544326 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444b28b-a7c2-43e3-843a-5a22003e2470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:33.544670 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c98b2-d0ca-4e7a-98ca-d961aa38a12a None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:33.545342 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444b28b-a7c2-43e3-843a-5a22003e2470 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:33.545831 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444b28b-a7c2-43e3-843a-5a22003e2470 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:33.546426 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444b28b-a7c2-43e3-843a-5a22003e2470 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:33.547503 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444b28b-a7c2-43e3-843a-5a22003e2470 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:33.548384 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444b28b-a7c2-43e3-843a-5a22003e2470 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:33.550342 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444b28b-a7c2-43e3-843a-5a22003e2470 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:33.562000 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 176/357] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Aug 28 00:41:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:33.563340 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bacb98-4634-40df-bc9e-e7152a9c57a7 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:33.563629 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bacb98-4634-40df-bc9e-e7152a9c57a7 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:33.564166 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bacb98-4634-40df-bc9e-e7152a9c57a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:33.587122 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b7bacb98-4634-40df-bc9e-e7152a9c57a7 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:33.588618 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b7bacb98-4634-40df-bc9e-e7152a9c57a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:33.590311 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29a9ef-0681-4dc6-80cd-454bc023fb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:33.591028 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29a9ef-0681-4dc6-80cd-454bc023fb45 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:33.591442 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29a9ef-0681-4dc6-80cd-454bc023fb45 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:33.591859 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29a9ef-0681-4dc6-80cd-454bc023fb45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:33.592730 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29a9ef-0681-4dc6-80cd-454bc023fb45 None admin] RBAC: Adding query filter params (group.id=b5a1d67be7bf41008790f84c11b698d9, role.id=258091cadd094ad2a608d396036e8869, scope.project.id=93e707bfff714b1c80277c83a2ed2c93) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:33.593758 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29a9ef-0681-4dc6-80cd-454bc023fb45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:33.596632 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29a9ef-0681-4dc6-80cd-454bc023fb45 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:33.603421 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 182/358] 10.222.0.52 () {56 vars in 1376 bytes} [Sun Aug 28 00:41:33 2022] GET /identity/v3/role_assignments?group.id=b5a1d67be7bf41008790f84c11b698d9&scope.project.id=93e707bfff714b1c80277c83a2ed2c93&role.id=258091cadd094ad2a608d396036e8869 => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:33.604343 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29a9ef-0681-4dc6-80cd-454bc023fb45 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:33.676672 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 177/359] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:33.677764 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bacb98-4634-40df-bc9e-e7152a9c57a7 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:33.712103 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:33.730899 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29a9ef-0681-4dc6-80cd-454bc023fb45 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:33.801269 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:33.828295 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6cb1b-5940-4c39-97ab-cf5d8d1eca65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:33.828922 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6cb1b-5940-4c39-97ab-cf5d8d1eca65 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:33.829316 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6cb1b-5940-4c39-97ab-cf5d8d1eca65 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:33.829589 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6cb1b-5940-4c39-97ab-cf5d8d1eca65 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:33.830348 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6cb1b-5940-4c39-97ab-cf5d8d1eca65 None admin] RBAC: Adding query filter params (name=member) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:33.830604 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6cb1b-5940-4c39-97ab-cf5d8d1eca65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:33.832002 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6cb1b-5940-4c39-97ab-cf5d8d1eca65 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:33.850165 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 183/360] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Aug 28 00:41:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:33.855168 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6cb1b-5940-4c39-97ab-cf5d8d1eca65 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:33.877696 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bacb98-4634-40df-bc9e-e7152a9c57a7 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:33.934479 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956bf80-ac49-4151-bdf6-7c0419199729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:33.935481 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956bf80-ac49-4151-bdf6-7c0419199729 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:33.936109 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956bf80-ac49-4151-bdf6-7c0419199729 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:33.937826 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956bf80-ac49-4151-bdf6-7c0419199729 None admin] PATH_INFO: `/v3/users/05616fedce2d4d18b5dbcc8188cb2970` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:33.939292 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956bf80-ac49-4151-bdf6-7c0419199729 None admin] RBAC: Authorizing `identity:get_user(user_id=05616fedce2d4d18b5dbcc8188cb2970)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:33.941075 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956bf80-ac49-4151-bdf6-7c0419199729 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:33.943662 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 178/361] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:41:33 2022] GET /identity/v3/users/05616fedce2d4d18b5dbcc8188cb2970 => generated 293 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:33.945983 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768e7b0-bf82-4309-b0ef-1b29314eb48d None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:33.947660 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768e7b0-bf82-4309-b0ef-1b29314eb48d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:33.949649 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768e7b0-bf82-4309-b0ef-1b29314eb48d None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:33.951288 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 179/362] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:33.953662 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768e7b0-bf82-4309-b0ef-1b29314eb48d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:34.023993 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6cb1b-5940-4c39-97ab-cf5d8d1eca65 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:34.076688 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4eb5c0-f97f-4c6e-91eb-c63792a5bd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:34.077235 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4eb5c0-f97f-4c6e-91eb-c63792a5bd7b None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:34.077510 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4eb5c0-f97f-4c6e-91eb-c63792a5bd7b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:34.077823 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4eb5c0-f97f-4c6e-91eb-c63792a5bd7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:34.111172 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:34.124889 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768e7b0-bf82-4309-b0ef-1b29314eb48d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:34.154671 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:34.162961 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a95a11-c6d4-4954-bf64-eca6cb44721c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:34.163862 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a95a11-c6d4-4954-bf64-eca6cb44721c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:34.164266 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a95a11-c6d4-4954-bf64-eca6cb44721c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:34.164604 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a95a11-c6d4-4954-bf64-eca6cb44721c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:34.165713 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a95a11-c6d4-4954-bf64-eca6cb44721c None admin] RBAC: Adding query filter params (role.id=3e76264611ba49e6abbc019c0928e888, user.id=05616fedce2d4d18b5dbcc8188cb2970, scope.system=all) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:34.166342 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a95a11-c6d4-4954-bf64-eca6cb44721c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:34.167874 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a95a11-c6d4-4954-bf64-eca6cb44721c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:34.172745 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4eb5c0-f97f-4c6e-91eb-c63792a5bd7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:34.174527 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4eb5c0-f97f-4c6e-91eb-c63792a5bd7b None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:34.182412 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 180/363] 10.222.0.52 () {56 vars in 1308 bytes} [Sun Aug 28 00:41:33 2022] GET /identity/v3/role_assignments?user.id=05616fedce2d4d18b5dbcc8188cb2970&scope.system=all&role.id=3e76264611ba49e6abbc019c0928e888 => generated 510 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:34.189873 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7abd92-88a1-4e96-9514-8cd3c3bb1d6b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:34.189873 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7abd92-88a1-4e96-9514-8cd3c3bb1d6b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:34.189873 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7abd92-88a1-4e96-9514-8cd3c3bb1d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:34.206239 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-9e7abd92-88a1-4e96-9514-8cd3c3bb1d6b None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:34.207926 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9e7abd92-88a1-4e96-9514-8cd3c3bb1d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:34.295058 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 181/364] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:34.298717 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7abd92-88a1-4e96-9514-8cd3c3bb1d6b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:34.332919 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 184/365] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:41:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 00:41:34.338894 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4eb5c0-f97f-4c6e-91eb-c63792a5bd7b None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:34.467245 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:34.505141 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7abd92-88a1-4e96-9514-8cd3c3bb1d6b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:34.510189 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:34.532823 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4eb5c0-f97f-4c6e-91eb-c63792a5bd7b None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:34.573497 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42037752-f753-4c43-b6fc-ec8e9dbc2279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:34.574246 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42037752-f753-4c43-b6fc-ec8e9dbc2279 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:34.574516 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42037752-f753-4c43-b6fc-ec8e9dbc2279 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:34.574778 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42037752-f753-4c43-b6fc-ec8e9dbc2279 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:34.596656 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42037752-f753-4c43-b6fc-ec8e9dbc2279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:34.602115 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-42037752-f753-4c43-b6fc-ec8e9dbc2279 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:41:34.602115 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:34.602115 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:34.602115 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:34.602115 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:34.602115 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:34.602115 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:34.602115 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:34.602115 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:34.602115 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:34.602115 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:34.602115 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:34.602115 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:34.602115 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:34.602115 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:34.602115 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:34.603041 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:34.603041 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:34.603041 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:34.603041 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:34.603041 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:34.603041 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:34.603041 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:34.603041 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:34.603041 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:34.603041 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:34.603041 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:34.603041 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:34.603041 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:34.603041 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:34.603041 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:34.603041 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:34.603842 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:34.603842 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:34.603842 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:34.603842 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:34.603842 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:34.603842 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:34.603842 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:34.603842 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:34.603842 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:34.603842 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:34.603842 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:41:34.603842 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:34.603842 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 182/366] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Aug 28 00:41:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:34.605351 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01c480-aa3b-4705-899d-883aaeca4344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:34.606570 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01c480-aa3b-4705-899d-883aaeca4344 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:34.606913 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01c480-aa3b-4705-899d-883aaeca4344 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:34.607247 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01c480-aa3b-4705-899d-883aaeca4344 None admin] PATH_INFO: `/v3/projects/ad187f94c1d9456e9c97f78a7f686485` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:34.610622 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01c480-aa3b-4705-899d-883aaeca4344 None admin] RBAC: Authorizing `identity:get_project(project_id=ad187f94c1d9456e9c97f78a7f686485)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:34.611968 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42037752-f753-4c43-b6fc-ec8e9dbc2279 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:34.613550 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01c480-aa3b-4705-899d-883aaeca4344 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:34.615558 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 185/367] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:34 2022] GET /identity/v3/projects/ad187f94c1d9456e9c97f78a7f686485 => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:41:34.622739 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01c480-aa3b-4705-899d-883aaeca4344 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:34.771923 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42037752-f753-4c43-b6fc-ec8e9dbc2279 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:34.781355 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01c480-aa3b-4705-899d-883aaeca4344 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:34.812557 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75906ba-32b6-4d08-b534-3b4269dd49fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:34.813203 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75906ba-32b6-4d08-b534-3b4269dd49fb None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:34.813475 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75906ba-32b6-4d08-b534-3b4269dd49fb None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:34.813784 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75906ba-32b6-4d08-b534-3b4269dd49fb None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:34.814594 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75906ba-32b6-4d08-b534-3b4269dd49fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:34.815041 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75906ba-32b6-4d08-b534-3b4269dd49fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:34.816431 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75906ba-32b6-4d08-b534-3b4269dd49fb None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:34.823892 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5ec2b-db35-4c22-9b24-2fddb03c3342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:34.824534 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5ec2b-db35-4c22-9b24-2fddb03c3342 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:34.825079 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5ec2b-db35-4c22-9b24-2fddb03c3342 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:34.825355 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5ec2b-db35-4c22-9b24-2fddb03c3342 None admin] PATH_INFO: `/v3/groups/b5a1d67be7bf41008790f84c11b698d9` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:34.826580 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5ec2b-db35-4c22-9b24-2fddb03c3342 None admin] RBAC: Authorizing `identity:get_group(group_id=b5a1d67be7bf41008790f84c11b698d9)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:34.827533 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 183/368] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:41:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:34.828700 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75906ba-32b6-4d08-b534-3b4269dd49fb None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:34.829279 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5ec2b-db35-4c22-9b24-2fddb03c3342 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:34.834111 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:34.835016 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 186/369] 10.222.0.52 () {56 vars in 1180 bytes} [Sun Aug 28 00:41:34 2022] GET /identity/v3/groups/b5a1d67be7bf41008790f84c11b698d9 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:34.835990 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5ec2b-db35-4c22-9b24-2fddb03c3342 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:34.869474 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:34.965626 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75906ba-32b6-4d08-b534-3b4269dd49fb None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:34.966009 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5ec2b-db35-4c22-9b24-2fddb03c3342 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:35.009825 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa188922-cb5c-49ff-a01b-3621c607c7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:35.010466 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a35e0-8c49-47b6-81f0-fe89620e4d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:35.011098 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a35e0-8c49-47b6-81f0-fe89620e4d24 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:35.011207 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa188922-cb5c-49ff-a01b-3621c607c7c1 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:35.011366 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a35e0-8c49-47b6-81f0-fe89620e4d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:35.011639 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a35e0-8c49-47b6-81f0-fe89620e4d24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:35.012057 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa188922-cb5c-49ff-a01b-3621c607c7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:35.012517 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa188922-cb5c-49ff-a01b-3621c607c7c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:35.023968 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a35e0-8c49-47b6-81f0-fe89620e4d24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:35.030374 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-517a35e0-8c49-47b6-81f0-fe89620e4d24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:41:35.030374 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:35.030374 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:35.030374 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:35.030374 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:35.030374 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:35.030374 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:35.030374 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:35.030374 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:35.030374 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:35.030374 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:35.030374 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:35.030374 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:35.030374 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:35.030374 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:35.030374 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:35.031308 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:35.031308 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:35.031308 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:35.031308 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:35.031308 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:35.031308 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:35.031308 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:35.031308 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:35.031308 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:35.031308 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:35.031308 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:35.031308 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:35.031308 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:35.031308 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:35.031308 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:35.031308 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:35.032095 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:35.032095 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:35.032095 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:35.032095 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:35.032095 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:35.032095 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:35.032095 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:35.032095 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:35.032095 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:35.032095 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:35.032095 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:41:35.032095 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:35.033923 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 184/370] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:41:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:35.034974 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a35e0-8c49-47b6-81f0-fe89620e4d24 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:35.113998 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa188922-cb5c-49ff-a01b-3621c607c7c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:35.115852 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:35.116392 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa188922-cb5c-49ff-a01b-3621c607c7c1 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:35.150222 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:35.175737 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a35e0-8c49-47b6-81f0-fe89620e4d24 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:35.225546 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc654070-0318-4640-b5df-41fe419f831b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:35.226602 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc654070-0318-4640-b5df-41fe419f831b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:35.227081 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc654070-0318-4640-b5df-41fe419f831b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:35.227544 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc654070-0318-4640-b5df-41fe419f831b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:35.228469 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc654070-0318-4640-b5df-41fe419f831b None admin] RBAC: Adding query filter params (group.id=b5a1d67be7bf41008790f84c11b698d9, role.id=2231e998e50146f4b53b832f2f88c1c8, scope.project.id=ad187f94c1d9456e9c97f78a7f686485) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:35.229057 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc654070-0318-4640-b5df-41fe419f831b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:35.231666 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc654070-0318-4640-b5df-41fe419f831b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:35.238754 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 185/371] 10.222.0.52 () {56 vars in 1376 bytes} [Sun Aug 28 00:41:35 2022] GET /identity/v3/role_assignments?group.id=b5a1d67be7bf41008790f84c11b698d9&scope.project.id=ad187f94c1d9456e9c97f78a7f686485&role.id=2231e998e50146f4b53b832f2f88c1c8 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:35.239871 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc654070-0318-4640-b5df-41fe419f831b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:35.248884 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 187/372] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:41:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:41:35.255705 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa188922-cb5c-49ff-a01b-3621c607c7c1 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:35.385828 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa188922-cb5c-49ff-a01b-3621c607c7c1 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:35.386830 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc654070-0318-4640-b5df-41fe419f831b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:35.417117 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:35.423512 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:35.436713 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d1662-808d-4f67-b156-da79b8d097e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:35.436713 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d1662-808d-4f67-b156-da79b8d097e8 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:35.436713 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d1662-808d-4f67-b156-da79b8d097e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:35.437067 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d1662-808d-4f67-b156-da79b8d097e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:35.437676 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d1662-808d-4f67-b156-da79b8d097e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:35.438111 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d1662-808d-4f67-b156-da79b8d097e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:35.439539 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d1662-808d-4f67-b156-da79b8d097e8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:35.443322 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cd039-bd97-43f7-a3ba-36127b8a6497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:35.444256 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cd039-bd97-43f7-a3ba-36127b8a6497 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:35.444731 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cd039-bd97-43f7-a3ba-36127b8a6497 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:35.445231 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cd039-bd97-43f7-a3ba-36127b8a6497 None admin] PATH_INFO: `/v3/projects/ad187f94c1d9456e9c97f78a7f686485` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:35.448352 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8cd039-bd97-43f7-a3ba-36127b8a6497 None admin] RBAC: Authorizing `identity:get_project(project_id=ad187f94c1d9456e9c97f78a7f686485)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:35.450085 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8cd039-bd97-43f7-a3ba-36127b8a6497 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:35.454507 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 188/373] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:35 2022] GET /identity/v3/projects/ad187f94c1d9456e9c97f78a7f686485 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:41:35.459342 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 186/374] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:35.460531 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d1662-808d-4f67-b156-da79b8d097e8 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:35.462545 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cd039-bd97-43f7-a3ba-36127b8a6497 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:35.636070 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cd039-bd97-43f7-a3ba-36127b8a6497 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:35.646068 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d1662-808d-4f67-b156-da79b8d097e8 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:35.674563 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc64c4-164f-42a7-837b-285045f54c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:35.675177 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc64c4-164f-42a7-837b-285045f54c13 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:35.675453 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc64c4-164f-42a7-837b-285045f54c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:35.675724 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc64c4-164f-42a7-837b-285045f54c13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:35.689582 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790a4b3-27cf-4da2-95cc-2872d063da94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:35.690257 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790a4b3-27cf-4da2-95cc-2872d063da94 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:35.690530 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790a4b3-27cf-4da2-95cc-2872d063da94 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:35.690801 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790a4b3-27cf-4da2-95cc-2872d063da94 None admin] PATH_INFO: `/v3/groups/b5a1d67be7bf41008790f84c11b698d9` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:35.691905 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790a4b3-27cf-4da2-95cc-2872d063da94 None admin] RBAC: Authorizing `identity:get_group(group_id=b5a1d67be7bf41008790f84c11b698d9)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:35.693347 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790a4b3-27cf-4da2-95cc-2872d063da94 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:35.696243 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 187/375] 10.222.0.52 () {56 vars in 1180 bytes} [Sun Aug 28 00:41:35 2022] GET /identity/v3/groups/b5a1d67be7bf41008790f84c11b698d9 => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:35.697416 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92869e-bc68-444e-a00c-2c27d8cce380 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:35.697692 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92869e-bc68-444e-a00c-2c27d8cce380 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:35.702136 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92869e-bc68-444e-a00c-2c27d8cce380 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:35.703722 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 188/376] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:35.705391 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92869e-bc68-444e-a00c-2c27d8cce380 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:35.750619 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:35.764368 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc64c4-164f-42a7-837b-285045f54c13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:35.765879 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc64c4-164f-42a7-837b-285045f54c13 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:35.817134 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:35.844026 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92869e-bc68-444e-a00c-2c27d8cce380 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:35.882176 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 189/377] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:41:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:41:35.883446 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c7c04-f133-4304-8ce9-2371d2a607e0 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:35.883732 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c7c04-f133-4304-8ce9-2371d2a607e0 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:35.884002 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c7c04-f133-4304-8ce9-2371d2a607e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:35.887494 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e4eee-8203-4319-ab90-65b00c43e379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:35.888139 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e4eee-8203-4319-ab90-65b00c43e379 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:35.888413 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e4eee-8203-4319-ab90-65b00c43e379 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:35.888813 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e4eee-8203-4319-ab90-65b00c43e379 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:35.889650 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e4eee-8203-4319-ab90-65b00c43e379 None admin] RBAC: Adding query filter params (group.id=b5a1d67be7bf41008790f84c11b698d9, role.id=258091cadd094ad2a608d396036e8869, scope.project.id=ad187f94c1d9456e9c97f78a7f686485) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:35.889982 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e4eee-8203-4319-ab90-65b00c43e379 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:35.892733 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e4eee-8203-4319-ab90-65b00c43e379 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:35.899389 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 189/378] 10.222.0.52 () {56 vars in 1376 bytes} [Sun Aug 28 00:41:35 2022] GET /identity/v3/role_assignments?group.id=b5a1d67be7bf41008790f84c11b698d9&scope.project.id=ad187f94c1d9456e9c97f78a7f686485&role.id=258091cadd094ad2a608d396036e8869 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:35.900329 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e4eee-8203-4319-ab90-65b00c43e379 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:35.909048 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-052c7c04-f133-4304-8ce9-2371d2a607e0 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:35.910313 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-052c7c04-f133-4304-8ce9-2371d2a607e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:36.051725 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e4eee-8203-4319-ab90-65b00c43e379 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:36.065139 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 190/379] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:36.080793 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:36.100419 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331c5e2-22cb-42dd-9dec-54bd7e118fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:36.101064 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331c5e2-22cb-42dd-9dec-54bd7e118fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:36.101337 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331c5e2-22cb-42dd-9dec-54bd7e118fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:36.101602 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331c5e2-22cb-42dd-9dec-54bd7e118fe2 None admin] PATH_INFO: `/v3/projects/4e55fe92e3a24b25b164aeab879fa6da` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:36.102767 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331c5e2-22cb-42dd-9dec-54bd7e118fe2 None admin] RBAC: Authorizing `identity:get_project(project_id=4e55fe92e3a24b25b164aeab879fa6da)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:36.104240 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331c5e2-22cb-42dd-9dec-54bd7e118fe2 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:36.106178 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 190/380] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:35 2022] GET /identity/v3/projects/4e55fe92e3a24b25b164aeab879fa6da => generated 344 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:36.111778 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c7c04-f133-4304-8ce9-2371d2a607e0 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:36.144962 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:36.194099 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3953b-f2ce-4501-a25f-31be142c207a None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:36.194600 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3953b-f2ce-4501-a25f-31be142c207a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:36.194883 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3953b-f2ce-4501-a25f-31be142c207a None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:36.196899 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 191/381] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:36.202529 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634975f2-e337-43e4-844c-1e4a2bef8b22 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:36.202810 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634975f2-e337-43e4-844c-1e4a2bef8b22 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:36.203085 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634975f2-e337-43e4-844c-1e4a2bef8b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:36.231853 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-634975f2-e337-43e4-844c-1e4a2bef8b22 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:36.233068 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-634975f2-e337-43e4-844c-1e4a2bef8b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:36.259384 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c7c04-f133-4304-8ce9-2371d2a607e0 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:36.328264 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9ff9f-c840-45d5-83ab-1a6cc28957cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:36.328900 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9ff9f-c840-45d5-83ab-1a6cc28957cb None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:36.329169 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9ff9f-c840-45d5-83ab-1a6cc28957cb None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:36.329435 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9ff9f-c840-45d5-83ab-1a6cc28957cb None admin] PATH_INFO: `/v3/groups/114c7ecc19ff4e4f9653e543a196572e` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:36.343227 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9ff9f-c840-45d5-83ab-1a6cc28957cb None admin] RBAC: Authorizing `identity:get_group(group_id=114c7ecc19ff4e4f9653e543a196572e)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:36.345006 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9ff9f-c840-45d5-83ab-1a6cc28957cb None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:36.349234 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 191/382] 10.222.0.52 () {56 vars in 1180 bytes} [Sun Aug 28 00:41:36 2022] GET /identity/v3/groups/114c7ecc19ff4e4f9653e543a196572e => generated 229 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:36.355498 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9ff9f-c840-45d5-83ab-1a6cc28957cb None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:36.372220 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 192/383] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:41:36.386998 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634975f2-e337-43e4-844c-1e4a2bef8b22 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:36.510673 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:36.527144 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9ff9f-c840-45d5-83ab-1a6cc28957cb None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:36.582240 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634975f2-e337-43e4-844c-1e4a2bef8b22 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:36.593443 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35280016-8496-4e34-a24b-51970ba38403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:36.594706 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35280016-8496-4e34-a24b-51970ba38403 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:36.595130 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35280016-8496-4e34-a24b-51970ba38403 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:36.595540 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35280016-8496-4e34-a24b-51970ba38403 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:36.596412 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35280016-8496-4e34-a24b-51970ba38403 None admin] RBAC: Adding query filter params (group.id=114c7ecc19ff4e4f9653e543a196572e, role.id=cc013581bb07418d9ec6a3a1d282ea53, scope.project.id=4e55fe92e3a24b25b164aeab879fa6da) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:36.596882 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35280016-8496-4e34-a24b-51970ba38403 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:36.598856 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35280016-8496-4e34-a24b-51970ba38403 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:36.610562 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:36.611973 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 192/384] 10.222.0.52 () {56 vars in 1376 bytes} [Sun Aug 28 00:41:36 2022] GET /identity/v3/role_assignments?group.id=114c7ecc19ff4e4f9653e543a196572e&scope.project.id=4e55fe92e3a24b25b164aeab879fa6da&role.id=cc013581bb07418d9ec6a3a1d282ea53 => generated 260 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:36.622750 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c4451-5d8f-4b18-bc53-ceffe857ba28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:36.623501 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c4451-5d8f-4b18-bc53-ceffe857ba28 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:36.623953 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c4451-5d8f-4b18-bc53-ceffe857ba28 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:36.624296 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c4451-5d8f-4b18-bc53-ceffe857ba28 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:36.636917 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c4451-5d8f-4b18-bc53-ceffe857ba28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:36.642777 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-a04c4451-5d8f-4b18-bc53-ceffe857ba28 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:41:36.642777 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:36.642777 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:36.642777 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:36.642777 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:36.642777 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:36.642777 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:36.642777 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:36.642777 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:36.642777 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:36.642777 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:36.642777 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:36.642777 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:36.642777 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:36.642777 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:36.642777 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:36.643734 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:36.643734 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:36.643734 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:36.643734 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:36.643734 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:36.643734 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:36.643734 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:36.643734 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:36.643734 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:36.643734 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:36.643734 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:36.643734 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:36.643734 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:36.643734 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:36.643734 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:36.643734 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:36.644906 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:36.644906 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:36.644906 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:36.644906 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:36.644906 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:36.644906 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:36.644906 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:36.644906 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:36.644906 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:36.644906 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:36.644906 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:41:36.644906 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:36.644906 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 193/385] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:41:36.650475 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35280016-8496-4e34-a24b-51970ba38403 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:36.682046 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c4451-5d8f-4b18-bc53-ceffe857ba28 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:36.804593 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c4451-5d8f-4b18-bc53-ceffe857ba28 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:36.823518 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35280016-8496-4e34-a24b-51970ba38403 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:36.843387 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e45620-b22c-4ea7-aa72-df9953e4178a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:36.844306 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e45620-b22c-4ea7-aa72-df9953e4178a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:36.845141 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e45620-b22c-4ea7-aa72-df9953e4178a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:36.845570 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e45620-b22c-4ea7-aa72-df9953e4178a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:36.856900 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e45620-b22c-4ea7-aa72-df9953e4178a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:36.862325 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-d1e45620-b22c-4ea7-aa72-df9953e4178a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:41:36.862325 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:36.862325 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:36.862325 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:36.862325 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:36.862325 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:36.862325 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:36.862325 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:36.862325 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:36.862325 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:36.862325 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:36.862325 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:36.862325 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:36.862325 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:36.862325 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:36.862325 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:36.863408 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:36.863408 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:36.863408 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:36.863408 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:36.863408 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:36.863408 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:36.863408 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:36.863408 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:36.863408 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:36.863408 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:36.863408 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:36.863408 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:36.863408 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:36.863408 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:36.863408 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:36.863408 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:36.864495 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:36.864495 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:36.864495 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:36.864495 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:36.864495 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:36.864495 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:36.864495 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:36.864495 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:36.864495 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:36.864495 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:36.864495 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:41:36.864495 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:36.866850 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 194/386] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Aug 28 00:41:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:41:36.875470 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e45620-b22c-4ea7-aa72-df9953e4178a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:36.893258 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daf86f-0e81-4a51-bfb9-34054e97af75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:36.893903 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daf86f-0e81-4a51-bfb9-34054e97af75 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:36.894183 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daf86f-0e81-4a51-bfb9-34054e97af75 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:36.894455 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daf86f-0e81-4a51-bfb9-34054e97af75 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:36.895132 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30daf86f-0e81-4a51-bfb9-34054e97af75 None admin] RBAC: Adding query filter params (name=member) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:36.895432 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30daf86f-0e81-4a51-bfb9-34054e97af75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:36.896819 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30daf86f-0e81-4a51-bfb9-34054e97af75 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:36.914651 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 193/387] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Aug 28 00:41:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:36.923889 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daf86f-0e81-4a51-bfb9-34054e97af75 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:36.941687 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:36.943728 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:37.032434 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e45620-b22c-4ea7-aa72-df9953e4178a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:37.042876 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daf86f-0e81-4a51-bfb9-34054e97af75 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:37.079405 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b1865-fc4f-4525-8c0e-a01ab3edcd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:37.079971 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b1865-fc4f-4525-8c0e-a01ab3edcd4e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:37.080251 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b1865-fc4f-4525-8c0e-a01ab3edcd4e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:37.080520 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b1865-fc4f-4525-8c0e-a01ab3edcd4e None admin] PATH_INFO: `/v3/groups/b5a1d67be7bf41008790f84c11b698d9` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:37.081640 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759b1865-fc4f-4525-8c0e-a01ab3edcd4e None admin] RBAC: Authorizing `identity:get_group(group_id=b5a1d67be7bf41008790f84c11b698d9)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:37.083328 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759b1865-fc4f-4525-8c0e-a01ab3edcd4e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:37.089562 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 194/388] 10.222.0.52 () {56 vars in 1180 bytes} [Sun Aug 28 00:41:36 2022] GET /identity/v3/groups/b5a1d67be7bf41008790f84c11b698d9 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:41:37.090890 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b1865-fc4f-4525-8c0e-a01ab3edcd4e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:37.102617 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb47c30-e117-4543-8fa5-3b566e696aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:37.103335 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb47c30-e117-4543-8fa5-3b566e696aff None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:37.103610 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb47c30-e117-4543-8fa5-3b566e696aff None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:37.103880 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb47c30-e117-4543-8fa5-3b566e696aff None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:37.104648 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb47c30-e117-4543-8fa5-3b566e696aff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:37.104947 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb47c30-e117-4543-8fa5-3b566e696aff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:37.106394 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb47c30-e117-4543-8fa5-3b566e696aff None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:37.122404 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 195/389] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:41:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:37.128126 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb47c30-e117-4543-8fa5-3b566e696aff None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:37.179379 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:37.200283 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b1865-fc4f-4525-8c0e-a01ab3edcd4e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:37.237205 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b748d-e5d8-438e-a6ee-48d56baa3020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:37.237865 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b748d-e5d8-438e-a6ee-48d56baa3020 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:37.238151 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b748d-e5d8-438e-a6ee-48d56baa3020 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:37.238427 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b748d-e5d8-438e-a6ee-48d56baa3020 None admin] PATH_INFO: `/v3/projects/93e707bfff714b1c80277c83a2ed2c93` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:37.239608 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b748d-e5d8-438e-a6ee-48d56baa3020 None admin] RBAC: Authorizing `identity:get_project(project_id=93e707bfff714b1c80277c83a2ed2c93)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:37.241145 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b748d-e5d8-438e-a6ee-48d56baa3020 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:37.247712 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 195/390] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:37 2022] GET /identity/v3/projects/93e707bfff714b1c80277c83a2ed2c93 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:37.249164 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b748d-e5d8-438e-a6ee-48d56baa3020 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:37.313869 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb47c30-e117-4543-8fa5-3b566e696aff None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:37.316530 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:37.361957 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b748d-e5d8-438e-a6ee-48d56baa3020 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:37.367866 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b4a3e-916f-4cb3-b9fc-3619b1605d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:37.368527 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b4a3e-916f-4cb3-b9fc-3619b1605d7a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:37.368814 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b4a3e-916f-4cb3-b9fc-3619b1605d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:37.369092 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b4a3e-916f-4cb3-b9fc-3619b1605d7a None admin] PATH_INFO: `/v3/groups/b5a1d67be7bf41008790f84c11b698d9` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:37.373229 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b4a3e-916f-4cb3-b9fc-3619b1605d7a None admin] RBAC: Authorizing `identity:get_group(group_id=b5a1d67be7bf41008790f84c11b698d9)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:37.374872 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b4a3e-916f-4cb3-b9fc-3619b1605d7a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:37.376816 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 196/391] 10.222.0.52 () {56 vars in 1180 bytes} [Sun Aug 28 00:41:37 2022] GET /identity/v3/groups/b5a1d67be7bf41008790f84c11b698d9 => generated 226 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:41:37.382255 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b4a3e-916f-4cb3-b9fc-3619b1605d7a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:37.395333 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace7a5c-20d8-4c01-87c1-4c4f9864de09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:37.396009 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace7a5c-20d8-4c01-87c1-4c4f9864de09 None admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:37.396286 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace7a5c-20d8-4c01-87c1-4c4f9864de09 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:37.396554 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace7a5c-20d8-4c01-87c1-4c4f9864de09 None admin] PATH_INFO: `/v3/projects/93e707bfff714b1c80277c83a2ed2c93/groups/b5a1d67be7bf41008790f84c11b698d9/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:37.398523 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace7a5c-20d8-4c01-87c1-4c4f9864de09 None admin] RBAC: Authorizing `identity:create_grant(project_id=93e707bfff714b1c80277c83a2ed2c93, group_id=b5a1d67be7bf41008790f84c11b698d9, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:37.400215 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace7a5c-20d8-4c01-87c1-4c4f9864de09 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:37.425606 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 196/392] 10.222.0.52 () {58 vars in 1442 bytes} [Sun Aug 28 00:41:37 2022] PUT /identity/v3/projects/93e707bfff714b1c80277c83a2ed2c93/groups/b5a1d67be7bf41008790f84c11b698d9/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:41:37.524003 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b4a3e-916f-4cb3-b9fc-3619b1605d7a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:37.585857 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c378c-eb6f-4452-b863-efa6f8b6f33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:37.586551 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c378c-eb6f-4452-b863-efa6f8b6f33e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:37.586830 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c378c-eb6f-4452-b863-efa6f8b6f33e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:37.587100 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c378c-eb6f-4452-b863-efa6f8b6f33e None admin] PATH_INFO: `/v3/projects/93e707bfff714b1c80277c83a2ed2c93` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:37.588241 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c378c-eb6f-4452-b863-efa6f8b6f33e None admin] RBAC: Authorizing `identity:get_project(project_id=93e707bfff714b1c80277c83a2ed2c93)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:37.589764 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c378c-eb6f-4452-b863-efa6f8b6f33e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:37.591626 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 197/393] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:37 2022] GET /identity/v3/projects/93e707bfff714b1c80277c83a2ed2c93 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:41:37.598117 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace7a5c-20d8-4c01-87c1-4c4f9864de09 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:37.610248 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:37.718198 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace7a5c-20d8-4c01-87c1-4c4f9864de09 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:37.755912 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e82019-ecff-4d33-9d9a-413f148d0fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:37.756590 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e82019-ecff-4d33-9d9a-413f148d0fcf None admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:37.756908 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e82019-ecff-4d33-9d9a-413f148d0fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:37.757187 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e82019-ecff-4d33-9d9a-413f148d0fcf None admin] PATH_INFO: `/v3/projects/93e707bfff714b1c80277c83a2ed2c93/groups/b5a1d67be7bf41008790f84c11b698d9/roles/258091cadd094ad2a608d396036e8869` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:37.759535 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e82019-ecff-4d33-9d9a-413f148d0fcf None admin] RBAC: Authorizing `identity:create_grant(project_id=93e707bfff714b1c80277c83a2ed2c93, group_id=b5a1d67be7bf41008790f84c11b698d9, role_id=258091cadd094ad2a608d396036e8869)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:37.761008 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e82019-ecff-4d33-9d9a-413f148d0fcf None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:37.777411 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 197/394] 10.222.0.52 () {58 vars in 1442 bytes} [Sun Aug 28 00:41:37 2022] PUT /identity/v3/projects/93e707bfff714b1c80277c83a2ed2c93/groups/b5a1d67be7bf41008790f84c11b698d9/roles/258091cadd094ad2a608d396036e8869 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:41:37.934518 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457c707-7eda-47ae-9116-28424633e4a7 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:37.934883 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457c707-7eda-47ae-9116-28424633e4a7 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:37.935105 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457c707-7eda-47ae-9116-28424633e4a7 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:37.937195 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 198/395] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:37.943894 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80360244-e52f-43f8-b02a-14f0b65153aa None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:37.944385 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80360244-e52f-43f8-b02a-14f0b65153aa None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:37.944793 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80360244-e52f-43f8-b02a-14f0b65153aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:37.967440 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-80360244-e52f-43f8-b02a-14f0b65153aa None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:37.969282 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-80360244-e52f-43f8-b02a-14f0b65153aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:38.041392 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:38.047872 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 198/396] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:38.473026 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b93ff-d5c0-4058-9600-6eb1557d0cd2 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:38.473543 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b93ff-d5c0-4058-9600-6eb1557d0cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:38.473543 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b93ff-d5c0-4058-9600-6eb1557d0cd2 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:38.475186 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 199/397] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:38.483246 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495e782-90bc-46f3-a8e6-f3df946e256c None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:38.484121 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495e782-90bc-46f3-a8e6-f3df946e256c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:38.484585 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495e782-90bc-46f3-a8e6-f3df946e256c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:38.506100 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-8495e782-90bc-46f3-a8e6-f3df946e256c None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:38.507636 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8495e782-90bc-46f3-a8e6-f3df946e256c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:38.547189 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b93ff-d5c0-4058-9600-6eb1557d0cd2 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:38.598151 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 199/398] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:38.634191 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:38.716622 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b93ff-d5c0-4058-9600-6eb1557d0cd2 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:38.757710 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ba6f7-84b4-4903-ab93-fe51c7bb01e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:38.758305 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ba6f7-84b4-4903-ab93-fe51c7bb01e5 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:38.758580 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ba6f7-84b4-4903-ab93-fe51c7bb01e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:38.758848 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ba6f7-84b4-4903-ab93-fe51c7bb01e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:38.776452 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ba6f7-84b4-4903-ab93-fe51c7bb01e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:38.783474 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-1d8ba6f7-84b4-4903-ab93-fe51c7bb01e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:41:38.783474 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:38.783474 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:38.783474 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:38.783474 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:38.783474 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:38.783474 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:38.783474 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:38.783474 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:38.783474 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:38.783474 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:38.783474 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:38.783474 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:38.783474 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:38.783474 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:38.783474 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:38.784461 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:38.784461 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:38.784461 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:38.784461 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:38.784461 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:38.784461 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:38.784461 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:38.784461 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:38.784461 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:38.784461 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:38.784461 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:38.784461 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:38.784461 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:38.784461 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:38.784461 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:38.784461 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:38.785267 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:38.785267 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:38.785267 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:38.785267 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:38.785267 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:38.785267 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:38.785267 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:38.785267 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:38.785267 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:38.785267 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:38.785267 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:41:38.785267 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:38.785267 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 200/399] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:38.792332 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8495e782-90bc-46f3-a8e6-f3df946e256c None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:38.927771 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8495e782-90bc-46f3-a8e6-f3df946e256c None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:38.957994 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:38.971896 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377dddf-0991-4f8d-b860-64dae361f713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:38.972522 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377dddf-0991-4f8d-b860-64dae361f713 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:38.972796 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377dddf-0991-4f8d-b860-64dae361f713 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:38.973064 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377dddf-0991-4f8d-b860-64dae361f713 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:38.973734 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f377dddf-0991-4f8d-b860-64dae361f713 None admin] RBAC: Adding query filter params (name=member) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:38.974067 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f377dddf-0991-4f8d-b860-64dae361f713 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:38.975454 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f377dddf-0991-4f8d-b860-64dae361f713 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:38.986093 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 200/400] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Aug 28 00:41:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:38.991715 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ba6f7-84b4-4903-ab93-fe51c7bb01e5 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:39.071472 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7811144-599a-40f1-99d7-995588330c0f None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:39.071793 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7811144-599a-40f1-99d7-995588330c0f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:39.072014 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7811144-599a-40f1-99d7-995588330c0f None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:39.073541 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 201/401] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:41:39.079071 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145bfa72-1555-415a-90b1-0bca5f0ed1c5 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:39.079763 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145bfa72-1555-415a-90b1-0bca5f0ed1c5 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:39.080231 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145bfa72-1555-415a-90b1-0bca5f0ed1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:39.100499 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-145bfa72-1555-415a-90b1-0bca5f0ed1c5 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:39.102081 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-145bfa72-1555-415a-90b1-0bca5f0ed1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:39.106773 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ba6f7-84b4-4903-ab93-fe51c7bb01e5 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:39.125173 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:39.150327 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0f2c0-f1bb-494f-a1dd-7c4bdce60fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:39.151208 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0f2c0-f1bb-494f-a1dd-7c4bdce60fcb None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:39.151656 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0f2c0-f1bb-494f-a1dd-7c4bdce60fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:39.152066 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0f2c0-f1bb-494f-a1dd-7c4bdce60fcb None admin] PATH_INFO: `/v3/groups/b5a1d67be7bf41008790f84c11b698d9` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:39.153355 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0f2c0-f1bb-494f-a1dd-7c4bdce60fcb None admin] RBAC: Authorizing `identity:get_group(group_id=b5a1d67be7bf41008790f84c11b698d9)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:39.155301 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0f2c0-f1bb-494f-a1dd-7c4bdce60fcb None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:39.157093 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 201/402] 10.222.0.52 () {56 vars in 1180 bytes} [Sun Aug 28 00:41:38 2022] GET /identity/v3/groups/b5a1d67be7bf41008790f84c11b698d9 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:39.162633 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0f2c0-f1bb-494f-a1dd-7c4bdce60fcb None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:39.196867 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 202/403] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:41:39.203125 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145bfa72-1555-415a-90b1-0bca5f0ed1c5 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:39.345055 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0f2c0-f1bb-494f-a1dd-7c4bdce60fcb None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:39.403248 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145bfa72-1555-415a-90b1-0bca5f0ed1c5 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:39.414157 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1432b8-374c-4bd0-8877-16a039678820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:39.414796 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1432b8-374c-4bd0-8877-16a039678820 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:39.415071 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1432b8-374c-4bd0-8877-16a039678820 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:39.415340 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1432b8-374c-4bd0-8877-16a039678820 None admin] PATH_INFO: `/v3/projects/ad187f94c1d9456e9c97f78a7f686485` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:39.418105 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1432b8-374c-4bd0-8877-16a039678820 None admin] RBAC: Authorizing `identity:get_project(project_id=ad187f94c1d9456e9c97f78a7f686485)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:39.419561 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1432b8-374c-4bd0-8877-16a039678820 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:39.421961 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 202/404] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:39 2022] GET /identity/v3/projects/ad187f94c1d9456e9c97f78a7f686485 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:41:39.427401 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1432b8-374c-4bd0-8877-16a039678820 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:39.443106 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:39.469972 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1158e8-5d57-410b-a3e0-72994f8b5a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:39.470606 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1158e8-5d57-410b-a3e0-72994f8b5a11 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:39.470882 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1158e8-5d57-410b-a3e0-72994f8b5a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:39.471149 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1158e8-5d57-410b-a3e0-72994f8b5a11 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:39.487900 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:39.491732 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1158e8-5d57-410b-a3e0-72994f8b5a11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:39.502714 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-9c1158e8-5d57-410b-a3e0-72994f8b5a11 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:41:39.502714 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:39.502714 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:39.502714 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:39.502714 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:39.502714 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:39.502714 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:39.502714 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:39.502714 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:39.502714 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:39.502714 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:39.502714 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:39.502714 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:39.502714 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:39.502714 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:39.502714 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:39.503782 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:39.503782 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:39.503782 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:39.503782 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:39.503782 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:39.503782 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:39.503782 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:39.503782 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:39.503782 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:39.503782 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:39.503782 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:39.503782 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:39.503782 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:39.503782 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:39.503782 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:39.503782 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:39.505035 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:39.505035 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:39.505035 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:39.505035 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:39.505035 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:39.505035 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:39.505035 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:39.505035 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:39.505035 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:39.505035 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:39.505035 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:41:39.505035 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:39.505035 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 203/405] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Aug 28 00:41:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:39.510806 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1158e8-5d57-410b-a3e0-72994f8b5a11 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:39.590354 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1432b8-374c-4bd0-8877-16a039678820 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:39.630828 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd95545-3ba6-4154-a708-9ac8fa5f9bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:39.631511 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd95545-3ba6-4154-a708-9ac8fa5f9bc6 None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:39.631855 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd95545-3ba6-4154-a708-9ac8fa5f9bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:39.632131 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd95545-3ba6-4154-a708-9ac8fa5f9bc6 None admin] PATH_INFO: `/v3/projects/ad187f94c1d9456e9c97f78a7f686485/groups/b5a1d67be7bf41008790f84c11b698d9/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:39.634144 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd95545-3ba6-4154-a708-9ac8fa5f9bc6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad187f94c1d9456e9c97f78a7f686485, group_id=b5a1d67be7bf41008790f84c11b698d9, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:39.635682 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd95545-3ba6-4154-a708-9ac8fa5f9bc6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:39.652355 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 203/406] 10.222.0.52 () {58 vars in 1442 bytes} [Sun Aug 28 00:41:39 2022] PUT /identity/v3/projects/ad187f94c1d9456e9c97f78a7f686485/groups/b5a1d67be7bf41008790f84c11b698d9/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:41:39.653376 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd95545-3ba6-4154-a708-9ac8fa5f9bc6 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:39.669134 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1158e8-5d57-410b-a3e0-72994f8b5a11 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:39.716334 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd77c1f-f800-4aaa-a64b-f6b5ef3676f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:39.717017 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd77c1f-f800-4aaa-a64b-f6b5ef3676f6 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:39.717349 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd77c1f-f800-4aaa-a64b-f6b5ef3676f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:39.717747 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd77c1f-f800-4aaa-a64b-f6b5ef3676f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:39.718581 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd77c1f-f800-4aaa-a64b-f6b5ef3676f6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:39.718942 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd77c1f-f800-4aaa-a64b-f6b5ef3676f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:39.720971 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd77c1f-f800-4aaa-a64b-f6b5ef3676f6 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:39.732461 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 204/407] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:41:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:39.742591 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd77c1f-f800-4aaa-a64b-f6b5ef3676f6 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:39.782014 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:39.793399 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd95545-3ba6-4154-a708-9ac8fa5f9bc6 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:39.798706 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:39.870592 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23366e11-f830-424f-8be6-e85e8aadb6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:39.871247 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23366e11-f830-424f-8be6-e85e8aadb6e2 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:39.871519 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23366e11-f830-424f-8be6-e85e8aadb6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:39.871783 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23366e11-f830-424f-8be6-e85e8aadb6e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:39.893996 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23366e11-f830-424f-8be6-e85e8aadb6e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:39.898870 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-23366e11-f830-424f-8be6-e85e8aadb6e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:41:39.898870 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:39.898870 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:39.898870 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:39.898870 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:39.898870 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:39.898870 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:39.898870 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:39.898870 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:39.898870 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:39.898870 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:39.898870 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:39.898870 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:39.898870 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:39.898870 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:39.898870 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:39.899807 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:39.899807 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:39.899807 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:39.899807 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:39.899807 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:39.899807 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:39.899807 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:39.899807 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:39.899807 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:39.899807 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:39.899807 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:39.899807 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:39.899807 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:39.899807 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:39.899807 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:39.899807 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:39.900609 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:39.900609 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:39.900609 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:39.900609 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:39.900609 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:39.900609 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:39.900609 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:39.900609 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:39.900609 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:39.900609 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:39.900609 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:41:39.900609 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:39.901232 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 204/408] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:41:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:39.905923 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23366e11-f830-424f-8be6-e85e8aadb6e2 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:39.922822 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd77c1f-f800-4aaa-a64b-f6b5ef3676f6 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:39.967777 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc0e19-bb4d-40b0-92b9-22815408007c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:39.970670 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc0e19-bb4d-40b0-92b9-22815408007c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:39.970670 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc0e19-bb4d-40b0-92b9-22815408007c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:39.970670 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc0e19-bb4d-40b0-92b9-22815408007c None admin] PATH_INFO: `/v3/groups/b5a1d67be7bf41008790f84c11b698d9` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:39.970670 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc0e19-bb4d-40b0-92b9-22815408007c None admin] RBAC: Authorizing `identity:get_group(group_id=b5a1d67be7bf41008790f84c11b698d9)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:39.971860 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc0e19-bb4d-40b0-92b9-22815408007c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:39.973775 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 205/409] 10.222.0.52 () {56 vars in 1180 bytes} [Sun Aug 28 00:41:39 2022] GET /identity/v3/groups/b5a1d67be7bf41008790f84c11b698d9 => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:39.984176 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc0e19-bb4d-40b0-92b9-22815408007c None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:40.112091 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc0e19-bb4d-40b0-92b9-22815408007c None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:40.120056 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23366e11-f830-424f-8be6-e85e8aadb6e2 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:40.124085 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:40.170567 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bebd5e-0ec2-4c2e-a89c-754f74c8eafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:40.171314 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bebd5e-0ec2-4c2e-a89c-754f74c8eafe None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:40.171597 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bebd5e-0ec2-4c2e-a89c-754f74c8eafe None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:40.171879 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bebd5e-0ec2-4c2e-a89c-754f74c8eafe None admin] PATH_INFO: `/v3/projects/ad187f94c1d9456e9c97f78a7f686485` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:40.173037 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bebd5e-0ec2-4c2e-a89c-754f74c8eafe None admin] RBAC: Authorizing `identity:get_project(project_id=ad187f94c1d9456e9c97f78a7f686485)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:40.174548 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bebd5e-0ec2-4c2e-a89c-754f74c8eafe None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:40.176381 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 206/410] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:39 2022] GET /identity/v3/projects/ad187f94c1d9456e9c97f78a7f686485 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:40.178191 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e5c59-b7cb-41dd-8d34-87d1c9c81cf3 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:40.178370 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e5c59-b7cb-41dd-8d34-87d1c9c81cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:40.178643 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e5c59-b7cb-41dd-8d34-87d1c9c81cf3 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:40.180384 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 207/411] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:40.182759 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e5c59-b7cb-41dd-8d34-87d1c9c81cf3 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:40.184344 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ed6e8-8981-4001-ab0f-6b588b6f0b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:40.186905 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ed6e8-8981-4001-ab0f-6b588b6f0b23 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:40.187317 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ed6e8-8981-4001-ab0f-6b588b6f0b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:40.187695 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ed6e8-8981-4001-ab0f-6b588b6f0b23 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:40.188507 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ed6e8-8981-4001-ab0f-6b588b6f0b23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:40.188880 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ed6e8-8981-4001-ab0f-6b588b6f0b23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:40.190494 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ed6e8-8981-4001-ab0f-6b588b6f0b23 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:40.204224 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 205/412] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:41:40.205579 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ce58d-c3a7-44a9-acca-bc43e99decfa None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:40.205976 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ce58d-c3a7-44a9-acca-bc43e99decfa None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:40.206319 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ce58d-c3a7-44a9-acca-bc43e99decfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:40.227381 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-327ce58d-c3a7-44a9-acca-bc43e99decfa None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:40.228673 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-327ce58d-c3a7-44a9-acca-bc43e99decfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:40.242596 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:40.298240 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e5c59-b7cb-41dd-8d34-87d1c9c81cf3 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:40.315354 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 206/413] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:40.316004 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ce58d-c3a7-44a9-acca-bc43e99decfa None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:40.337353 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e753d-635e-4b86-887b-7063abcf4a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:40.338048 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e753d-635e-4b86-887b-7063abcf4a41 None admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:40.338326 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e753d-635e-4b86-887b-7063abcf4a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:40.338601 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e753d-635e-4b86-887b-7063abcf4a41 None admin] PATH_INFO: `/v3/projects/ad187f94c1d9456e9c97f78a7f686485/groups/b5a1d67be7bf41008790f84c11b698d9/roles/258091cadd094ad2a608d396036e8869` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:40.347988 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e753d-635e-4b86-887b-7063abcf4a41 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad187f94c1d9456e9c97f78a7f686485, group_id=b5a1d67be7bf41008790f84c11b698d9, role_id=258091cadd094ad2a608d396036e8869)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:40.350719 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e753d-635e-4b86-887b-7063abcf4a41 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:40.370034 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 208/414] 10.222.0.52 () {58 vars in 1442 bytes} [Sun Aug 28 00:41:40 2022] PUT /identity/v3/projects/ad187f94c1d9456e9c97f78a7f686485/groups/b5a1d67be7bf41008790f84c11b698d9/roles/258091cadd094ad2a608d396036e8869 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:41:40.373241 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202bb44-18b4-4c9d-a565-6d1689f24435 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:40.374195 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202bb44-18b4-4c9d-a565-6d1689f24435 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:40.374702 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202bb44-18b4-4c9d-a565-6d1689f24435 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:40.382350 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 209/415] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:40 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:40.385269 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3529edf-c531-4928-ac81-e045fb2676f7 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:40.386160 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3529edf-c531-4928-ac81-e045fb2676f7 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:40.390098 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3529edf-c531-4928-ac81-e045fb2676f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:40.414312 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-e3529edf-c531-4928-ac81-e045fb2676f7 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:40.415491 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e3529edf-c531-4928-ac81-e045fb2676f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:40.451680 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ce58d-c3a7-44a9-acca-bc43e99decfa None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:40.479528 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:40.498609 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c32707-e80d-4166-b3b4-079ce54e5cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:40.500337 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c32707-e80d-4166-b3b4-079ce54e5cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:40.500870 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c32707-e80d-4166-b3b4-079ce54e5cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:40.501802 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c32707-e80d-4166-b3b4-079ce54e5cb1 None admin] PATH_INFO: `/v3/groups/114c7ecc19ff4e4f9653e543a196572e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:40.503893 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c32707-e80d-4166-b3b4-079ce54e5cb1 None admin] RBAC: Authorizing `identity:get_group(group_id=114c7ecc19ff4e4f9653e543a196572e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:40.505673 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c32707-e80d-4166-b3b4-079ce54e5cb1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:40.507555 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 207/416] 10.222.0.52 () {56 vars in 1180 bytes} [Sun Aug 28 00:41:40 2022] GET /identity/v3/groups/114c7ecc19ff4e4f9653e543a196572e => generated 229 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:40.513973 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c32707-e80d-4166-b3b4-079ce54e5cb1 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:40.548671 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:40.562763 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 210/417] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:40.605445 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3529edf-c531-4928-ac81-e045fb2676f7 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:40.648507 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c32707-e80d-4166-b3b4-079ce54e5cb1 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:40.691556 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becbb48-d038-4613-8ae5-4874300c9aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:40.692203 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becbb48-d038-4613-8ae5-4874300c9aad None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:40.692485 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becbb48-d038-4613-8ae5-4874300c9aad None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:40.692760 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becbb48-d038-4613-8ae5-4874300c9aad None admin] PATH_INFO: `/v3/projects/4e55fe92e3a24b25b164aeab879fa6da` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:40.698535 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9becbb48-d038-4613-8ae5-4874300c9aad None admin] RBAC: Authorizing `identity:get_project(project_id=4e55fe92e3a24b25b164aeab879fa6da)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:40.700004 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9becbb48-d038-4613-8ae5-4874300c9aad None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:40.702309 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 208/418] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:40 2022] GET /identity/v3/projects/4e55fe92e3a24b25b164aeab879fa6da => generated 344 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:40.707887 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becbb48-d038-4613-8ae5-4874300c9aad None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:40.716141 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3529edf-c531-4928-ac81-e045fb2676f7 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:40.762478 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21df98a-e062-4abf-83be-a08765d6e9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:40.763206 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21df98a-e062-4abf-83be-a08765d6e9a8 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:40.763483 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21df98a-e062-4abf-83be-a08765d6e9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:40.763748 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21df98a-e062-4abf-83be-a08765d6e9a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:40.784556 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21df98a-e062-4abf-83be-a08765d6e9a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:40.795906 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-a21df98a-e062-4abf-83be-a08765d6e9a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:41:40.795906 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:40.795906 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:40.795906 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:40.795906 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:40.795906 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:40.795906 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:40.795906 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:40.795906 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:40.795906 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:40.795906 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:40.795906 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:40.795906 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:40.795906 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:40.795906 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:40.795906 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:40.797016 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:40.797016 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:40.797016 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:40.797016 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:40.797016 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:40.797016 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:40.797016 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:40.797016 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:40.797016 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:40.797016 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:40.797016 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:40.797016 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:40.797016 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:40.797016 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:40.797016 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:40.797016 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:40.798240 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:40.798240 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:40.798240 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:40.798240 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:40.798240 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:40.798240 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:40.798240 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:40.798240 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:40.798240 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:40.798240 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:40.798240 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:41:40.798240 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:40.798240 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 211/419] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:41:40.807804 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21df98a-e062-4abf-83be-a08765d6e9a8 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:40.817372 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:40.834057 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becbb48-d038-4613-8ae5-4874300c9aad None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:40.866191 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:40.870761 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d700fe-702f-46bf-ad46-2ad894dee21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:40.871509 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d700fe-702f-46bf-ad46-2ad894dee21b None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:40.871692 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d700fe-702f-46bf-ad46-2ad894dee21b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:40.872046 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d700fe-702f-46bf-ad46-2ad894dee21b None admin] PATH_INFO: `/v3/projects/4e55fe92e3a24b25b164aeab879fa6da/groups/114c7ecc19ff4e4f9653e543a196572e/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:40.874098 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d700fe-702f-46bf-ad46-2ad894dee21b None admin] RBAC: Authorizing `identity:create_grant(project_id=4e55fe92e3a24b25b164aeab879fa6da, group_id=114c7ecc19ff4e4f9653e543a196572e, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:40.875576 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d700fe-702f-46bf-ad46-2ad894dee21b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:40.893349 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 209/420] 10.222.0.52 () {58 vars in 1442 bytes} [Sun Aug 28 00:41:40 2022] PUT /identity/v3/projects/4e55fe92e3a24b25b164aeab879fa6da/groups/114c7ecc19ff4e4f9653e543a196572e/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:41:40.902151 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d700fe-702f-46bf-ad46-2ad894dee21b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:40.963280 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21df98a-e062-4abf-83be-a08765d6e9a8 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:41.034767 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc221981-4108-4718-900a-15858b633e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:41.035416 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc221981-4108-4718-900a-15858b633e0e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:41.035719 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc221981-4108-4718-900a-15858b633e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:41.036010 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc221981-4108-4718-900a-15858b633e0e None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:41.036871 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc221981-4108-4718-900a-15858b633e0e None admin] RBAC: Adding query filter params (name=member) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:41.037389 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc221981-4108-4718-900a-15858b633e0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:41.039999 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc221981-4108-4718-900a-15858b633e0e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:41.057058 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 212/421] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Aug 28 00:41:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:41:41.068013 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc221981-4108-4718-900a-15858b633e0e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:41.119916 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d700fe-702f-46bf-ad46-2ad894dee21b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:41.167152 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6f25b-682b-4b42-be26-2abf2fef8347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:41.167832 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6f25b-682b-4b42-be26-2abf2fef8347 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:41.168109 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6f25b-682b-4b42-be26-2abf2fef8347 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:41.168377 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6f25b-682b-4b42-be26-2abf2fef8347 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:41.186527 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6f25b-682b-4b42-be26-2abf2fef8347 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:41.192434 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-07b6f25b-682b-4b42-be26-2abf2fef8347 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:41:41.192434 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:41.192434 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:41.192434 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:41.192434 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:41.192434 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:41.192434 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:41.192434 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:41.192434 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:41.192434 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:41.192434 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:41.192434 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:41.192434 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:41.192434 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:41.192434 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:41.192434 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:41.193327 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:41.193327 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:41.193327 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:41.193327 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:41.193327 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:41.193327 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:41.193327 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:41.193327 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:41.193327 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:41.193327 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:41.193327 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:41.193327 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:41.193327 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:41.193327 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:41.193327 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:41.193327 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:41.194170 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:41.194170 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:41.194170 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:41.194170 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:41.194170 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:41.194170 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:41.194170 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:41.194170 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:41.194170 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:41.194170 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:41.194170 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:41:41.194170 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:41.195300 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 210/422] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Aug 28 00:41:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:41.201398 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6f25b-682b-4b42-be26-2abf2fef8347 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:41.206591 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:41.278523 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:41.299506 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc221981-4108-4718-900a-15858b633e0e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:41.352714 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85307eee-0ca6-4625-906b-2231e23af85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:41.353328 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85307eee-0ca6-4625-906b-2231e23af85c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:41.353605 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85307eee-0ca6-4625-906b-2231e23af85c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:41.353899 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85307eee-0ca6-4625-906b-2231e23af85c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:41.413118 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6f25b-682b-4b42-be26-2abf2fef8347 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:41.435854 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85307eee-0ca6-4625-906b-2231e23af85c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:41.437950 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85307eee-0ca6-4625-906b-2231e23af85c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:41.484019 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b792d4-cf6c-4797-a84a-7468c4c8c08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:41.485008 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b792d4-cf6c-4797-a84a-7468c4c8c08b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:41.485473 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b792d4-cf6c-4797-a84a-7468c4c8c08b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:41.485949 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b792d4-cf6c-4797-a84a-7468c4c8c08b None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:41.486927 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b792d4-cf6c-4797-a84a-7468c4c8c08b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:41.487431 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b792d4-cf6c-4797-a84a-7468c4c8c08b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:41.498353 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b792d4-cf6c-4797-a84a-7468c4c8c08b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:41.514213 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 211/423] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:41:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:41.519342 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b792d4-cf6c-4797-a84a-7468c4c8c08b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:41.546756 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:41.563307 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 213/424] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:41:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 00:41:41.571968 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85307eee-0ca6-4625-906b-2231e23af85c None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:41.618790 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:41.659774 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b792d4-cf6c-4797-a84a-7468c4c8c08b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:41.720166 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba5e84-df16-49a4-9978-c53b3db24fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:41.721080 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba5e84-df16-49a4-9978-c53b3db24fbc None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:41.721507 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba5e84-df16-49a4-9978-c53b3db24fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:41.721947 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba5e84-df16-49a4-9978-c53b3db24fbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:41.796482 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85307eee-0ca6-4625-906b-2231e23af85c None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:41.834790 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe6c75-1146-43b6-a8a4-eaa25416aea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:41.835690 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe6c75-1146-43b6-a8a4-eaa25416aea3 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:41.836115 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe6c75-1146-43b6-a8a4-eaa25416aea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:41.837405 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe6c75-1146-43b6-a8a4-eaa25416aea3 None admin] PATH_INFO: `/v3/projects/93e707bfff714b1c80277c83a2ed2c93` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:41.841305 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe6c75-1146-43b6-a8a4-eaa25416aea3 None admin] RBAC: Authorizing `identity:get_project(project_id=93e707bfff714b1c80277c83a2ed2c93)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:41.845980 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe6c75-1146-43b6-a8a4-eaa25416aea3 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:41.849904 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 214/425] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:41 2022] GET /identity/v3/projects/93e707bfff714b1c80277c83a2ed2c93 => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:41.858917 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe6c75-1146-43b6-a8a4-eaa25416aea3 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:41.878772 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba5e84-df16-49a4-9978-c53b3db24fbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:41.880266 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba5e84-df16-49a4-9978-c53b3db24fbc None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:41.971321 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:41.977199 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:42.017387 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 212/426] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:41:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:41:42.024778 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba5e84-df16-49a4-9978-c53b3db24fbc None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:42.096109 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe6c75-1146-43b6-a8a4-eaa25416aea3 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:42.155434 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba5e84-df16-49a4-9978-c53b3db24fbc None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:42.180762 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce0ef5-e334-475d-b5b6-aa98c9dca189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:42.181762 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce0ef5-e334-475d-b5b6-aa98c9dca189 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:42.182135 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce0ef5-e334-475d-b5b6-aa98c9dca189 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:42.182476 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce0ef5-e334-475d-b5b6-aa98c9dca189 None admin] PATH_INFO: `/v3/groups/b5a1d67be7bf41008790f84c11b698d9` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:42.183742 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce0ef5-e334-475d-b5b6-aa98c9dca189 None admin] RBAC: Authorizing `identity:get_group(group_id=b5a1d67be7bf41008790f84c11b698d9)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:42.194941 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce0ef5-e334-475d-b5b6-aa98c9dca189 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:42.196752 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 215/427] 10.222.0.52 () {56 vars in 1180 bytes} [Sun Aug 28 00:41:41 2022] GET /identity/v3/groups/b5a1d67be7bf41008790f84c11b698d9 => generated 226 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:42.200359 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc2511-5897-4a70-bbc1-15b0437f80c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:42.201230 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc2511-5897-4a70-bbc1-15b0437f80c0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:42.202004 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc2511-5897-4a70-bbc1-15b0437f80c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:42.202576 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc2511-5897-4a70-bbc1-15b0437f80c0 None admin] PATH_INFO: `/v3/projects/93e707bfff714b1c80277c83a2ed2c93` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:42.203581 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce0ef5-e334-475d-b5b6-aa98c9dca189 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:42.204254 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc2511-5897-4a70-bbc1-15b0437f80c0 None admin] RBAC: Authorizing `identity:get_project(project_id=93e707bfff714b1c80277c83a2ed2c93)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:42.206218 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc2511-5897-4a70-bbc1-15b0437f80c0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:42.213936 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 213/428] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:42 2022] GET /identity/v3/projects/93e707bfff714b1c80277c83a2ed2c93 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:42.216956 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc2511-5897-4a70-bbc1-15b0437f80c0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:42.258244 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:42.348944 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc2511-5897-4a70-bbc1-15b0437f80c0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:42.372556 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce0ef5-e334-475d-b5b6-aa98c9dca189 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:42.395330 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793b4e6-7f2a-409a-916b-242827bf8b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:42.396548 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793b4e6-7f2a-409a-916b-242827bf8b26 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:42.397015 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793b4e6-7f2a-409a-916b-242827bf8b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:42.397688 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793b4e6-7f2a-409a-916b-242827bf8b26 None admin] PATH_INFO: `/v3/groups/b5a1d67be7bf41008790f84c11b698d9` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:42.399707 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793b4e6-7f2a-409a-916b-242827bf8b26 None admin] RBAC: Authorizing `identity:get_group(group_id=b5a1d67be7bf41008790f84c11b698d9)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:42.401007 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:42.403172 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793b4e6-7f2a-409a-916b-242827bf8b26 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:42.407101 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 214/429] 10.222.0.52 () {56 vars in 1180 bytes} [Sun Aug 28 00:41:42 2022] GET /identity/v3/groups/b5a1d67be7bf41008790f84c11b698d9 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:42.408506 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e7eba-b102-4e24-8c4e-dcf6a2956d22 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:42.408936 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e7eba-b102-4e24-8c4e-dcf6a2956d22 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:42.409352 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e7eba-b102-4e24-8c4e-dcf6a2956d22 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:42.411454 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 215/430] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:42.412410 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e7eba-b102-4e24-8c4e-dcf6a2956d22 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:42.419363 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f8935-1b8b-4f0c-9d45-e6958754b89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:42.420065 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f8935-1b8b-4f0c-9d45-e6958754b89c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:42.420491 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f8935-1b8b-4f0c-9d45-e6958754b89c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:42.420873 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f8935-1b8b-4f0c-9d45-e6958754b89c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:42.421808 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f8935-1b8b-4f0c-9d45-e6958754b89c None admin] RBAC: Adding query filter params (group.id=b5a1d67be7bf41008790f84c11b698d9, role.id=2231e998e50146f4b53b832f2f88c1c8, scope.project.id=93e707bfff714b1c80277c83a2ed2c93) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:42.422207 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f8935-1b8b-4f0c-9d45-e6958754b89c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:42.423830 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f8935-1b8b-4f0c-9d45-e6958754b89c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:42.430385 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 216/431] 10.222.0.52 () {56 vars in 1376 bytes} [Sun Aug 28 00:41:42 2022] GET /identity/v3/role_assignments?group.id=b5a1d67be7bf41008790f84c11b698d9&scope.project.id=93e707bfff714b1c80277c83a2ed2c93&role.id=2231e998e50146f4b53b832f2f88c1c8 => generated 611 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:41:42.431822 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b117821-8e21-4db4-9b00-ddb0449c78ee None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:42.432168 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b117821-8e21-4db4-9b00-ddb0449c78ee None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:42.432503 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b117821-8e21-4db4-9b00-ddb0449c78ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:42.453130 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-5b117821-8e21-4db4-9b00-ddb0449c78ee None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:42.458209 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-5b117821-8e21-4db4-9b00-ddb0449c78ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:42.604575 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 217/432] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:42.617898 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:42.626210 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e7eba-b102-4e24-8c4e-dcf6a2956d22 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:42.663115 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29009e9-601f-4aa0-9994-70ea6e314d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:42.664067 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29009e9-601f-4aa0-9994-70ea6e314d8a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:42.664528 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29009e9-601f-4aa0-9994-70ea6e314d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:42.665083 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29009e9-601f-4aa0-9994-70ea6e314d8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:42.666024 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29009e9-601f-4aa0-9994-70ea6e314d8a None admin] RBAC: Adding query filter params (group.id=b5a1d67be7bf41008790f84c11b698d9, role.id=258091cadd094ad2a608d396036e8869, scope.project.id=93e707bfff714b1c80277c83a2ed2c93) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:42.666549 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29009e9-601f-4aa0-9994-70ea6e314d8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:42.668270 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29009e9-601f-4aa0-9994-70ea6e314d8a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:42.675298 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 216/433] 10.222.0.52 () {56 vars in 1376 bytes} [Sun Aug 28 00:41:42 2022] GET /identity/v3/role_assignments?group.id=b5a1d67be7bf41008790f84c11b698d9&scope.project.id=93e707bfff714b1c80277c83a2ed2c93&role.id=258091cadd094ad2a608d396036e8869 => generated 611 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:42.909468 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b117821-8e21-4db4-9b00-ddb0449c78ee None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:43.018748 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8080502-4823-4642-8d60-00191544bd4f None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:43.019114 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8080502-4823-4642-8d60-00191544bd4f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:43.019296 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8080502-4823-4642-8d60-00191544bd4f None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:43.019557 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b117821-8e21-4db4-9b00-ddb0449c78ee None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:43.020773 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 217/434] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:43.027050 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2a433-b798-4d96-be14-46abc35baf87 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:43.027629 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2a433-b798-4d96-be14-46abc35baf87 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:43.027901 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2a433-b798-4d96-be14-46abc35baf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:43.044815 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:43.052572 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a9b2a433-b798-4d96-be14-46abc35baf87 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:43.054981 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a9b2a433-b798-4d96-be14-46abc35baf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:43.061705 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ce93b-a00b-4c7f-ba2c-222630c9fea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:43.062456 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ce93b-a00b-4c7f-ba2c-222630c9fea2 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:43.062729 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ce93b-a00b-4c7f-ba2c-222630c9fea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:43.062992 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ce93b-a00b-4c7f-ba2c-222630c9fea2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:43.076860 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ce93b-a00b-4c7f-ba2c-222630c9fea2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:43.082089 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-8c7ce93b-a00b-4c7f-ba2c-222630c9fea2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:41:43.082089 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:43.082089 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:43.082089 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:43.082089 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:43.082089 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:43.082089 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:43.082089 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:43.082089 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:43.082089 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:43.082089 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:43.082089 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:43.082089 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:43.082089 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:43.082089 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:43.082089 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:43.083013 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:43.083013 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:43.083013 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:43.083013 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:43.083013 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:43.083013 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:43.083013 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:43.083013 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:43.083013 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:43.083013 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:43.083013 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:43.083013 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:43.083013 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:43.083013 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:43.083013 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:43.083013 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:43.083819 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:43.083819 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:43.083819 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:43.083819 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:43.083819 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:43.083819 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:43.083819 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:43.083819 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:43.083819 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:43.083819 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:43.083819 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:41:43.083819 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:43.083819 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 218/435] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:43.088823 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ce93b-a00b-4c7f-ba2c-222630c9fea2 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:43.156853 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 218/436] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:41:43.214464 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ce93b-a00b-4c7f-ba2c-222630c9fea2 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:43.250391 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605b33f-7de7-4d4b-8c0d-d6091012ee5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:43.250996 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605b33f-7de7-4d4b-8c0d-d6091012ee5c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:43.251269 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605b33f-7de7-4d4b-8c0d-d6091012ee5c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:43.251530 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605b33f-7de7-4d4b-8c0d-d6091012ee5c None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:43.252189 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605b33f-7de7-4d4b-8c0d-d6091012ee5c None admin] RBAC: Adding query filter params (name=member) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:43.252486 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605b33f-7de7-4d4b-8c0d-d6091012ee5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:43.253883 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605b33f-7de7-4d4b-8c0d-d6091012ee5c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:43.262818 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 219/437] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Aug 28 00:41:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:43.268423 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2a433-b798-4d96-be14-46abc35baf87 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:43.364051 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58827bb1-1ff5-4a77-a2ee-110e8b07d545 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:43.364335 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58827bb1-1ff5-4a77-a2ee-110e8b07d545 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:43.364612 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58827bb1-1ff5-4a77-a2ee-110e8b07d545 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:43.366110 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 220/438] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:41:43.370169 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:43.370796 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2025c-2433-40b9-98b6-2507cb8f3cb5 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:43.371081 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2025c-2433-40b9-98b6-2507cb8f3cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:43.371343 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2025c-2433-40b9-98b6-2507cb8f3cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:43.378191 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2a433-b798-4d96-be14-46abc35baf87 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:43.390397 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-72e2025c-2433-40b9-98b6-2507cb8f3cb5 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:43.391594 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-72e2025c-2433-40b9-98b6-2507cb8f3cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:43.413407 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13e7f9-5c51-4674-96b5-99aedb04bd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:43.414052 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13e7f9-5c51-4674-96b5-99aedb04bd15 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:43.414328 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13e7f9-5c51-4674-96b5-99aedb04bd15 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:43.414592 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13e7f9-5c51-4674-96b5-99aedb04bd15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:43.430789 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:43.463664 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 221/439] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:41:43.464406 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2025c-2433-40b9-98b6-2507cb8f3cb5 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:43.486770 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13e7f9-5c51-4674-96b5-99aedb04bd15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:43.488180 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13e7f9-5c51-4674-96b5-99aedb04bd15 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:43.577431 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2025c-2433-40b9-98b6-2507cb8f3cb5 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:43.585929 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:43.593880 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 219/440] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:41:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:41:43.600100 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13e7f9-5c51-4674-96b5-99aedb04bd15 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:43.615605 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71cd1e-6352-4f3c-9efd-b76d6e6535f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:43.616258 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71cd1e-6352-4f3c-9efd-b76d6e6535f3 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:43.616505 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71cd1e-6352-4f3c-9efd-b76d6e6535f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:43.616770 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71cd1e-6352-4f3c-9efd-b76d6e6535f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:43.627792 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb71cd1e-6352-4f3c-9efd-b76d6e6535f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:43.632590 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-bb71cd1e-6352-4f3c-9efd-b76d6e6535f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:41:43.632590 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:43.632590 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:43.632590 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:43.632590 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:43.632590 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:43.632590 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:43.632590 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:43.632590 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:43.632590 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:43.632590 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:43.632590 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:43.632590 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:43.632590 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:43.632590 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:43.632590 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:43.633659 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:43.633659 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:43.633659 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:43.633659 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:43.633659 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:43.633659 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:43.633659 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:43.633659 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:43.633659 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:43.633659 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:43.633659 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:43.633659 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:43.633659 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:43.633659 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:43.633659 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:43.633659 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:43.639404 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:43.639404 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:43.639404 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:43.639404 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:43.639404 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:43.639404 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:43.639404 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:43.639404 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:43.639404 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:43.639404 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:43.639404 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:41:43.639404 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:43.639404 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 222/441] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Aug 28 00:41:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:43.640069 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71cd1e-6352-4f3c-9efd-b76d6e6535f3 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:43.677503 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:43.716809 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13e7f9-5c51-4674-96b5-99aedb04bd15 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:43.749069 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71cd1e-6352-4f3c-9efd-b76d6e6535f3 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:43.752651 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279183f3-030f-49e9-a7e8-7ed7615ceedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:43.753354 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279183f3-030f-49e9-a7e8-7ed7615ceedf None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:43.753698 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279183f3-030f-49e9-a7e8-7ed7615ceedf None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:43.754071 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279183f3-030f-49e9-a7e8-7ed7615ceedf None admin] PATH_INFO: `/v3/projects/ad187f94c1d9456e9c97f78a7f686485` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:43.755191 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279183f3-030f-49e9-a7e8-7ed7615ceedf None admin] RBAC: Authorizing `identity:get_project(project_id=ad187f94c1d9456e9c97f78a7f686485)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:43.756664 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279183f3-030f-49e9-a7e8-7ed7615ceedf None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:43.758338 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 220/442] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:43 2022] GET /identity/v3/projects/ad187f94c1d9456e9c97f78a7f686485 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:41:43.762820 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279183f3-030f-49e9-a7e8-7ed7615ceedf None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:43.783546 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2895c4-1643-4d85-bce6-a3e3f179e148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:43.784228 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2895c4-1643-4d85-bce6-a3e3f179e148 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:43.784510 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2895c4-1643-4d85-bce6-a3e3f179e148 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:43.784780 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2895c4-1643-4d85-bce6-a3e3f179e148 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:43.785431 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2895c4-1643-4d85-bce6-a3e3f179e148 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:43.785730 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2895c4-1643-4d85-bce6-a3e3f179e148 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:43.787161 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2895c4-1643-4d85-bce6-a3e3f179e148 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:43.794931 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 223/443] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:41:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:43.798768 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2895c4-1643-4d85-bce6-a3e3f179e148 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:43.823140 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:43.862018 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279183f3-030f-49e9-a7e8-7ed7615ceedf None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:43.891006 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:43.896362 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b40d2-4d21-4e95-ad21-358b867b0560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:43.896986 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b40d2-4d21-4e95-ad21-358b867b0560 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:43.897261 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b40d2-4d21-4e95-ad21-358b867b0560 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:43.897529 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b40d2-4d21-4e95-ad21-358b867b0560 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:43.898470 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2895c4-1643-4d85-bce6-a3e3f179e148 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:43.908537 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b40d2-4d21-4e95-ad21-358b867b0560 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:43.914416 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-fe6b40d2-4d21-4e95-ad21-358b867b0560 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:41:43.914416 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:43.914416 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:43.914416 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:43.914416 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:43.914416 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:43.914416 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:43.914416 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:43.914416 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:43.914416 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:43.914416 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:43.914416 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:43.914416 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:43.914416 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:43.914416 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:43.914416 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:43.915435 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:43.915435 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:43.915435 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:43.915435 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:43.915435 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:43.915435 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:43.915435 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:43.915435 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:43.915435 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:43.915435 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:43.915435 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:43.915435 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:43.915435 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:43.915435 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:43.915435 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:43.915435 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:43.916247 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:43.916247 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:43.916247 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:43.916247 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:43.916247 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:43.916247 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:43.916247 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:43.916247 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:43.916247 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:43.916247 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:43.916247 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:41:43.916247 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:43.916247 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 221/444] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:41:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:43.916913 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b40d2-4d21-4e95-ad21-358b867b0560 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:43.939039 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9dcb2-e40f-4ff0-9013-4549d4023604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:43.939651 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9dcb2-e40f-4ff0-9013-4549d4023604 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:43.939952 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9dcb2-e40f-4ff0-9013-4549d4023604 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:43.940223 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9dcb2-e40f-4ff0-9013-4549d4023604 None admin] PATH_INFO: `/v3/groups/b5a1d67be7bf41008790f84c11b698d9` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:43.941463 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9dcb2-e40f-4ff0-9013-4549d4023604 None admin] RBAC: Authorizing `identity:get_group(group_id=b5a1d67be7bf41008790f84c11b698d9)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:43.942977 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9dcb2-e40f-4ff0-9013-4549d4023604 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:43.944579 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 224/445] 10.222.0.52 () {56 vars in 1180 bytes} [Sun Aug 28 00:41:43 2022] GET /identity/v3/groups/b5a1d67be7bf41008790f84c11b698d9 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:43.946734 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9dcb2-e40f-4ff0-9013-4549d4023604 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:44.021791 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b40d2-4d21-4e95-ad21-358b867b0560 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:44.044169 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:44.046644 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9dcb2-e40f-4ff0-9013-4549d4023604 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:44.055871 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e671b-4659-4187-bf5d-9e15d8d49533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:44.056471 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e671b-4659-4187-bf5d-9e15d8d49533 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:44.056750 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e671b-4659-4187-bf5d-9e15d8d49533 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:44.057025 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e671b-4659-4187-bf5d-9e15d8d49533 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:44.080141 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaad539-32d9-48e0-ac00-8096b537d8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:44.080742 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaad539-32d9-48e0-ac00-8096b537d8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:44.081022 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaad539-32d9-48e0-ac00-8096b537d8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:44.081292 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaad539-32d9-48e0-ac00-8096b537d8e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:44.081982 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaad539-32d9-48e0-ac00-8096b537d8e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:44.082287 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaad539-32d9-48e0-ac00-8096b537d8e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:44.083681 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaad539-32d9-48e0-ac00-8096b537d8e1 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:44.091537 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 225/446] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:44.092433 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaad539-32d9-48e0-ac00-8096b537d8e1 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:44.121075 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:44.127656 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e671b-4659-4187-bf5d-9e15d8d49533 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:44.129144 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e671b-4659-4187-bf5d-9e15d8d49533 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:44.194618 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaad539-32d9-48e0-ac00-8096b537d8e1 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:44.227755 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 222/447] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:41:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:41:44.228613 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e671b-4659-4187-bf5d-9e15d8d49533 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:44.231175 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84126b4d-8bd6-47d0-88d0-6d1c636dc1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:44.231789 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84126b4d-8bd6-47d0-88d0-6d1c636dc1a3 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:44.232069 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84126b4d-8bd6-47d0-88d0-6d1c636dc1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:44.232337 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84126b4d-8bd6-47d0-88d0-6d1c636dc1a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:44.233217 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84126b4d-8bd6-47d0-88d0-6d1c636dc1a3 None admin] RBAC: Adding query filter params (group.id=b5a1d67be7bf41008790f84c11b698d9, role.id=2231e998e50146f4b53b832f2f88c1c8, scope.project.id=ad187f94c1d9456e9c97f78a7f686485) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:44.233821 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84126b4d-8bd6-47d0-88d0-6d1c636dc1a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:44.235120 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84126b4d-8bd6-47d0-88d0-6d1c636dc1a3 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:44.244954 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 226/448] 10.222.0.52 () {56 vars in 1376 bytes} [Sun Aug 28 00:41:44 2022] GET /identity/v3/role_assignments?group.id=b5a1d67be7bf41008790f84c11b698d9&scope.project.id=ad187f94c1d9456e9c97f78a7f686485&role.id=2231e998e50146f4b53b832f2f88c1c8 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:44.244954 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84126b4d-8bd6-47d0-88d0-6d1c636dc1a3 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:44.262402 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:44.348260 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e671b-4659-4187-bf5d-9e15d8d49533 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:44.364048 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:44.379312 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84126b4d-8bd6-47d0-88d0-6d1c636dc1a3 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:44.392230 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61781b7-d304-4731-8a73-07e975943ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:44.392930 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61781b7-d304-4731-8a73-07e975943ffc None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:44.393271 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61781b7-d304-4731-8a73-07e975943ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:44.393606 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61781b7-d304-4731-8a73-07e975943ffc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:44.421378 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1432b6-27f8-4f8f-b539-1c8178e006f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:44.421850 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1432b6-27f8-4f8f-b539-1c8178e006f4 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:44.422222 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1432b6-27f8-4f8f-b539-1c8178e006f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:44.422548 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1432b6-27f8-4f8f-b539-1c8178e006f4 None admin] PATH_INFO: `/v3/projects/ad187f94c1d9456e9c97f78a7f686485` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:44.423766 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1432b6-27f8-4f8f-b539-1c8178e006f4 None admin] RBAC: Authorizing `identity:get_project(project_id=ad187f94c1d9456e9c97f78a7f686485)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:44.425394 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1432b6-27f8-4f8f-b539-1c8178e006f4 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:44.426964 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 227/449] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:44 2022] GET /identity/v3/projects/ad187f94c1d9456e9c97f78a7f686485 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:44.432843 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1432b6-27f8-4f8f-b539-1c8178e006f4 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:44.475380 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61781b7-d304-4731-8a73-07e975943ffc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:44.477114 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61781b7-d304-4731-8a73-07e975943ffc None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:44.507401 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:44.546368 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1432b6-27f8-4f8f-b539-1c8178e006f4 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:44.585280 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542291e-2df9-4c16-98b5-37cd2c974563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:44.585954 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542291e-2df9-4c16-98b5-37cd2c974563 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:44.586236 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542291e-2df9-4c16-98b5-37cd2c974563 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:44.586504 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542291e-2df9-4c16-98b5-37cd2c974563 None admin] PATH_INFO: `/v3/groups/b5a1d67be7bf41008790f84c11b698d9` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:44.587681 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542291e-2df9-4c16-98b5-37cd2c974563 None admin] RBAC: Authorizing `identity:get_group(group_id=b5a1d67be7bf41008790f84c11b698d9)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:44.589146 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542291e-2df9-4c16-98b5-37cd2c974563 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:44.590895 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 228/450] 10.222.0.52 () {56 vars in 1180 bytes} [Sun Aug 28 00:41:44 2022] GET /identity/v3/groups/b5a1d67be7bf41008790f84c11b698d9 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:44.597912 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542291e-2df9-4c16-98b5-37cd2c974563 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:44.610630 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 223/451] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:41:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:41:44.616130 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61781b7-d304-4731-8a73-07e975943ffc None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:44.624264 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:44.700238 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542291e-2df9-4c16-98b5-37cd2c974563 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:44.715981 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61781b7-d304-4731-8a73-07e975943ffc None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:44.736483 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f3c26-584d-48fb-ab3c-4ec2bcccf0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:44.737086 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f3c26-584d-48fb-ab3c-4ec2bcccf0d4 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:44.737364 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f3c26-584d-48fb-ab3c-4ec2bcccf0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:44.737636 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f3c26-584d-48fb-ab3c-4ec2bcccf0d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:44.738403 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f3c26-584d-48fb-ab3c-4ec2bcccf0d4 None admin] RBAC: Adding query filter params (group.id=b5a1d67be7bf41008790f84c11b698d9, role.id=258091cadd094ad2a608d396036e8869, scope.project.id=ad187f94c1d9456e9c97f78a7f686485) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:44.738711 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f3c26-584d-48fb-ab3c-4ec2bcccf0d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:44.738820 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:44.740610 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f3c26-584d-48fb-ab3c-4ec2bcccf0d4 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:44.746471 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 229/452] 10.222.0.52 () {56 vars in 1376 bytes} [Sun Aug 28 00:41:44 2022] GET /identity/v3/role_assignments?group.id=b5a1d67be7bf41008790f84c11b698d9&scope.project.id=ad187f94c1d9456e9c97f78a7f686485&role.id=258091cadd094ad2a608d396036e8869 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:41:44.750938 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a3564-2a41-4e4c-b15d-6469474ab17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:44.751794 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a3564-2a41-4e4c-b15d-6469474ab17e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:44.752154 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a3564-2a41-4e4c-b15d-6469474ab17e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:44.752489 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a3564-2a41-4e4c-b15d-6469474ab17e None admin] PATH_INFO: `/v3/projects/4e55fe92e3a24b25b164aeab879fa6da` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:44.753745 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a3564-2a41-4e4c-b15d-6469474ab17e None admin] RBAC: Authorizing `identity:get_project(project_id=4e55fe92e3a24b25b164aeab879fa6da)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:44.755340 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a3564-2a41-4e4c-b15d-6469474ab17e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:44.757111 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 224/453] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:41:44 2022] GET /identity/v3/projects/4e55fe92e3a24b25b164aeab879fa6da => generated 344 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:41:44.763129 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f3c26-584d-48fb-ab3c-4ec2bcccf0d4 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:44.863788 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:44.878020 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f3c26-584d-48fb-ab3c-4ec2bcccf0d4 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:44.912906 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c7f8c-c6f8-413b-8c97-620420ecc8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:44.913527 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c7f8c-c6f8-413b-8c97-620420ecc8ae None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:44.913799 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c7f8c-c6f8-413b-8c97-620420ecc8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:44.914119 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c7f8c-c6f8-413b-8c97-620420ecc8ae None admin] PATH_INFO: `/v3/groups/114c7ecc19ff4e4f9653e543a196572e` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:44.915239 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c7f8c-c6f8-413b-8c97-620420ecc8ae None admin] RBAC: Authorizing `identity:get_group(group_id=114c7ecc19ff4e4f9653e543a196572e)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:44.916675 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c7f8c-c6f8-413b-8c97-620420ecc8ae None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:44.918252 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 230/454] 10.222.0.52 () {56 vars in 1180 bytes} [Sun Aug 28 00:41:44 2022] GET /identity/v3/groups/114c7ecc19ff4e4f9653e543a196572e => generated 229 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:44.924617 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a3564-2a41-4e4c-b15d-6469474ab17e None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:45.028325 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a3564-2a41-4e4c-b15d-6469474ab17e None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:45.063361 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8eda8-454b-44e7-aa0e-87d785f84970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:45.064258 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8eda8-454b-44e7-aa0e-87d785f84970 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:45.064533 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8eda8-454b-44e7-aa0e-87d785f84970 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:45.064796 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8eda8-454b-44e7-aa0e-87d785f84970 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:45.065524 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8eda8-454b-44e7-aa0e-87d785f84970 None admin] RBAC: Adding query filter params (group.id=114c7ecc19ff4e4f9653e543a196572e, role.id=cc013581bb07418d9ec6a3a1d282ea53, scope.project.id=4e55fe92e3a24b25b164aeab879fa6da) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:45.065829 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8eda8-454b-44e7-aa0e-87d785f84970 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:45.067305 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8eda8-454b-44e7-aa0e-87d785f84970 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:45.073593 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 225/455] 10.222.0.52 () {56 vars in 1376 bytes} [Sun Aug 28 00:41:44 2022] GET /identity/v3/role_assignments?group.id=114c7ecc19ff4e4f9653e543a196572e&scope.project.id=4e55fe92e3a24b25b164aeab879fa6da&role.id=cc013581bb07418d9ec6a3a1d282ea53 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:47.350745 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818faf4-5579-4cd8-937e-af367a90b302 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:47.351805 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818faf4-5579-4cd8-937e-af367a90b302 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:47.352286 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818faf4-5579-4cd8-937e-af367a90b302 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:47.354114 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 231/456] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:47.361297 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5babc0c-0ac3-40b2-ac46-87aa03290246 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:47.362203 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5babc0c-0ac3-40b2-ac46-87aa03290246 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:47.362693 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5babc0c-0ac3-40b2-ac46-87aa03290246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:47.393926 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c5babc0c-0ac3-40b2-ac46-87aa03290246 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:47.395516 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c5babc0c-0ac3-40b2-ac46-87aa03290246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:47.457989 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:47.484484 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 226/457] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:47.491631 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123dfb5-d4fd-4f23-b219-22c8aaf131da None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:47.491922 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123dfb5-d4fd-4f23-b219-22c8aaf131da None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:47.492256 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123dfb5-d4fd-4f23-b219-22c8aaf131da None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:47.493740 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 232/458] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:47.498817 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd8636-48b9-4a19-bc8f-3ea7bcd1e963 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:47.499098 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd8636-48b9-4a19-bc8f-3ea7bcd1e963 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:47.499448 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd8636-48b9-4a19-bc8f-3ea7bcd1e963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:47.522924 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-d1dd8636-48b9-4a19-bc8f-3ea7bcd1e963 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:47.524127 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d1dd8636-48b9-4a19-bc8f-3ea7bcd1e963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:47.615158 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 227/459] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:47.672463 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c20bf-28cb-4554-9cc5-74bd3523d912 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:47.672806 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c20bf-28cb-4554-9cc5-74bd3523d912 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:47.673026 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c20bf-28cb-4554-9cc5-74bd3523d912 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:47.674468 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 233/460] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:47.681736 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c68a2-ccf7-4e29-a9bd-d353db2bda47 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:47.682053 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c68a2-ccf7-4e29-a9bd-d353db2bda47 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:47.682331 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c68a2-ccf7-4e29-a9bd-d353db2bda47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:47.710883 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-800c68a2-ccf7-4e29-a9bd-d353db2bda47 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:47.712083 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-800c68a2-ccf7-4e29-a9bd-d353db2bda47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:47.796692 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 228/461] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:47.896788 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c20bf-28cb-4554-9cc5-74bd3523d912 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:47.987146 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c68a2-ccf7-4e29-a9bd-d353db2bda47 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:48.020568 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c20bf-28cb-4554-9cc5-74bd3523d912 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:48.055809 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21516078-42b6-4158-b10f-4f2d2b764b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:48.056501 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21516078-42b6-4158-b10f-4f2d2b764b04 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:48.056719 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21516078-42b6-4158-b10f-4f2d2b764b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:48.057013 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21516078-42b6-4158-b10f-4f2d2b764b04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:48.068498 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21516078-42b6-4158-b10f-4f2d2b764b04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:48.070029 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21516078-42b6-4158-b10f-4f2d2b764b04 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:48.084900 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-21516078-42b6-4158-b10f-4f2d2b764b04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:48.084900 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:48.084900 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:48.084900 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:48.084900 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:48.084900 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:48.084900 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:48.084900 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:48.084900 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:48.084900 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:48.084900 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:48.084900 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:48.084900 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:41:48.084900 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:41:48.084900 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:41:48.084900 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:41:48.086012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:48.086012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:48.086012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:48.086012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:48.086012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:48.086012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:48.086012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:48.086012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:48.086012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:48.086012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:48.086012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:48.086012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:48.086012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:48.086012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:48.086012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:48.086012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:48.086012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:41:48.087534 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:41:48.087534 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:48.087534 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:48.087534 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 234/462] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:41:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:48.091647 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21516078-42b6-4158-b10f-4f2d2b764b04 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:48.107531 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:48.113503 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:48.189975 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c68a2-ccf7-4e29-a9bd-d353db2bda47 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:48.233991 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3299f89-a98c-4011-9f23-933b37f3d533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:48.234969 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3299f89-a98c-4011-9f23-933b37f3d533 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:48.235491 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3299f89-a98c-4011-9f23-933b37f3d533 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:48.236043 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3299f89-a98c-4011-9f23-933b37f3d533 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:48.245460 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21516078-42b6-4158-b10f-4f2d2b764b04 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:48.247693 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3299f89-a98c-4011-9f23-933b37f3d533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:48.249620 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3299f89-a98c-4011-9f23-933b37f3d533 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:48.266744 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-e3299f89-a98c-4011-9f23-933b37f3d533 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:48.266744 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:48.266744 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:48.266744 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:48.266744 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:48.266744 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:48.266744 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:48.266744 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:48.266744 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:48.266744 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:48.266744 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:48.266744 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:48.266744 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:41:48.266744 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:41:48.266744 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:41:48.266744 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:41:48.267670 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:48.267670 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:48.267670 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:48.267670 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:48.267670 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:48.267670 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:48.267670 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:48.267670 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:48.267670 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:48.267670 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:48.267670 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:48.267670 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:48.267670 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:48.267670 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:48.267670 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:48.267670 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:48.267670 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:41:48.268588 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:41:48.268588 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:48.268588 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:48.271058 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 229/463] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:41:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:48.272124 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3299f89-a98c-4011-9f23-933b37f3d533 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:48.282431 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7ffb9-672d-4743-b919-e700837ac64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:48.283028 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7ffb9-672d-4743-b919-e700837ac64f None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:48.283332 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7ffb9-672d-4743-b919-e700837ac64f None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:48.283903 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7ffb9-672d-4743-b919-e700837ac64f None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:48.284231 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7ffb9-672d-4743-b919-e700837ac64f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:48.284532 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7ffb9-672d-4743-b919-e700837ac64f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:48.285966 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7ffb9-672d-4743-b919-e700837ac64f None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:48.298884 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 235/464] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:48.299783 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7ffb9-672d-4743-b919-e700837ac64f None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:48.371285 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:48.383817 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:48.392214 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3299f89-a98c-4011-9f23-933b37f3d533 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:48.407085 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7ffb9-672d-4743-b919-e700837ac64f None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:48.429787 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157de2e5-e1de-4d26-b646-c9b974ea60b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:48.430900 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157de2e5-e1de-4d26-b646-c9b974ea60b2 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:48.431466 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157de2e5-e1de-4d26-b646-c9b974ea60b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:48.431950 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157de2e5-e1de-4d26-b646-c9b974ea60b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:48.444220 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e84ec2-bb94-477c-8d3d-cd3d1141064e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:48.444764 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e84ec2-bb94-477c-8d3d-cd3d1141064e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:48.445043 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e84ec2-bb94-477c-8d3d-cd3d1141064e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:48.445315 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e84ec2-bb94-477c-8d3d-cd3d1141064e None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:48.445635 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157de2e5-e1de-4d26-b646-c9b974ea60b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:48.446053 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e84ec2-bb94-477c-8d3d-cd3d1141064e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:48.446356 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e84ec2-bb94-477c-8d3d-cd3d1141064e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:48.447779 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157de2e5-e1de-4d26-b646-c9b974ea60b2 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:48.447884 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e84ec2-bb94-477c-8d3d-cd3d1141064e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:48.459896 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 236/465] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:48.460826 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e84ec2-bb94-477c-8d3d-cd3d1141064e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:48.464883 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-157de2e5-e1de-4d26-b646-c9b974ea60b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:48.464883 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:48.464883 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:48.464883 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:48.464883 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:48.464883 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:48.464883 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:48.464883 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:48.464883 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:48.464883 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:48.464883 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:48.464883 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:48.464883 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:41:48.464883 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:41:48.464883 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:41:48.464883 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:41:48.465996 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:48.465996 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:48.465996 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:48.465996 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:48.465996 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:48.465996 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:48.465996 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:48.465996 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:48.465996 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:48.465996 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:48.465996 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:48.465996 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:48.465996 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:48.465996 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:48.465996 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:48.465996 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:48.465996 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:41:48.466845 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:41:48.466845 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:48.466845 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:48.468461 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 230/466] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:41:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:48.470157 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157de2e5-e1de-4d26-b646-c9b974ea60b2 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:48.579400 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e84ec2-bb94-477c-8d3d-cd3d1141064e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:48.583251 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157de2e5-e1de-4d26-b646-c9b974ea60b2 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:48.608525 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:48.616546 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec588a4-a0c3-4d3f-87ef-629f537ab121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:48.617159 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec588a4-a0c3-4d3f-87ef-629f537ab121 None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:48.617440 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec588a4-a0c3-4d3f-87ef-629f537ab121 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:48.617718 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec588a4-a0c3-4d3f-87ef-629f537ab121 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:48.618399 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec588a4-a0c3-4d3f-87ef-629f537ab121 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:48.619848 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec588a4-a0c3-4d3f-87ef-629f537ab121 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:48.623750 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a1147-cd39-4dde-8ecf-4654aeb6c0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:48.624205 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a1147-cd39-4dde-8ecf-4654aeb6c0d4 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:48.624481 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a1147-cd39-4dde-8ecf-4654aeb6c0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:48.624751 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a1147-cd39-4dde-8ecf-4654aeb6c0d4 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:48.625399 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a1147-cd39-4dde-8ecf-4654aeb6c0d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:48.626875 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a1147-cd39-4dde-8ecf-4654aeb6c0d4 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:48.641332 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 237/467] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Aug 28 00:41:48 2022] POST /identity/v3/users => generated 246 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:41:48.642678 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77656c-983c-403c-b5c4-c96a7b04f28f None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:48.642975 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77656c-983c-403c-b5c4-c96a7b04f28f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:48.643450 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77656c-983c-403c-b5c4-c96a7b04f28f None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:48.649210 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 238/468] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:48.649210 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77656c-983c-403c-b5c4-c96a7b04f28f None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:48.677868 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 231/469] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Aug 28 00:41:48 2022] POST /identity/v3/users => generated 248 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:41:48.677868 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491db2fc-25ac-49f8-b0d4-3dc3103289be None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:48.677868 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491db2fc-25ac-49f8-b0d4-3dc3103289be None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:48.677868 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491db2fc-25ac-49f8-b0d4-3dc3103289be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:48.691096 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:48.712096 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-491db2fc-25ac-49f8-b0d4-3dc3103289be None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:48.715323 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-491db2fc-25ac-49f8-b0d4-3dc3103289be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:48.834798 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77656c-983c-403c-b5c4-c96a7b04f28f None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:48.872945 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 232/470] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:48.884407 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ffba74-87a5-4a4c-b552-495889a6d791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:48.885020 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffba74-87a5-4a4c-b552-495889a6d791 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:48.885297 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffba74-87a5-4a4c-b552-495889a6d791 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:48.885569 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffba74-87a5-4a4c-b552-495889a6d791 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:48.886270 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ffba74-87a5-4a4c-b552-495889a6d791 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:48.886572 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ffba74-87a5-4a4c-b552-495889a6d791 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:48.887955 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ffba74-87a5-4a4c-b552-495889a6d791 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:48.900970 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 239/471] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:48.906504 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491db2fc-25ac-49f8-b0d4-3dc3103289be None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:48.993518 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e86dd-2996-48e5-8e8f-3c938ccdd9a2 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:48.994145 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e86dd-2996-48e5-8e8f-3c938ccdd9a2 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:48.994595 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e86dd-2996-48e5-8e8f-3c938ccdd9a2 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:48.996549 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 240/472] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:49.002496 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24bfc7-fede-4da4-88b3-fd8b934ffbe0 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:49.002780 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24bfc7-fede-4da4-88b3-fd8b934ffbe0 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:49.003053 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24bfc7-fede-4da4-88b3-fd8b934ffbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:49.019985 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491db2fc-25ac-49f8-b0d4-3dc3103289be None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:49.023620 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-ec24bfc7-fede-4da4-88b3-fd8b934ffbe0 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:49.024515 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ec24bfc7-fede-4da4-88b3-fd8b934ffbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:49.072813 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:49.078880 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d14d4-a1ab-4074-9cb2-3bf84faf5113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:49.080007 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d14d4-a1ab-4074-9cb2-3bf84faf5113 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:49.080292 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d14d4-a1ab-4074-9cb2-3bf84faf5113 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:49.080566 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d14d4-a1ab-4074-9cb2-3bf84faf5113 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:49.081487 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d14d4-a1ab-4074-9cb2-3bf84faf5113 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:49.083754 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d14d4-a1ab-4074-9cb2-3bf84faf5113 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:49.094048 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:49.109135 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 241/473] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:49.112960 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 233/474] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Aug 28 00:41:48 2022] POST /identity/v3/users => generated 248 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:41:49.198678 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24bfc7-fede-4da4-88b3-fd8b934ffbe0 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:49.333291 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24bfc7-fede-4da4-88b3-fd8b934ffbe0 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:49.369974 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508538f-7393-4373-b853-f460bc1653a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:49.370864 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508538f-7393-4373-b853-f460bc1653a1 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:49.371288 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508538f-7393-4373-b853-f460bc1653a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:49.371701 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508538f-7393-4373-b853-f460bc1653a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:49.383445 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d14d4-a1ab-4074-9cb2-3bf84faf5113 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:49.383789 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f508538f-7393-4373-b853-f460bc1653a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:49.385424 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f508538f-7393-4373-b853-f460bc1653a1 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:49.403582 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-f508538f-7393-4373-b853-f460bc1653a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:49.403582 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:49.403582 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:49.403582 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:49.403582 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:49.403582 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:49.403582 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:49.403582 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:49.403582 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:49.403582 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:49.403582 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:49.403582 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:49.403582 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:41:49.403582 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:41:49.403582 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:41:49.403582 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:41:49.404916 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:49.404916 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:49.404916 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:49.404916 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:49.404916 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:49.404916 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:49.404916 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:49.404916 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:49.404916 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:49.404916 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:49.404916 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:49.404916 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:49.404916 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:49.404916 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:49.404916 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:49.404916 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:49.404916 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:41:49.406125 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:41:49.406125 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:49.406125 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:49.407997 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 242/475] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:49.413463 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508538f-7393-4373-b853-f460bc1653a1 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:49.465617 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:49.510662 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d14d4-a1ab-4074-9cb2-3bf84faf5113 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:49.531249 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508538f-7393-4373-b853-f460bc1653a1 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:49.550013 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9448deb-c209-4a31-a7bd-76360df6970f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:49.550874 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9448deb-c209-4a31-a7bd-76360df6970f None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:49.551320 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9448deb-c209-4a31-a7bd-76360df6970f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:49.551731 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9448deb-c209-4a31-a7bd-76360df6970f None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:49.552542 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9448deb-c209-4a31-a7bd-76360df6970f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:49.554115 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9448deb-c209-4a31-a7bd-76360df6970f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:49.564329 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.sql.core [None req-e9448deb-c209-4a31-a7bd-76360df6970f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 28 00:41:49.564329 dv-cinder-master-3-smb devstack@keystone.service[81517]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 28 00:41:49.564329 dv-cinder-master-3-smb devstack@keystone.service[81517]: [parameters: {'id': 'b4c93c49bfd4493d8e29f62a66241cdf', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 28 00:41:49.564329 dv-cinder-master-3-smb devstack@keystone.service[81517]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81517) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 28 00:41:49.574925 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4098ac-401b-41e4-ab06-4ad11a09f5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:49.575842 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4098ac-401b-41e4-ab06-4ad11a09f5a6 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:49.576360 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4098ac-401b-41e4-ab06-4ad11a09f5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:49.576865 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4098ac-401b-41e4-ab06-4ad11a09f5a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:49.577769 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4098ac-401b-41e4-ab06-4ad11a09f5a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:49.578344 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4098ac-401b-41e4-ab06-4ad11a09f5a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:49.579997 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4098ac-401b-41e4-ab06-4ad11a09f5a6 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:49.582021 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-e9448deb-c209-4a31-a7bd-76360df6970f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 28 00:41:49.582021 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:49.582021 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 00:41:49.582021 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 00:41:49.582021 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 00:41:49.582021 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 00:41:49.582021 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 00:41:49.582021 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 00:41:49.582021 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 00:41:49.582021 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application conn.query(q) Aug 28 00:41:49.582021 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 00:41:49.582021 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 00:41:49.582021 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 00:41:49.582021 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application result.read() Aug 28 00:41:49.582021 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 00:41:49.582929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 00:41:49.582929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 00:41:49.582929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 00:41:49.582929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 00:41:49.582929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 00:41:49.582929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 00:41:49.582929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 00:41:49.582929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 28 00:41:49.582929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:49.582929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 28 00:41:49.582929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:49.582929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:49.582929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 00:41:49.582929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 00:41:49.582929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 28 00:41:49.582929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return ref.to_dict() Aug 28 00:41:49.582929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 00:41:49.582929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application next(self.gen) Aug 28 00:41:49.583893 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 00:41:49.583893 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application yield resource Aug 28 00:41:49.583893 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 00:41:49.583893 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application next(self.gen) Aug 28 00:41:49.583893 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 00:41:49.583893 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 00:41:49.583893 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 00:41:49.583893 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 00:41:49.583893 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 00:41:49.583893 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise self.value Aug 28 00:41:49.583893 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 00:41:49.583893 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 00:41:49.583893 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 00:41:49.583893 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application session.commit() Aug 28 00:41:49.583893 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 00:41:49.583893 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 00:41:49.583893 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 00:41:49.584766 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 00:41:49.584766 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 00:41:49.584766 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self.session.flush() Aug 28 00:41:49.584766 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 00:41:49.584766 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 00:41:49.584766 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 00:41:49.584766 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 00:41:49.584766 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 00:41:49.584766 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application compat.raise_( Aug 28 00:41:49.584766 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 00:41:49.584766 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception Aug 28 00:41:49.584766 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 00:41:49.584766 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 00:41:49.584766 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 00:41:49.584766 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 00:41:49.584766 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 28 00:41:49.584766 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 28 00:41:49.585675 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 28 00:41:49.585675 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 28 00:41:49.585675 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 28 00:41:49.585675 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 28 00:41:49.585675 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 28 00:41:49.585675 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 28 00:41:49.585675 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 28 00:41:49.585675 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 28 00:41:49.585675 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 28 00:41:49.585675 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 28 00:41:49.585675 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 28 00:41:49.585675 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 28 00:41:49.585675 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 28 00:41:49.585675 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 28 00:41:49.585675 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 00:41:49.585675 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception Aug 28 00:41:49.586542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 00:41:49.586542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 00:41:49.586542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 00:41:49.586542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 00:41:49.586542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 00:41:49.586542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 00:41:49.586542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 00:41:49.586542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application conn.query(q) Aug 28 00:41:49.586542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 00:41:49.586542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 00:41:49.586542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 00:41:49.586542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application result.read() Aug 28 00:41:49.586542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 00:41:49.586542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 00:41:49.586542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 00:41:49.586542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 00:41:49.587334 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 00:41:49.587334 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 00:41:49.587334 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 00:41:49.587334 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 00:41:49.587334 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 28 00:41:49.587334 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 28 00:41:49.587334 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [parameters: {'id': 'b4c93c49bfd4493d8e29f62a66241cdf', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 28 00:41:49.587334 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 28 00:41:49.587334 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:49.587334 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:41:49.587334 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:49.587334 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:49.587334 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:49.587334 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:49.587334 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:49.587334 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:49.588142 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:49.588142 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:49.588142 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:49.588142 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:49.588142 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:49.588142 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:49.588142 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 28 00:41:49.588142 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 28 00:41:49.588142 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:49.588142 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:49.588142 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 28 00:41:49.588142 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 28 00:41:49.588142 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 28 00:41:49.588142 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 28 00:41:49.588142 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 28 00:41:49.588142 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:49.594018 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 234/476] 10.222.0.52 () {60 vars in 1131 bytes} [Sun Aug 28 00:41:49 2022] POST /identity/v3/roles => generated 144 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:41:49.594018 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9448deb-c209-4a31-a7bd-76360df6970f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:49.609416 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 243/477] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:49.615057 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4098ac-401b-41e4-ab06-4ad11a09f5a6 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:49.705110 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:49.764757 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9448deb-c209-4a31-a7bd-76360df6970f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:49.782283 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:49.799892 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f407b-b837-44cb-adbe-1708f0d8c905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:49.800869 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f407b-b837-44cb-adbe-1708f0d8c905 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:49.801361 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f407b-b837-44cb-adbe-1708f0d8c905 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:49.801862 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f407b-b837-44cb-adbe-1708f0d8c905 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:49.807398 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4098ac-401b-41e4-ab06-4ad11a09f5a6 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:49.813316 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f407b-b837-44cb-adbe-1708f0d8c905 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:49.818918 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-dd9f407b-b837-44cb-adbe-1708f0d8c905 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:41:49.818918 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:49.818918 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:49.818918 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:49.818918 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:49.818918 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:49.818918 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:49.818918 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:49.818918 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:49.818918 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:49.818918 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:49.818918 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:49.818918 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:49.818918 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:49.818918 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:49.818918 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:49.819832 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:49.819832 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:49.819832 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:49.819832 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:49.819832 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:49.819832 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:49.819832 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:49.819832 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:49.819832 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:49.819832 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:49.819832 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:49.819832 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:49.819832 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:49.819832 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:49.819832 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:49.819832 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:49.820641 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:49.820641 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:49.820641 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:49.820641 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:49.820641 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:49.820641 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:49.820641 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:49.820641 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:49.820641 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:49.820641 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:49.820641 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:41:49.820641 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:49.823292 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 235/478] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Aug 28 00:41:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:49.829259 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f407b-b837-44cb-adbe-1708f0d8c905 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:49.857983 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30b103-fad5-4e03-b6e1-7df54a742122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:49.857983 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30b103-fad5-4e03-b6e1-7df54a742122 None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:49.857983 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30b103-fad5-4e03-b6e1-7df54a742122 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:49.857983 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30b103-fad5-4e03-b6e1-7df54a742122 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:49.858359 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc30b103-fad5-4e03-b6e1-7df54a742122 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:49.858359 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc30b103-fad5-4e03-b6e1-7df54a742122 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:49.878508 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 244/479] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Aug 28 00:41:49 2022] POST /identity/v3/users => generated 249 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:41:50.012762 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f407b-b837-44cb-adbe-1708f0d8c905 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:50.030052 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:50.054689 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252493d4-7808-4ffd-88b3-aafc0410dd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:50.055638 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252493d4-7808-4ffd-88b3-aafc0410dd9f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:50.056132 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252493d4-7808-4ffd-88b3-aafc0410dd9f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:50.056587 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252493d4-7808-4ffd-88b3-aafc0410dd9f None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:50.057450 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252493d4-7808-4ffd-88b3-aafc0410dd9f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:50.057964 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252493d4-7808-4ffd-88b3-aafc0410dd9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:50.059596 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252493d4-7808-4ffd-88b3-aafc0410dd9f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:50.070665 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 236/480] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:41:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:41:51.239212 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3c24a-7169-46cc-9a72-eadcdb18c191 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:51.240195 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3c24a-7169-46cc-9a72-eadcdb18c191 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:51.240672 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3c24a-7169-46cc-9a72-eadcdb18c191 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:51.242496 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 245/481] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:51.247027 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889df60-a0c6-44a1-b716-f5932a75fbe5 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:51.247527 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889df60-a0c6-44a1-b716-f5932a75fbe5 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:51.248122 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889df60-a0c6-44a1-b716-f5932a75fbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:51.252161 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c93ac-6a38-4608-80ee-b3798ef7a787 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:51.253361 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c93ac-6a38-4608-80ee-b3798ef7a787 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:51.254370 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c93ac-6a38-4608-80ee-b3798ef7a787 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:51.259578 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 237/482] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:51 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:51.267206 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b573b8-18d3-4566-b35c-cd5fdf6583ca None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:51.268597 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b573b8-18d3-4566-b35c-cd5fdf6583ca None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:51.269081 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b573b8-18d3-4566-b35c-cd5fdf6583ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:51.277469 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-b889df60-a0c6-44a1-b716-f5932a75fbe5 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:51.279632 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b889df60-a0c6-44a1-b716-f5932a75fbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:51.295145 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a5b573b8-18d3-4566-b35c-cd5fdf6583ca None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:51.296739 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a5b573b8-18d3-4566-b35c-cd5fdf6583ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:51.405793 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 246/483] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:41:51.407410 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 238/484] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:51.693568 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b573b8-18d3-4566-b35c-cd5fdf6583ca None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:51.757592 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10ae4f-d2d3-40c1-8724-e39646de538d None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:51.757972 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10ae4f-d2d3-40c1-8724-e39646de538d None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:51.758257 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10ae4f-d2d3-40c1-8724-e39646de538d None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:51.759854 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 247/485] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:51.764928 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3dc1c-3796-4cc3-a538-8825cf0611ee None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:51.765218 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3dc1c-3796-4cc3-a538-8825cf0611ee None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:51.765487 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3dc1c-3796-4cc3-a538-8825cf0611ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:51.783699 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-c2a3dc1c-3796-4cc3-a538-8825cf0611ee None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:51.784895 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c2a3dc1c-3796-4cc3-a538-8825cf0611ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:51.832691 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b573b8-18d3-4566-b35c-cd5fdf6583ca None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:51.848345 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:51.858108 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 248/486] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:41:51.867040 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3dc1c-3796-4cc3-a538-8825cf0611ee None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:51.870085 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:51.922572 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d76d79-3999-40bf-b47a-f69d4d57a386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:51.923588 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d76d79-3999-40bf-b47a-f69d4d57a386 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:51.924093 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d76d79-3999-40bf-b47a-f69d4d57a386 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:51.924556 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d76d79-3999-40bf-b47a-f69d4d57a386 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:51.962455 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d76d79-3999-40bf-b47a-f69d4d57a386 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:51.967822 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-f0d76d79-3999-40bf-b47a-f69d4d57a386 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:41:51.967822 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:51.967822 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:51.967822 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:51.967822 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:51.967822 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:51.967822 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:51.967822 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:51.967822 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:51.967822 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:51.967822 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:51.967822 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:51.967822 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:51.967822 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:51.967822 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:51.967822 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:51.968809 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:51.968809 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:51.968809 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:51.968809 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:51.968809 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:51.968809 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:51.968809 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:51.968809 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:51.968809 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:51.968809 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:51.968809 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:51.968809 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:51.968809 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:51.968809 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:51.968809 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:51.968809 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:51.969984 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:51.969984 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:51.969984 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:51.969984 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:51.969984 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:51.969984 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:51.969984 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:51.969984 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:51.969984 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:51.969984 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:51.969984 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:41:51.969984 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:51.976704 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3dc1c-3796-4cc3-a538-8825cf0611ee None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:51.977014 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 239/487] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Aug 28 00:41:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:51.978115 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d76d79-3999-40bf-b47a-f69d4d57a386 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:52.012963 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d2d11-4efe-4cd4-af3f-20f73bfe9cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:52.013604 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d2d11-4efe-4cd4-af3f-20f73bfe9cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:52.013903 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d2d11-4efe-4cd4-af3f-20f73bfe9cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:52.014241 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d2d11-4efe-4cd4-af3f-20f73bfe9cb7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:52.025784 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d2d11-4efe-4cd4-af3f-20f73bfe9cb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:52.031393 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-009d2d11-4efe-4cd4-af3f-20f73bfe9cb7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:41:52.031393 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:52.031393 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:52.031393 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:52.031393 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:52.031393 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:52.031393 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:52.031393 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:52.031393 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:52.031393 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:52.031393 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:52.031393 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:52.031393 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:52.031393 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:52.031393 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:52.031393 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:52.032289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:52.032289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:52.032289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:52.032289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:52.032289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:52.032289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:52.032289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:52.032289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:52.032289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:52.032289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:52.032289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:52.032289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:52.032289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:52.032289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:52.032289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:52.032289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:52.033249 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:52.033249 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:52.033249 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:52.033249 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:52.033249 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:52.033249 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:52.033249 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:52.033249 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:52.033249 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:52.033249 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:52.033249 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:41:52.033249 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:52.033249 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 249/488] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Aug 28 00:41:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:41:52.040529 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d2d11-4efe-4cd4-af3f-20f73bfe9cb7 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:52.145894 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d2d11-4efe-4cd4-af3f-20f73bfe9cb7 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:52.154204 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:52.182640 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d76d79-3999-40bf-b47a-f69d4d57a386 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:52.182862 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54137712-9adb-4e3b-ac32-de204aeffd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:52.183514 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54137712-9adb-4e3b-ac32-de204aeffd0b None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:52.183939 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54137712-9adb-4e3b-ac32-de204aeffd0b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:52.184339 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54137712-9adb-4e3b-ac32-de204aeffd0b None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:52.185080 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54137712-9adb-4e3b-ac32-de204aeffd0b None admin] RBAC: Adding query filter params (name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:52.185448 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54137712-9adb-4e3b-ac32-de204aeffd0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:52.187101 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54137712-9adb-4e3b-ac32-de204aeffd0b None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:52.203933 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 250/489] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Aug 28 00:41:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:41:52.206145 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54137712-9adb-4e3b-ac32-de204aeffd0b None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:52.237670 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10944557-83c4-42fd-9f6c-0d03f2d196b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:52.238684 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10944557-83c4-42fd-9f6c-0d03f2d196b1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:52.239211 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10944557-83c4-42fd-9f6c-0d03f2d196b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:52.239532 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10944557-83c4-42fd-9f6c-0d03f2d196b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:52.240430 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10944557-83c4-42fd-9f6c-0d03f2d196b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:52.240736 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10944557-83c4-42fd-9f6c-0d03f2d196b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:52.242784 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10944557-83c4-42fd-9f6c-0d03f2d196b1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:52.253699 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 240/490] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Aug 28 00:41:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:52.254599 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10944557-83c4-42fd-9f6c-0d03f2d196b1 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:52.292029 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:52.337867 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54137712-9adb-4e3b-ac32-de204aeffd0b None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:52.359576 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:52.377870 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c0587-fe8d-42cb-a68a-e83300e94c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:52.377870 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c0587-fe8d-42cb-a68a-e83300e94c66 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:52.377870 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c0587-fe8d-42cb-a68a-e83300e94c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:52.377870 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c0587-fe8d-42cb-a68a-e83300e94c66 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:52.390379 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c0587-fe8d-42cb-a68a-e83300e94c66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:52.393657 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10944557-83c4-42fd-9f6c-0d03f2d196b1 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:52.399290 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-949c0587-fe8d-42cb-a68a-e83300e94c66 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:41:52.399290 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:52.399290 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:52.399290 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:52.399290 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:52.399290 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:52.399290 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:52.399290 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:52.399290 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:52.399290 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:52.399290 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:52.399290 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:52.399290 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:52.399290 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:52.399290 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:52.399290 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:52.400203 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:52.400203 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:52.400203 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:52.400203 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:52.400203 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:52.400203 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:52.400203 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:52.400203 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:52.400203 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:52.400203 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:52.400203 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:52.400203 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:52.400203 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:52.400203 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:52.400203 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:52.400203 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:52.401142 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:52.401142 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:52.401142 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:52.401142 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:52.401142 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:52.401142 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:52.401142 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:52.401142 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:52.401142 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:52.401142 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:52.401142 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:41:52.401142 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:52.403924 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 251/491] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Aug 28 00:41:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:52.405347 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c0587-fe8d-42cb-a68a-e83300e94c66 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:52.442426 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c70ce-0915-423e-8a35-df33304330ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:52.443069 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c70ce-0915-423e-8a35-df33304330ff None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:52.443366 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c70ce-0915-423e-8a35-df33304330ff None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:52.443644 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c70ce-0915-423e-8a35-df33304330ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:52.454935 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c70ce-0915-423e-8a35-df33304330ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:52.456411 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c70ce-0915-423e-8a35-df33304330ff None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:52.471307 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-622c70ce-0915-423e-8a35-df33304330ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:52.471307 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:52.471307 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:52.471307 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:52.471307 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:52.471307 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:52.471307 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:52.471307 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:52.471307 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:52.471307 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:52.471307 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:52.471307 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:52.471307 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:41:52.471307 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:41:52.471307 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:41:52.471307 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:41:52.472481 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:52.472481 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:52.472481 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:52.472481 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:52.472481 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:52.472481 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:52.472481 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:52.472481 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:52.472481 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:52.472481 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:52.472481 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:52.472481 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:52.472481 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:52.472481 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:52.472481 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:52.472481 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:52.472481 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:41:52.473336 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:41:52.473336 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:52.473336 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:52.473336 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 241/492] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:41:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:52.473797 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d1c0d-f21f-482b-b71b-d974ef4c0a73 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:52.474103 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d1c0d-f21f-482b-b71b-d974ef4c0a73 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:52.474375 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d1c0d-f21f-482b-b71b-d974ef4c0a73 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:52.475735 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 242/493] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:52.476337 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d1c0d-f21f-482b-b71b-d974ef4c0a73 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:52.546370 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c0587-fe8d-42cb-a68a-e83300e94c66 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:52.575707 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:52.588546 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60da42-1199-43ae-87fb-286c0bfb884c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:52.589453 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60da42-1199-43ae-87fb-286c0bfb884c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:52.589894 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60da42-1199-43ae-87fb-286c0bfb884c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:52.590299 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60da42-1199-43ae-87fb-286c0bfb884c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:52.602453 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60da42-1199-43ae-87fb-286c0bfb884c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:52.603116 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d1c0d-f21f-482b-b71b-d974ef4c0a73 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:52.603913 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60da42-1199-43ae-87fb-286c0bfb884c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:52.617979 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-5f60da42-1199-43ae-87fb-286c0bfb884c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:52.617979 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:52.617979 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:52.617979 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:52.617979 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:52.617979 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:52.617979 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:52.617979 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:52.617979 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:52.617979 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:52.617979 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:52.617979 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:52.617979 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:41:52.617979 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:41:52.617979 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:41:52.617979 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:41:52.619027 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:52.619027 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:52.619027 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:52.619027 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:52.619027 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:52.619027 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:52.619027 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:52.619027 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:52.619027 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:52.619027 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:52.619027 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:52.619027 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:52.619027 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:52.619027 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:52.619027 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:52.619027 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:52.619027 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:41:52.619881 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:41:52.619881 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:52.619881 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:52.619881 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 252/494] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:41:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:52.619881 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60da42-1199-43ae-87fb-286c0bfb884c None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:52.643135 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51944d74-1f90-45b1-8d0c-b623298ec687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:52.643741 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51944d74-1f90-45b1-8d0c-b623298ec687 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:52.644013 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51944d74-1f90-45b1-8d0c-b623298ec687 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:52.644276 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51944d74-1f90-45b1-8d0c-b623298ec687 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:52.644932 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51944d74-1f90-45b1-8d0c-b623298ec687 None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:52.645229 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51944d74-1f90-45b1-8d0c-b623298ec687 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:52.646770 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51944d74-1f90-45b1-8d0c-b623298ec687 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:52.657014 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 243/495] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Aug 28 00:41:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:52.658292 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eddc47-ff1b-4991-95b5-f42f22eb5b71 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:52.658576 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eddc47-ff1b-4991-95b5-f42f22eb5b71 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:52.658862 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eddc47-ff1b-4991-95b5-f42f22eb5b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:52.659195 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:52.678011 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b8eddc47-ff1b-4991-95b5-f42f22eb5b71 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:52.679399 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b8eddc47-ff1b-4991-95b5-f42f22eb5b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:52.728364 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60da42-1199-43ae-87fb-286c0bfb884c None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:52.756244 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 244/496] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:52.757515 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd8e92-8e60-4944-b604-693c7a042167 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:52.757800 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd8e92-8e60-4944-b604-693c7a042167 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:52.758101 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd8e92-8e60-4944-b604-693c7a042167 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:52.761878 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 245/497] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:52.761878 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd8e92-8e60-4944-b604-693c7a042167 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:52.763547 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358fc1e-e7a9-4aa0-9045-cf8703e3d28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:52.764201 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358fc1e-e7a9-4aa0-9045-cf8703e3d28b None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:52.764512 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358fc1e-e7a9-4aa0-9045-cf8703e3d28b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:52.764857 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358fc1e-e7a9-4aa0-9045-cf8703e3d28b None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:52.765511 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358fc1e-e7a9-4aa0-9045-cf8703e3d28b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:52.765810 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358fc1e-e7a9-4aa0-9045-cf8703e3d28b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:52.767216 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358fc1e-e7a9-4aa0-9045-cf8703e3d28b None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:52.783856 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 253/498] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:52.783856 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358fc1e-e7a9-4aa0-9045-cf8703e3d28b None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:52.845500 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:52.875758 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd8e92-8e60-4944-b604-693c7a042167 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:52.882639 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:52.889961 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358fc1e-e7a9-4aa0-9045-cf8703e3d28b None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:52.911104 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756ef7d-fc87-4eaf-b790-f4bce0a241af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:52.911630 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756ef7d-fc87-4eaf-b790-f4bce0a241af None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:52.911905 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756ef7d-fc87-4eaf-b790-f4bce0a241af None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:52.912172 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756ef7d-fc87-4eaf-b790-f4bce0a241af None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:52.912814 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756ef7d-fc87-4eaf-b790-f4bce0a241af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:52.913110 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756ef7d-fc87-4eaf-b790-f4bce0a241af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:52.914528 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756ef7d-fc87-4eaf-b790-f4bce0a241af None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:52.928519 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa811855-3873-4fc2-85b0-322bffaf8f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:52.929145 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa811855-3873-4fc2-85b0-322bffaf8f83 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:52.929414 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa811855-3873-4fc2-85b0-322bffaf8f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:52.929982 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa811855-3873-4fc2-85b0-322bffaf8f83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:52.937963 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 246/499] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:52.937963 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cc9d0-0690-4cad-8dd1-ca05456e638f None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:52.937963 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cc9d0-0690-4cad-8dd1-ca05456e638f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:52.937963 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cc9d0-0690-4cad-8dd1-ca05456e638f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:52.939970 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa811855-3873-4fc2-85b0-322bffaf8f83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:52.941445 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa811855-3873-4fc2-85b0-322bffaf8f83 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:52.955213 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-782cc9d0-0690-4cad-8dd1-ca05456e638f None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:52.956415 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-782cc9d0-0690-4cad-8dd1-ca05456e638f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:52.957317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-fa811855-3873-4fc2-85b0-322bffaf8f83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:52.957317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:52.957317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:52.957317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:52.957317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:52.957317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:52.957317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:52.957317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:52.957317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:52.957317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:52.957317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:52.957317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:52.957317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:41:52.957317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:41:52.957317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:41:52.957317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:41:52.958230 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:52.958230 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:52.958230 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:52.958230 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:52.958230 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:52.958230 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:52.958230 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:52.958230 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:52.958230 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:52.958230 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:52.958230 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:52.958230 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:52.958230 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:52.958230 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:52.958230 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:52.958230 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:52.958230 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:41:52.959067 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:41:52.959067 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:52.959067 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:52.959067 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 254/500] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:41:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:52.959859 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa811855-3873-4fc2-85b0-322bffaf8f83 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:53.030099 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 247/501] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:53.031662 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782cc9d0-0690-4cad-8dd1-ca05456e638f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:53.077353 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa811855-3873-4fc2-85b0-322bffaf8f83 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:53.093303 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:53.116442 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4eaf6-7f88-4a1e-951f-8673313fd0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:53.117327 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4eaf6-7f88-4a1e-951f-8673313fd0ef None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:53.117604 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4eaf6-7f88-4a1e-951f-8673313fd0ef None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:53.117909 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4eaf6-7f88-4a1e-951f-8673313fd0ef None admin] PATH_INFO: `/v3/users/nova` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:53.127778 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4eaf6-7f88-4a1e-951f-8673313fd0ef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:53.129258 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4eaf6-7f88-4a1e-951f-8673313fd0ef None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:53.135280 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782cc9d0-0690-4cad-8dd1-ca05456e638f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:53.141879 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-21c4eaf6-7f88-4a1e-951f-8673313fd0ef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:41:53.141879 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:53.141879 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:53.141879 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:53.141879 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:53.141879 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:53.141879 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:53.141879 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:53.141879 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:53.141879 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:53.141879 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:53.141879 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:53.141879 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:41:53.141879 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:41:53.141879 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:41:53.141879 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:41:53.142801 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:53.142801 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:53.142801 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:41:53.142801 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:41:53.142801 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:41:53.142801 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:41:53.142801 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:53.142801 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:53.142801 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:53.142801 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:53.142801 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:53.142801 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:53.142801 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:53.142801 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:53.142801 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:53.142801 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:53.142801 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:53.142801 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:53.144622 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:53.144622 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:53.144622 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:41:53.144622 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:41:53.144622 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:41:53.144622 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:41:53.144622 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:41:53.144622 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:41:53.144622 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:41:53.144622 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:53.144622 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 255/502] 10.222.0.52 () {56 vars in 1093 bytes} [Sun Aug 28 00:41:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:53.144622 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4eaf6-7f88-4a1e-951f-8673313fd0ef None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:53.158382 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:53.175035 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e311765-05fa-4bba-8765-7b2c2b58ce76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:53.175591 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e311765-05fa-4bba-8765-7b2c2b58ce76 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:53.175866 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e311765-05fa-4bba-8765-7b2c2b58ce76 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:53.176130 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e311765-05fa-4bba-8765-7b2c2b58ce76 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:53.183328 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e311765-05fa-4bba-8765-7b2c2b58ce76 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:53.184776 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e311765-05fa-4bba-8765-7b2c2b58ce76 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:53.198102 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-9e311765-05fa-4bba-8765-7b2c2b58ce76 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 28 00:41:53.198102 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:53.198102 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:53.198102 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:53.198102 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:53.198102 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:53.198102 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:53.198102 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:53.198102 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:53.198102 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:53.198102 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:53.198102 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:53.198102 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:41:53.198102 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:41:53.198102 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:41:53.198102 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:41:53.199055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:53.199055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:53.199055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:41:53.199055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:41:53.199055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:41:53.199055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:41:53.199055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:53.199055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:53.199055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:53.199055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:53.199055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:53.199055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:53.199055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:53.199055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:53.199055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:53.199055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:53.199055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:53.199055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:53.199963 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:53.199963 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:53.199963 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:41:53.199963 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:41:53.199963 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:41:53.199963 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:41:53.199963 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:41:53.199963 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:41:53.199963 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 28 00:41:53.199963 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:53.199963 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 248/503] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:53.200551 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e311765-05fa-4bba-8765-7b2c2b58ce76 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:53.257802 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4eaf6-7f88-4a1e-951f-8673313fd0ef None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:53.291711 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2ab4a-734f-4b8e-a49e-b9f7bf383680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:53.292324 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2ab4a-734f-4b8e-a49e-b9f7bf383680 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:53.292606 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2ab4a-734f-4b8e-a49e-b9f7bf383680 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:53.292878 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2ab4a-734f-4b8e-a49e-b9f7bf383680 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:53.293524 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2ab4a-734f-4b8e-a49e-b9f7bf383680 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:53.293829 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2ab4a-734f-4b8e-a49e-b9f7bf383680 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:53.295273 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2ab4a-734f-4b8e-a49e-b9f7bf383680 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:53.307019 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 256/504] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:53.307932 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e311765-05fa-4bba-8765-7b2c2b58ce76 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:53.308380 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2ab4a-734f-4b8e-a49e-b9f7bf383680 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:53.330383 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:53.342668 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1fcab-20e9-4c37-b4a6-7cd4ca659972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:53.343317 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1fcab-20e9-4c37-b4a6-7cd4ca659972 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:53.343586 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1fcab-20e9-4c37-b4a6-7cd4ca659972 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:53.343854 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1fcab-20e9-4c37-b4a6-7cd4ca659972 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:53.355025 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1fcab-20e9-4c37-b4a6-7cd4ca659972 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:53.356549 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1fcab-20e9-4c37-b4a6-7cd4ca659972 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:53.371233 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-3ce1fcab-20e9-4c37-b4a6-7cd4ca659972 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:53.371233 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:53.371233 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:53.371233 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:53.371233 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:53.371233 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:53.371233 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:53.371233 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:53.371233 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:53.371233 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:53.371233 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:53.371233 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:53.371233 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:41:53.371233 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:41:53.371233 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:41:53.371233 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:41:53.372169 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:53.372169 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:53.372169 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:53.372169 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:53.372169 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:53.372169 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:53.372169 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:53.372169 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:53.372169 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:53.372169 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:53.372169 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:53.372169 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:53.372169 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:53.372169 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:53.372169 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:53.372169 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:53.372169 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:41:53.373005 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:41:53.373005 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:53.373005 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:53.373005 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 249/505] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:41:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:53.373224 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1fcab-20e9-4c37-b4a6-7cd4ca659972 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:53.381467 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:53.415084 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2ab4a-734f-4b8e-a49e-b9f7bf383680 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:53.449926 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e327a-da55-4e16-9a1b-97bb25c55909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:53.450443 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e327a-da55-4e16-9a1b-97bb25c55909 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:53.450736 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e327a-da55-4e16-9a1b-97bb25c55909 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:53.451029 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e327a-da55-4e16-9a1b-97bb25c55909 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:53.452071 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e327a-da55-4e16-9a1b-97bb25c55909 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:53.452071 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e327a-da55-4e16-9a1b-97bb25c55909 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:53.453527 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e327a-da55-4e16-9a1b-97bb25c55909 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:53.476761 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1fcab-20e9-4c37-b4a6-7cd4ca659972 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:53.490605 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 257/506] 10.222.0.52 () {56 vars in 1133 bytes} [Sun Aug 28 00:41:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:53.491507 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e327a-da55-4e16-9a1b-97bb25c55909 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:53.511158 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c30db-6d6d-4da9-bf5d-4ce843710c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:53.511763 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c30db-6d6d-4da9-bf5d-4ce843710c4e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:53.512042 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c30db-6d6d-4da9-bf5d-4ce843710c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:53.512313 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c30db-6d6d-4da9-bf5d-4ce843710c4e None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:53.513049 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c30db-6d6d-4da9-bf5d-4ce843710c4e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:53.513355 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c30db-6d6d-4da9-bf5d-4ce843710c4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:53.514895 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c30db-6d6d-4da9-bf5d-4ce843710c4e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:53.554227 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 250/507] 10.222.0.52 () {56 vars in 1137 bytes} [Sun Aug 28 00:41:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:53.555078 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c30db-6d6d-4da9-bf5d-4ce843710c4e None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:53.585230 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:53.594220 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e327a-da55-4e16-9a1b-97bb25c55909 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:53.620183 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:53.629264 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2dda8e-9d98-4ce4-a900-e423ec26c6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:53.629927 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dda8e-9d98-4ce4-a900-e423ec26c6eb None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:53.630215 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dda8e-9d98-4ce4-a900-e423ec26c6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:53.630506 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dda8e-9d98-4ce4-a900-e423ec26c6eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:53.641031 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2dda8e-9d98-4ce4-a900-e423ec26c6eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:53.645932 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-7b2dda8e-9d98-4ce4-a900-e423ec26c6eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:41:53.645932 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:53.645932 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:53.645932 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:53.645932 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:53.645932 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:53.645932 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:53.645932 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:53.645932 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:53.645932 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:53.645932 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:53.645932 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:53.645932 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:53.645932 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:53.645932 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:53.645932 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:53.646962 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:53.646962 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:53.646962 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:53.646962 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:53.646962 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:53.646962 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:53.646962 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:53.646962 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:53.646962 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:53.646962 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:53.646962 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:53.646962 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:53.646962 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:53.646962 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:53.646962 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:53.646962 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:53.647888 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:53.647888 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:53.647888 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:53.647888 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:53.647888 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:53.647888 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:53.647888 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:53.647888 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:53.647888 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:53.647888 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:53.647888 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:41:53.647888 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:53.647888 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 258/508] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Aug 28 00:41:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:53.647888 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2dda8e-9d98-4ce4-a900-e423ec26c6eb None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:53.657859 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c30db-6d6d-4da9-bf5d-4ce843710c4e None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:53.692771 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc890d-b914-4659-8cb0-1f7f14960f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:53.693629 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc890d-b914-4659-8cb0-1f7f14960f01 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:53.693934 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc890d-b914-4659-8cb0-1f7f14960f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:53.694199 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc890d-b914-4659-8cb0-1f7f14960f01 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:53.701883 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc890d-b914-4659-8cb0-1f7f14960f01 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:53.703412 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc890d-b914-4659-8cb0-1f7f14960f01 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:53.714759 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-7edc890d-b914-4659-8cb0-1f7f14960f01 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 00:41:53.714759 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:53.714759 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:53.714759 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:53.714759 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:53.714759 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:53.714759 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:53.714759 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:53.714759 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:53.714759 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:53.714759 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:53.714759 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:53.714759 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:41:53.714759 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:41:53.714759 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:41:53.714759 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:41:53.715823 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:53.715823 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:53.715823 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:41:53.715823 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:41:53.715823 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:41:53.715823 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:41:53.715823 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:53.715823 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:53.715823 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:53.715823 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:53.715823 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:53.715823 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:53.715823 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:53.715823 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:53.715823 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:53.715823 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:53.715823 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:53.715823 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:53.717273 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:53.717273 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:53.717273 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:41:53.717273 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:41:53.717273 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:41:53.717273 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:41:53.717273 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:41:53.717273 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:41:53.717273 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 00:41:53.717273 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:53.717273 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 251/509] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:41:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:53.717273 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc890d-b914-4659-8cb0-1f7f14960f01 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:53.751106 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2dda8e-9d98-4ce4-a900-e423ec26c6eb None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:53.783834 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0d8b2-7e62-43b6-a7dd-583c3b63573a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:53.784421 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0d8b2-7e62-43b6-a7dd-583c3b63573a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:53.784717 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0d8b2-7e62-43b6-a7dd-583c3b63573a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:53.784979 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0d8b2-7e62-43b6-a7dd-583c3b63573a None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:53.785615 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0d8b2-7e62-43b6-a7dd-583c3b63573a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:53.785946 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0d8b2-7e62-43b6-a7dd-583c3b63573a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:53.787339 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0d8b2-7e62-43b6-a7dd-583c3b63573a None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:53.798480 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 259/510] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:53.799306 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0d8b2-7e62-43b6-a7dd-583c3b63573a None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:53.809237 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:53.820509 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc890d-b914-4659-8cb0-1f7f14960f01 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:53.845875 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:53.855365 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97626864-5e4e-4125-9427-19c664d88482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:53.855969 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97626864-5e4e-4125-9427-19c664d88482 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:53.856240 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97626864-5e4e-4125-9427-19c664d88482 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:53.856526 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97626864-5e4e-4125-9427-19c664d88482 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:53.901073 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0d8b2-7e62-43b6-a7dd-583c3b63573a None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:53.922805 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97626864-5e4e-4125-9427-19c664d88482 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:53.924270 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97626864-5e4e-4125-9427-19c664d88482 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:53.933495 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28d096-78f0-4566-8c37-62d913342296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:53.934123 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28d096-78f0-4566-8c37-62d913342296 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:53.934411 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28d096-78f0-4566-8c37-62d913342296 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:53.934685 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28d096-78f0-4566-8c37-62d913342296 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:54.000474 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28d096-78f0-4566-8c37-62d913342296 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:54.001877 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28d096-78f0-4566-8c37-62d913342296 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:54.011479 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:54.021451 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 252/511] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:41:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:41:54.022067 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97626864-5e4e-4125-9427-19c664d88482 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:54.047705 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:54.102821 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 260/512] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:41:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:41:54.103700 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28d096-78f0-4566-8c37-62d913342296 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:54.121977 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97626864-5e4e-4125-9427-19c664d88482 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:54.156310 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358c167-2bba-44ba-ba81-21432e39dc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:54.156912 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358c167-2bba-44ba-ba81-21432e39dc4c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:54.157189 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358c167-2bba-44ba-ba81-21432e39dc4c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:54.157445 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358c167-2bba-44ba-ba81-21432e39dc4c None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:54.158147 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358c167-2bba-44ba-ba81-21432e39dc4c None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:54.158448 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358c167-2bba-44ba-ba81-21432e39dc4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:54.159850 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358c167-2bba-44ba-ba81-21432e39dc4c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:54.167627 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 253/513] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Aug 28 00:41:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:54.168500 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358c167-2bba-44ba-ba81-21432e39dc4c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:54.203355 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28d096-78f0-4566-8c37-62d913342296 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:54.225737 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:54.237888 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25574f2d-f8ae-40b6-b610-e2a56530a866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:54.238493 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25574f2d-f8ae-40b6-b610-e2a56530a866 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:54.238764 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25574f2d-f8ae-40b6-b610-e2a56530a866 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:54.239024 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25574f2d-f8ae-40b6-b610-e2a56530a866 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:54.239745 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25574f2d-f8ae-40b6-b610-e2a56530a866 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:54.240040 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25574f2d-f8ae-40b6-b610-e2a56530a866 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:54.241464 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25574f2d-f8ae-40b6-b610-e2a56530a866 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:54.259602 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 261/514] 10.222.0.52 () {56 vars in 1137 bytes} [Sun Aug 28 00:41:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:54.260574 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25574f2d-f8ae-40b6-b610-e2a56530a866 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:54.267213 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:54.271555 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358c167-2bba-44ba-ba81-21432e39dc4c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:54.304901 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5705f3-0783-433c-82b0-92837a44f441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:54.305621 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5705f3-0783-433c-82b0-92837a44f441 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:54.305917 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5705f3-0783-433c-82b0-92837a44f441 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:54.306184 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5705f3-0783-433c-82b0-92837a44f441 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:54.306821 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5705f3-0783-433c-82b0-92837a44f441 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:54.308256 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5705f3-0783-433c-82b0-92837a44f441 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:54.330305 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 254/515] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Aug 28 00:41:54 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:41:54.331311 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5705f3-0783-433c-82b0-92837a44f441 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:54.392016 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25574f2d-f8ae-40b6-b610-e2a56530a866 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:54.430005 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5675e02-3de8-425e-91e4-94d2e31dbac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:54.430650 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5675e02-3de8-425e-91e4-94d2e31dbac4 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:54.430929 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5675e02-3de8-425e-91e4-94d2e31dbac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:54.431201 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5675e02-3de8-425e-91e4-94d2e31dbac4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:54.442440 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5675e02-3de8-425e-91e4-94d2e31dbac4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:54.443971 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5675e02-3de8-425e-91e4-94d2e31dbac4 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:54.444896 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5705f3-0783-433c-82b0-92837a44f441 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:54.456461 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:54.460667 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-b5675e02-3de8-425e-91e4-94d2e31dbac4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:54.460667 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:54.460667 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:54.460667 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:54.460667 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:54.460667 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:54.460667 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:54.460667 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:54.460667 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:54.460667 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:54.460667 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:54.460667 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:54.460667 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:41:54.460667 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:41:54.460667 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:41:54.460667 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:41:54.461606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:54.461606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:54.461606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:54.461606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:54.461606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:54.461606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:54.461606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:54.461606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:54.461606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:54.461606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:54.461606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:54.461606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:54.461606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:54.461606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:54.461606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:54.461606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:54.461606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:41:54.462483 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:41:54.462483 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:54.462483 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:54.462483 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 262/516] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:41:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:54.462712 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5675e02-3de8-425e-91e4-94d2e31dbac4 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:54.491641 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e97d5-3a32-46fe-abc0-fb69b099a3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:54.492281 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e97d5-3a32-46fe-abc0-fb69b099a3fd None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:54.492558 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e97d5-3a32-46fe-abc0-fb69b099a3fd None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:54.492823 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e97d5-3a32-46fe-abc0-fb69b099a3fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:54.504480 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e97d5-3a32-46fe-abc0-fb69b099a3fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:54.506077 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e97d5-3a32-46fe-abc0-fb69b099a3fd None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:54.522802 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-ca1e97d5-3a32-46fe-abc0-fb69b099a3fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:54.522802 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:54.522802 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:54.522802 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:54.522802 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:54.522802 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:54.522802 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:54.522802 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:54.522802 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:54.522802 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:54.522802 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:54.522802 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:54.522802 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:41:54.522802 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:41:54.522802 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:41:54.522802 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:41:54.523755 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:54.523755 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:54.523755 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:54.523755 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:54.523755 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:54.523755 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:54.523755 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:54.523755 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:54.523755 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:54.523755 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:54.523755 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:54.523755 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:54.523755 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:54.523755 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:54.523755 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:54.523755 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:54.523755 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:41:54.524617 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:41:54.524617 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:54.524617 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:54.524617 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 255/517] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:41:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:54.524617 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e97d5-3a32-46fe-abc0-fb69b099a3fd None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:54.536775 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:54.595649 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5675e02-3de8-425e-91e4-94d2e31dbac4 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:54.633016 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926eb43e-ca30-4b9a-bf85-fec032eef9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:54.633655 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926eb43e-ca30-4b9a-bf85-fec032eef9fa None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:54.633970 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926eb43e-ca30-4b9a-bf85-fec032eef9fa None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:54.634224 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926eb43e-ca30-4b9a-bf85-fec032eef9fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:54.639379 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e97d5-3a32-46fe-abc0-fb69b099a3fd None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:54.646324 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926eb43e-ca30-4b9a-bf85-fec032eef9fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:54.647815 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926eb43e-ca30-4b9a-bf85-fec032eef9fa None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:54.662364 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-926eb43e-ca30-4b9a-bf85-fec032eef9fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:54.662364 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:54.662364 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:54.662364 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:54.662364 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:54.662364 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:54.662364 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:54.662364 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:54.662364 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:54.662364 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:54.662364 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:54.662364 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:54.662364 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:41:54.662364 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:41:54.662364 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:41:54.662364 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:41:54.663317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:54.663317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:54.663317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:54.663317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:54.663317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:54.663317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:54.663317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:54.663317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:54.663317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:54.663317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:54.663317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:54.663317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:54.663317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:54.663317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:54.663317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:54.663317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:54.663317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:41:54.664172 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:41:54.664172 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:54.664172 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:54.664172 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 263/518] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:41:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:54.664875 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926eb43e-ca30-4b9a-bf85-fec032eef9fa None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:54.687520 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44734e-bfa4-4e91-9307-4fd758757046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:54.688128 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44734e-bfa4-4e91-9307-4fd758757046 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:54.688399 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44734e-bfa4-4e91-9307-4fd758757046 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:54.688663 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44734e-bfa4-4e91-9307-4fd758757046 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:54.722942 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:54.763593 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44734e-bfa4-4e91-9307-4fd758757046 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:54.765184 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44734e-bfa4-4e91-9307-4fd758757046 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:54.774001 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926eb43e-ca30-4b9a-bf85-fec032eef9fa None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:54.784103 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:54.811436 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597a92d-9842-4d90-a002-3128ddc1a3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:54.812071 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597a92d-9842-4d90-a002-3128ddc1a3d3 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:54.812334 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597a92d-9842-4d90-a002-3128ddc1a3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:54.812606 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597a92d-9842-4d90-a002-3128ddc1a3d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:54.813243 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1597a92d-9842-4d90-a002-3128ddc1a3d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:54.813548 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1597a92d-9842-4d90-a002-3128ddc1a3d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:54.814980 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1597a92d-9842-4d90-a002-3128ddc1a3d3 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:54.828535 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 264/519] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:54.829691 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597a92d-9842-4d90-a002-3128ddc1a3d3 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:54.875903 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 256/520] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:41:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:41:54.876706 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44734e-bfa4-4e91-9307-4fd758757046 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:54.937367 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597a92d-9842-4d90-a002-3128ddc1a3d3 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:54.941277 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:54.975411 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69338c-ce85-45ed-809c-9ff64e91e864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:54.976828 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69338c-ce85-45ed-809c-9ff64e91e864 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:54.977526 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69338c-ce85-45ed-809c-9ff64e91e864 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:54.978001 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69338c-ce85-45ed-809c-9ff64e91e864 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:54.978959 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b69338c-ce85-45ed-809c-9ff64e91e864 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:54.979715 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b69338c-ce85-45ed-809c-9ff64e91e864 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:54.981521 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b69338c-ce85-45ed-809c-9ff64e91e864 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:54.982007 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44734e-bfa4-4e91-9307-4fd758757046 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:54.995913 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 265/521] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:54.996741 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69338c-ce85-45ed-809c-9ff64e91e864 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:55.021823 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece58a9-65d0-429c-b50f-29d314948dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:55.022519 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece58a9-65d0-429c-b50f-29d314948dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:55.022771 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece58a9-65d0-429c-b50f-29d314948dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:55.023023 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece58a9-65d0-429c-b50f-29d314948dd2 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:55.023680 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece58a9-65d0-429c-b50f-29d314948dd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:55.023931 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece58a9-65d0-429c-b50f-29d314948dd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:55.025397 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece58a9-65d0-429c-b50f-29d314948dd2 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:55.027470 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:55.043348 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 257/522] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:55.043348 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece58a9-65d0-429c-b50f-29d314948dd2 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:55.111658 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69338c-ce85-45ed-809c-9ff64e91e864 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:55.147203 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138b7f7-497d-458c-9d7a-19505f585ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:55.147670 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece58a9-65d0-429c-b50f-29d314948dd2 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:55.147838 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138b7f7-497d-458c-9d7a-19505f585ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:55.148106 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138b7f7-497d-458c-9d7a-19505f585ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:55.148380 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138b7f7-497d-458c-9d7a-19505f585ba4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:55.155770 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1138b7f7-497d-458c-9d7a-19505f585ba4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:55.157235 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1138b7f7-497d-458c-9d7a-19505f585ba4 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:55.169174 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-1138b7f7-497d-458c-9d7a-19505f585ba4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:41:55.169174 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:55.169174 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:55.169174 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:55.169174 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:55.169174 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:55.169174 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:55.169174 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:55.169174 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:55.169174 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:55.169174 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:55.169174 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:55.169174 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:41:55.169174 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:41:55.169174 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:41:55.170047 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:41:55.170047 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:55.170047 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:55.170047 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:55.170047 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:55.170047 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:55.170047 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:55.170047 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:55.170047 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:55.170047 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:55.170047 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:55.170047 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:55.170047 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:55.170047 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:55.170047 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:55.170047 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:55.170047 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:55.171189 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:41:55.171189 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:41:55.171189 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:41:55.171189 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:41:55.171189 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:41:55.171189 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:41:55.171189 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:41:55.171189 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:55.171189 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 266/523] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:41:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:55.171189 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138b7f7-497d-458c-9d7a-19505f585ba4 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:55.176830 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:55.188795 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616f617-d1fc-4b93-bf0c-34d3e667abe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:55.189429 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616f617-d1fc-4b93-bf0c-34d3e667abe8 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:55.189706 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616f617-d1fc-4b93-bf0c-34d3e667abe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:55.190010 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616f617-d1fc-4b93-bf0c-34d3e667abe8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:55.200769 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616f617-d1fc-4b93-bf0c-34d3e667abe8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:55.202327 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616f617-d1fc-4b93-bf0c-34d3e667abe8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:55.217473 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-5616f617-d1fc-4b93-bf0c-34d3e667abe8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:55.217473 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:55.217473 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:55.217473 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:55.217473 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:55.217473 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:55.217473 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:55.217473 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:55.217473 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:55.217473 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:55.217473 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:55.217473 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:55.217473 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:41:55.217473 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:41:55.217473 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:41:55.217473 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:41:55.218836 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:55.218836 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:55.218836 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:55.218836 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:55.218836 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:55.218836 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:55.218836 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:55.218836 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:55.218836 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:55.218836 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:55.218836 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:55.218836 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:55.218836 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:55.218836 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:55.218836 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:55.218836 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:55.218836 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:41:55.219999 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:41:55.219999 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:55.219999 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:55.219999 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 258/524] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:41:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:55.219999 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616f617-d1fc-4b93-bf0c-34d3e667abe8 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:55.268402 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:55.281009 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138b7f7-497d-458c-9d7a-19505f585ba4 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:55.314603 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba45901-aa7e-40cf-b194-4c0f0ffcb30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:55.315234 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba45901-aa7e-40cf-b194-4c0f0ffcb30e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:55.315514 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba45901-aa7e-40cf-b194-4c0f0ffcb30e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:55.315786 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba45901-aa7e-40cf-b194-4c0f0ffcb30e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:55.322964 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba45901-aa7e-40cf-b194-4c0f0ffcb30e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:55.324428 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba45901-aa7e-40cf-b194-4c0f0ffcb30e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:55.330623 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616f617-d1fc-4b93-bf0c-34d3e667abe8 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:55.336788 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-1ba45901-aa7e-40cf-b194-4c0f0ffcb30e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:41:55.336788 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:55.336788 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:55.336788 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:55.336788 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:55.336788 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:55.336788 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:55.336788 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:55.336788 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:55.336788 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:55.336788 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:55.336788 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:55.336788 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:41:55.336788 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:41:55.336788 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:41:55.338199 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:41:55.338199 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:55.338199 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:55.338199 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:55.338199 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:55.338199 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:55.338199 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:55.338199 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:55.338199 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:55.338199 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:55.338199 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:55.338199 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:55.338199 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:55.338199 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:55.338199 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:55.338199 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:55.338199 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:55.339161 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:41:55.339161 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:41:55.339161 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:41:55.339161 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:41:55.339161 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:41:55.339161 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:41:55.339161 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:41:55.339161 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:55.339161 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 267/525] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:41:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:55.339161 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba45901-aa7e-40cf-b194-4c0f0ffcb30e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:55.371022 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60280f1d-3c2f-4c90-b057-b35f49134337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:55.371625 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60280f1d-3c2f-4c90-b057-b35f49134337 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:55.371916 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60280f1d-3c2f-4c90-b057-b35f49134337 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:55.372179 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60280f1d-3c2f-4c90-b057-b35f49134337 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:55.380724 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60280f1d-3c2f-4c90-b057-b35f49134337 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:55.382230 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60280f1d-3c2f-4c90-b057-b35f49134337 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:55.395163 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-60280f1d-3c2f-4c90-b057-b35f49134337 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 00:41:55.395163 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:55.395163 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:55.395163 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:55.395163 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:55.395163 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:55.395163 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:55.395163 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:55.395163 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:55.395163 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:55.395163 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:55.395163 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:55.395163 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:41:55.395163 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:41:55.395163 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:41:55.395163 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:41:55.396092 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:55.396092 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:55.396092 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:41:55.396092 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:41:55.396092 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:41:55.396092 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:41:55.396092 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:55.396092 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:55.396092 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:55.396092 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:55.396092 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:55.396092 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:55.396092 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:55.396092 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:55.396092 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:55.396092 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:55.396092 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:55.396092 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:55.396972 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:55.396972 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:55.396972 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:41:55.396972 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:41:55.396972 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:41:55.396972 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:41:55.396972 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:41:55.396972 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:41:55.396972 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 00:41:55.396972 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:55.398392 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 259/526] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Aug 28 00:41:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:55.398784 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60280f1d-3c2f-4c90-b057-b35f49134337 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:55.436203 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:55.449895 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba45901-aa7e-40cf-b194-4c0f0ffcb30e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:55.491849 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3bf5e-d714-4c75-8c11-580e7482162c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:55.492455 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3bf5e-d714-4c75-8c11-580e7482162c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:55.492727 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3bf5e-d714-4c75-8c11-580e7482162c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:55.492982 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3bf5e-d714-4c75-8c11-580e7482162c None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:55.493684 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3bf5e-d714-4c75-8c11-580e7482162c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:55.494013 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3bf5e-d714-4c75-8c11-580e7482162c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:55.495471 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3bf5e-d714-4c75-8c11-580e7482162c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:55.509273 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60280f1d-3c2f-4c90-b057-b35f49134337 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:55.513811 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 268/527] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:41:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:55.514653 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3bf5e-d714-4c75-8c11-580e7482162c None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:55.537226 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:55.548977 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c3d66-8a20-4d74-bb46-5d1a2775387b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:55.549811 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c3d66-8a20-4d74-bb46-5d1a2775387b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:55.550251 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c3d66-8a20-4d74-bb46-5d1a2775387b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:55.550652 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c3d66-8a20-4d74-bb46-5d1a2775387b None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:55.551461 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c3d66-8a20-4d74-bb46-5d1a2775387b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:55.551918 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c3d66-8a20-4d74-bb46-5d1a2775387b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:55.553458 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c3d66-8a20-4d74-bb46-5d1a2775387b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:55.567011 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 260/528] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:55.567838 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c3d66-8a20-4d74-bb46-5d1a2775387b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:55.634766 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3bf5e-d714-4c75-8c11-580e7482162c None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:55.665959 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:55.671157 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211fbf3-ab74-41db-8b07-63ff4e768753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:55.671768 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211fbf3-ab74-41db-8b07-63ff4e768753 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:55.672050 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211fbf3-ab74-41db-8b07-63ff4e768753 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:55.672321 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211fbf3-ab74-41db-8b07-63ff4e768753 None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:55.673015 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4211fbf3-ab74-41db-8b07-63ff4e768753 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:55.673316 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4211fbf3-ab74-41db-8b07-63ff4e768753 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:55.674016 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c3d66-8a20-4d74-bb46-5d1a2775387b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:55.674788 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4211fbf3-ab74-41db-8b07-63ff4e768753 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:55.691457 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 269/529] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:41:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:55.692331 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211fbf3-ab74-41db-8b07-63ff4e768753 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:55.711301 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576a23b-b284-4fe8-8dd2-08a1400c19d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:55.712190 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576a23b-b284-4fe8-8dd2-08a1400c19d1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:55.712476 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576a23b-b284-4fe8-8dd2-08a1400c19d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:55.712750 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576a23b-b284-4fe8-8dd2-08a1400c19d1 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:55.713485 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576a23b-b284-4fe8-8dd2-08a1400c19d1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:55.713789 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576a23b-b284-4fe8-8dd2-08a1400c19d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:55.715696 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576a23b-b284-4fe8-8dd2-08a1400c19d1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:55.742168 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 261/530] 10.222.0.52 () {56 vars in 1139 bytes} [Sun Aug 28 00:41:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:55.743053 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576a23b-b284-4fe8-8dd2-08a1400c19d1 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:55.760313 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:55.799054 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211fbf3-ab74-41db-8b07-63ff4e768753 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:55.836813 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0e9b8-245b-47d4-b6d6-e13dec28e789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:55.837417 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0e9b8-245b-47d4-b6d6-e13dec28e789 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:55.837696 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0e9b8-245b-47d4-b6d6-e13dec28e789 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:55.838007 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0e9b8-245b-47d4-b6d6-e13dec28e789 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:55.838746 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd0e9b8-245b-47d4-b6d6-e13dec28e789 None admin] RBAC: Adding query filter params (role.id=ce8c7035b6004d2f84c02ebc4a05f17b, scope.project.id=45c69e3e973c449895457bb610103a43, user.id=f890ff4e7807477db7f17c2f6434dce8) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:55.839289 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd0e9b8-245b-47d4-b6d6-e13dec28e789 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:55.840532 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd0e9b8-245b-47d4-b6d6-e13dec28e789 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:55.853873 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 270/531] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:41:55 2022] GET /identity/v3/role_assignments?user.id=f890ff4e7807477db7f17c2f6434dce8&scope.project.id=45c69e3e973c449895457bb610103a43&role.id=ce8c7035b6004d2f84c02ebc4a05f17b => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:55.853873 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0e9b8-245b-47d4-b6d6-e13dec28e789 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:55.860905 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576a23b-b284-4fe8-8dd2-08a1400c19d1 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:55.903610 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8d60b-cee2-4390-8c69-a28524721aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:55.904371 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8d60b-cee2-4390-8c69-a28524721aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:55.904812 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8d60b-cee2-4390-8c69-a28524721aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:55.905241 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8d60b-cee2-4390-8c69-a28524721aa9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:55.915161 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8d60b-cee2-4390-8c69-a28524721aa9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:55.917766 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8d60b-cee2-4390-8c69-a28524721aa9 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:55.937302 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-f9a8d60b-cee2-4390-8c69-a28524721aa9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:41:55.937302 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:55.937302 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:55.937302 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:55.937302 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:55.937302 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:55.937302 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:55.937302 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:55.937302 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:55.937302 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:55.937302 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:55.937302 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:55.937302 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:41:55.937302 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:41:55.937302 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:41:55.938377 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:41:55.938377 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:55.938377 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:55.938377 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:55.938377 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:55.938377 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:55.938377 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:55.938377 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:55.938377 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:55.938377 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:55.938377 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:55.938377 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:55.938377 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:55.938377 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:55.938377 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:55.938377 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:55.938377 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:55.939422 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:41:55.939422 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:41:55.939422 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:41:55.939422 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:41:55.939422 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:41:55.939422 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:41:55.939422 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:41:55.939422 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:55.941804 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 262/532] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:41:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:55.942868 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8d60b-cee2-4390-8c69-a28524721aa9 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:55.979190 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0e9b8-245b-47d4-b6d6-e13dec28e789 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:56.001685 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:56.012282 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:56.019078 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1a6d8-6f85-49a6-8011-a09fee8cf015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:56.019777 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1a6d8-6f85-49a6-8011-a09fee8cf015 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:56.020125 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1a6d8-6f85-49a6-8011-a09fee8cf015 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:56.020516 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1a6d8-6f85-49a6-8011-a09fee8cf015 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:56.021350 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1a6d8-6f85-49a6-8011-a09fee8cf015 None admin] RBAC: Adding query filter params (role.id=ce8c7035b6004d2f84c02ebc4a05f17b, scope.project.id=45c69e3e973c449895457bb610103a43, user.id=34fd9f7932e14a409d7668d40ff6680e) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:56.021760 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1a6d8-6f85-49a6-8011-a09fee8cf015 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:56.023340 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1a6d8-6f85-49a6-8011-a09fee8cf015 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:56.031581 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 271/533] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:41:55 2022] GET /identity/v3/role_assignments?user.id=34fd9f7932e14a409d7668d40ff6680e&scope.project.id=45c69e3e973c449895457bb610103a43&role.id=ce8c7035b6004d2f84c02ebc4a05f17b => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:56.032620 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1a6d8-6f85-49a6-8011-a09fee8cf015 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:56.082479 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8d60b-cee2-4390-8c69-a28524721aa9 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:56.163691 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1a6d8-6f85-49a6-8011-a09fee8cf015 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:56.187259 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c5dfd-f769-4804-9d22-653c5641c237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:56.187259 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c5dfd-f769-4804-9d22-653c5641c237 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:56.187790 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c5dfd-f769-4804-9d22-653c5641c237 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:56.188130 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c5dfd-f769-4804-9d22-653c5641c237 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:56.205316 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8cd04-f6d4-4e6b-8976-5729484ca061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:56.207576 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8cd04-f6d4-4e6b-8976-5729484ca061 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:56.208068 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8cd04-f6d4-4e6b-8976-5729484ca061 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:56.208545 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8cd04-f6d4-4e6b-8976-5729484ca061 None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:56.209738 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8cd04-f6d4-4e6b-8976-5729484ca061 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:56.210489 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8cd04-f6d4-4e6b-8976-5729484ca061 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:56.212734 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8cd04-f6d4-4e6b-8976-5729484ca061 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:56.229402 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 272/534] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:41:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:56.239457 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8cd04-f6d4-4e6b-8976-5729484ca061 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:56.303729 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c5dfd-f769-4804-9d22-653c5641c237 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:56.305246 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c5dfd-f769-4804-9d22-653c5641c237 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:56.322917 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:56.323468 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:56.375488 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8cd04-f6d4-4e6b-8976-5729484ca061 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:56.414970 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02013e-33dd-473c-af50-d7568edd092c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:56.415820 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02013e-33dd-473c-af50-d7568edd092c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:56.416227 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02013e-33dd-473c-af50-d7568edd092c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:56.416706 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02013e-33dd-473c-af50-d7568edd092c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:56.417673 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c02013e-33dd-473c-af50-d7568edd092c None admin] RBAC: Adding query filter params (role.id=ce8c7035b6004d2f84c02ebc4a05f17b, scope.project.id=45c69e3e973c449895457bb610103a43, user.id=3fbafa16c1ce4402ae4086e51767c05b) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:56.418155 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c02013e-33dd-473c-af50-d7568edd092c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:56.419752 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c02013e-33dd-473c-af50-d7568edd092c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:56.426511 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 273/535] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:41:56 2022] GET /identity/v3/role_assignments?user.id=3fbafa16c1ce4402ae4086e51767c05b&scope.project.id=45c69e3e973c449895457bb610103a43&role.id=ce8c7035b6004d2f84c02ebc4a05f17b => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:56.427930 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a54656-6e2e-4ee5-9616-df46f623b4ab None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:56.428413 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a54656-6e2e-4ee5-9616-df46f623b4ab None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:56.428945 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a54656-6e2e-4ee5-9616-df46f623b4ab None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:56.430684 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 274/536] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:56.436537 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867885c-d867-4a4d-9f8d-61947f74c50b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:56.436875 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867885c-d867-4a4d-9f8d-61947f74c50b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:56.437067 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867885c-d867-4a4d-9f8d-61947f74c50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:56.443282 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 263/537] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:41:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:41:56.450969 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c5dfd-f769-4804-9d22-653c5641c237 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:56.457441 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-5867885c-d867-4a4d-9f8d-61947f74c50b None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:56.465886 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-5867885c-d867-4a4d-9f8d-61947f74c50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:56.587249 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 275/538] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:41:56.613926 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c5dfd-f769-4804-9d22-653c5641c237 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:56.631019 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:56.655810 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41996ff1-846e-4aab-a68c-5e2096b94d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:56.656440 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41996ff1-846e-4aab-a68c-5e2096b94d15 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:56.656714 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41996ff1-846e-4aab-a68c-5e2096b94d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:56.656977 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41996ff1-846e-4aab-a68c-5e2096b94d15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:56.667506 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41996ff1-846e-4aab-a68c-5e2096b94d15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:56.668973 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41996ff1-846e-4aab-a68c-5e2096b94d15 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:56.683819 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-41996ff1-846e-4aab-a68c-5e2096b94d15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:56.683819 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:56.683819 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:56.683819 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:56.683819 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:56.683819 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:56.683819 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:56.683819 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:56.683819 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:56.683819 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:56.683819 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:56.683819 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:56.683819 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:41:56.683819 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:41:56.683819 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:41:56.683819 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:41:56.684756 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:56.684756 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:56.684756 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:56.684756 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:56.684756 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:56.684756 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:56.684756 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:56.684756 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:56.684756 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:56.684756 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:56.684756 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:56.684756 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:56.684756 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:56.684756 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:56.684756 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:56.684756 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:56.684756 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:41:56.685603 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:41:56.685603 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:56.685603 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:56.685603 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 264/539] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:41:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:56.690667 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867885c-d867-4a4d-9f8d-61947f74c50b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:56.741599 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:56.792187 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867885c-d867-4a4d-9f8d-61947f74c50b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:56.835463 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69c239-9518-4e2f-808c-f705a94e07d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:56.836076 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69c239-9518-4e2f-808c-f705a94e07d5 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:56.836354 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69c239-9518-4e2f-808c-f705a94e07d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:56.836620 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69c239-9518-4e2f-808c-f705a94e07d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:56.837267 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69c239-9518-4e2f-808c-f705a94e07d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:56.837566 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69c239-9518-4e2f-808c-f705a94e07d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:56.838969 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69c239-9518-4e2f-808c-f705a94e07d5 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:56.856529 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 276/540] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:56.862017 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41996ff1-846e-4aab-a68c-5e2096b94d15 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:56.942489 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69c239-9518-4e2f-808c-f705a94e07d5 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:56.997871 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41996ff1-846e-4aab-a68c-5e2096b94d15 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:57.032763 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307320d-5ee7-4f8c-848b-c53b288c845b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:57.033391 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307320d-5ee7-4f8c-848b-c53b288c845b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:57.033671 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307320d-5ee7-4f8c-848b-c53b288c845b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:57.033968 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307320d-5ee7-4f8c-848b-c53b288c845b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:57.041199 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307320d-5ee7-4f8c-848b-c53b288c845b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:57.042714 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307320d-5ee7-4f8c-848b-c53b288c845b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:57.056366 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-0307320d-5ee7-4f8c-848b-c53b288c845b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:41:57.056366 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:57.056366 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:57.056366 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:57.056366 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:57.056366 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:57.056366 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:57.056366 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:57.056366 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:57.056366 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:57.056366 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:57.056366 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:57.056366 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:41:57.056366 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:41:57.056366 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:41:57.057267 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:41:57.057267 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:57.057267 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:57.057267 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:57.057267 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:57.057267 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:57.057267 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:57.057267 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:57.057267 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:57.057267 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:57.057267 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:57.057267 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:57.057267 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:57.057267 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:57.057267 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:57.057267 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:57.057267 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:57.058151 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:41:57.058151 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:41:57.058151 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:41:57.058151 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:41:57.058151 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:41:57.058151 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:41:57.058151 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:41:57.058151 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:57.058151 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 265/541] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:41:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:57.066851 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307320d-5ee7-4f8c-848b-c53b288c845b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:57.122197 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:57.142199 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69c239-9518-4e2f-808c-f705a94e07d5 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:57.163610 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:57.208955 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c0a03-d95c-417d-bb23-238c901f9ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:57.209517 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c0a03-d95c-417d-bb23-238c901f9ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:57.209796 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c0a03-d95c-417d-bb23-238c901f9ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:57.210094 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c0a03-d95c-417d-bb23-238c901f9ca3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:57.230521 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c0a03-d95c-417d-bb23-238c901f9ca3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:57.235883 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-818c0a03-d95c-417d-bb23-238c901f9ca3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:41:57.235883 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:57.235883 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:57.235883 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:57.235883 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:57.235883 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:57.235883 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:57.235883 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:57.235883 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:57.235883 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:57.235883 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:57.235883 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:57.235883 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:57.235883 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:57.235883 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:57.235883 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:57.236775 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:57.236775 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:57.236775 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:57.236775 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:57.236775 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:57.236775 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:57.236775 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:57.236775 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:57.236775 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:57.236775 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:57.236775 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:57.236775 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:57.236775 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:57.236775 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:57.236775 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:57.236775 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:57.237559 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:57.237559 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:57.237559 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:57.237559 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:57.237559 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:57.237559 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:57.237559 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:57.237559 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:57.237559 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:57.237559 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:57.237559 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:41:57.237559 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:57.237559 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 277/542] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Aug 28 00:41:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:57.246781 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c0a03-d95c-417d-bb23-238c901f9ca3 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:57.284458 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307320d-5ee7-4f8c-848b-c53b288c845b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:57.355586 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a64756-b80c-4665-90f2-ff87842f8e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:57.356200 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a64756-b80c-4665-90f2-ff87842f8e07 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:57.356478 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a64756-b80c-4665-90f2-ff87842f8e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:57.356749 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a64756-b80c-4665-90f2-ff87842f8e07 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:57.357457 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a64756-b80c-4665-90f2-ff87842f8e07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:57.357895 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a64756-b80c-4665-90f2-ff87842f8e07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:57.359427 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a64756-b80c-4665-90f2-ff87842f8e07 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:57.399552 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 266/543] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:41:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:57.410902 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a64756-b80c-4665-90f2-ff87842f8e07 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:57.419130 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c0a03-d95c-417d-bb23-238c901f9ca3 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:57.464897 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c656c4-ac36-4e68-88e0-901b47fa2517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:57.466305 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c656c4-ac36-4e68-88e0-901b47fa2517 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:57.466815 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c656c4-ac36-4e68-88e0-901b47fa2517 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:57.467317 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c656c4-ac36-4e68-88e0-901b47fa2517 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:57.468547 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c656c4-ac36-4e68-88e0-901b47fa2517 None admin] RBAC: Adding query filter params (name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:57.469056 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c656c4-ac36-4e68-88e0-901b47fa2517 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:57.470961 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c656c4-ac36-4e68-88e0-901b47fa2517 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:57.482082 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 278/544] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Aug 28 00:41:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:57.486229 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c656c4-ac36-4e68-88e0-901b47fa2517 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:57.550893 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:57.565004 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a64756-b80c-4665-90f2-ff87842f8e07 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:57.572151 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:57.602664 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790b7a0-23a1-49d2-af01-b0243e00f0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:57.603628 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790b7a0-23a1-49d2-af01-b0243e00f0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:57.604294 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790b7a0-23a1-49d2-af01-b0243e00f0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:57.604764 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790b7a0-23a1-49d2-af01-b0243e00f0b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:57.605678 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790b7a0-23a1-49d2-af01-b0243e00f0b0 None admin] RBAC: Adding query filter params (role.id=ce8c7035b6004d2f84c02ebc4a05f17b, scope.project.id=45c69e3e973c449895457bb610103a43, user.id=0ca94d8693c64e388bd0d15db07f5fd4) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:57.606342 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790b7a0-23a1-49d2-af01-b0243e00f0b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:57.608090 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790b7a0-23a1-49d2-af01-b0243e00f0b0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:57.618408 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 267/545] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:41:57 2022] GET /identity/v3/role_assignments?user.id=0ca94d8693c64e388bd0d15db07f5fd4&scope.project.id=45c69e3e973c449895457bb610103a43&role.id=ce8c7035b6004d2f84c02ebc4a05f17b => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:41:57.690420 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c656c4-ac36-4e68-88e0-901b47fa2517 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:57.730822 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef49d7-3f91-4585-a258-a56d8ca0f919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:57.731386 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef49d7-3f91-4585-a258-a56d8ca0f919 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:57.731666 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef49d7-3f91-4585-a258-a56d8ca0f919 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:57.731935 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef49d7-3f91-4585-a258-a56d8ca0f919 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:57.743913 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef49d7-3f91-4585-a258-a56d8ca0f919 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:57.745463 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef49d7-3f91-4585-a258-a56d8ca0f919 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:57.760935 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-41ef49d7-3f91-4585-a258-a56d8ca0f919 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:57.760935 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:57.760935 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:57.760935 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:57.760935 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:57.760935 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:57.760935 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:57.760935 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:57.760935 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:57.760935 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:57.760935 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:57.760935 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:57.760935 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:41:57.760935 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:41:57.760935 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:41:57.760935 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:41:57.761918 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:57.761918 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:57.761918 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:57.761918 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:57.761918 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:57.761918 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:57.761918 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:57.761918 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:57.761918 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:57.761918 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:57.761918 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:57.761918 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:57.761918 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:57.761918 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:57.761918 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:57.761918 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:57.761918 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:41:57.762784 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:41:57.762784 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:57.762784 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:57.762784 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 279/546] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:41:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:57.768587 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790b7a0-23a1-49d2-af01-b0243e00f0b0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:57.946198 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790b7a0-23a1-49d2-af01-b0243e00f0b0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:58.002163 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296894d-3d43-4de6-9ea3-003ca81a7ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:58.002693 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296894d-3d43-4de6-9ea3-003ca81a7ffa None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:58.002971 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296894d-3d43-4de6-9ea3-003ca81a7ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:58.003247 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296894d-3d43-4de6-9ea3-003ca81a7ffa None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:58.003900 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296894d-3d43-4de6-9ea3-003ca81a7ffa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:58.004257 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296894d-3d43-4de6-9ea3-003ca81a7ffa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:58.005648 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296894d-3d43-4de6-9ea3-003ca81a7ffa None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:58.020662 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 268/547] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:58.026136 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef49d7-3f91-4585-a258-a56d8ca0f919 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:58.134731 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:58.158340 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef49d7-3f91-4585-a258-a56d8ca0f919 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:58.201272 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bb9de-086c-4aba-8fdc-e4e009f0517c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:58.202010 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bb9de-086c-4aba-8fdc-e4e009f0517c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:58.202293 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bb9de-086c-4aba-8fdc-e4e009f0517c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:58.202566 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bb9de-086c-4aba-8fdc-e4e009f0517c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:58.203388 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e88b3-759c-4ae6-8071-bd3e57f7c99b None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:58.203679 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e88b3-759c-4ae6-8071-bd3e57f7c99b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:58.203956 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e88b3-759c-4ae6-8071-bd3e57f7c99b None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:58.205647 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 269/548] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:58.211319 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17bb9de-086c-4aba-8fdc-e4e009f0517c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:58.212717 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17bb9de-086c-4aba-8fdc-e4e009f0517c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:58.213208 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dbb4d-e440-4b63-959e-e14eb3fad9b1 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:58.213493 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dbb4d-e440-4b63-959e-e14eb3fad9b1 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:58.213765 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dbb4d-e440-4b63-959e-e14eb3fad9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:58.225335 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-c17bb9de-086c-4aba-8fdc-e4e009f0517c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:41:58.225335 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:58.225335 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:58.225335 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:58.225335 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:58.225335 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:58.225335 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:58.225335 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:58.225335 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:58.225335 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:58.225335 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:58.225335 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:58.225335 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:41:58.225335 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:41:58.225335 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:41:58.225335 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:41:58.227282 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:58.227282 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:58.227282 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:41:58.227282 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:41:58.227282 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:41:58.227282 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:41:58.227282 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:58.227282 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:58.227282 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:58.227282 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:58.227282 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:58.227282 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:58.227282 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:58.227282 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:58.227282 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:58.227282 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:58.227282 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:58.227282 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:58.228693 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:58.228693 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:58.228693 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:41:58.228693 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:41:58.228693 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:41:58.228693 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:41:58.228693 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:41:58.228693 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:41:58.228693 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:41:58.228693 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:58.228693 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 280/549] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:41:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:58.232299 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bb9de-086c-4aba-8fdc-e4e009f0517c None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:58.257752 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-aa3dbb4d-e440-4b63-959e-e14eb3fad9b1 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:58.258888 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-aa3dbb4d-e440-4b63-959e-e14eb3fad9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:58.260967 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:58.333500 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bb9de-086c-4aba-8fdc-e4e009f0517c None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:58.376966 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4cf8e5-dc23-490e-b7d5-90de505235b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:58.377580 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cf8e5-dc23-490e-b7d5-90de505235b3 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:58.377889 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cf8e5-dc23-490e-b7d5-90de505235b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:58.378151 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cf8e5-dc23-490e-b7d5-90de505235b3 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:58.378892 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4cf8e5-dc23-490e-b7d5-90de505235b3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:58.379197 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4cf8e5-dc23-490e-b7d5-90de505235b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:58.380646 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4cf8e5-dc23-490e-b7d5-90de505235b3 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:58.392237 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 270/550] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:58.403826 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 281/551] 10.222.0.52 () {56 vars in 1135 bytes} [Sun Aug 28 00:41:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:58.409554 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dbb4d-e440-4b63-959e-e14eb3fad9b1 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:58.419511 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c676b17-6d9e-465f-9152-ec96c1156419 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:58.420088 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c676b17-6d9e-465f-9152-ec96c1156419 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:58.420779 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c676b17-6d9e-465f-9152-ec96c1156419 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:58.423710 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 282/552] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:58.428046 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59511b3d-eb46-4e39-88f1-a0e255bf90b5 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:58.428540 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59511b3d-eb46-4e39-88f1-a0e255bf90b5 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:58.429005 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59511b3d-eb46-4e39-88f1-a0e255bf90b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:58.437108 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:58.448658 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-59511b3d-eb46-4e39-88f1-a0e255bf90b5 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:58.450183 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-59511b3d-eb46-4e39-88f1-a0e255bf90b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:58.577429 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 283/553] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:41:58.589184 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dbb4d-e440-4b63-959e-e14eb3fad9b1 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:58.624262 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218de43e-aeed-4718-89ff-330f0e20849d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:58.624873 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218de43e-aeed-4718-89ff-330f0e20849d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:58.625155 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218de43e-aeed-4718-89ff-330f0e20849d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:58.625434 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218de43e-aeed-4718-89ff-330f0e20849d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:58.640914 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:58.729207 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218de43e-aeed-4718-89ff-330f0e20849d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:58.730821 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218de43e-aeed-4718-89ff-330f0e20849d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:58.741350 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59511b3d-eb46-4e39-88f1-a0e255bf90b5 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:58.855118 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 271/554] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:41:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:41:58.856458 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ae268-f220-4778-aade-74e94a6cb389 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:58.856746 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ae268-f220-4778-aade-74e94a6cb389 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:58.857018 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ae268-f220-4778-aade-74e94a6cb389 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:58.858648 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 272/555] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:58.865180 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07196e3-1ec7-4e6d-aee7-1e1d74271806 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:58.865519 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07196e3-1ec7-4e6d-aee7-1e1d74271806 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:58.865772 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07196e3-1ec7-4e6d-aee7-1e1d74271806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:58.886831 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f07196e3-1ec7-4e6d-aee7-1e1d74271806 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:41:58.888595 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f07196e3-1ec7-4e6d-aee7-1e1d74271806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:41:58.891107 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59511b3d-eb46-4e39-88f1-a0e255bf90b5 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:58.922265 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:58.923499 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:58.928872 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca3891-ed45-4fae-903f-cd9322c78b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:58.929712 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca3891-ed45-4fae-903f-cd9322c78b0a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:58.930023 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca3891-ed45-4fae-903f-cd9322c78b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:58.930296 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca3891-ed45-4fae-903f-cd9322c78b0a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:58.943849 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca3891-ed45-4fae-903f-cd9322c78b0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:58.948936 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-c3ca3891-ed45-4fae-903f-cd9322c78b0a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:41:58.948936 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:58.948936 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:58.948936 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:58.948936 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:58.948936 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:58.948936 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:58.948936 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:58.948936 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:58.948936 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:58.948936 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:58.948936 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:58.948936 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:58.948936 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:58.948936 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:58.948936 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:58.949866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:58.949866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:58.949866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:58.949866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:58.949866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:58.949866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:58.949866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:58.949866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:58.949866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:58.949866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:58.949866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:58.949866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:58.949866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:58.949866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:58.949866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:58.949866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:58.950732 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:58.950732 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:58.950732 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:58.950732 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:58.950732 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:58.950732 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:58.950732 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:58.950732 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:58.950732 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:58.950732 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:58.950732 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:41:58.950732 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:58.950732 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 284/556] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Aug 28 00:41:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:58.951497 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca3891-ed45-4fae-903f-cd9322c78b0a None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:58.978091 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 273/557] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:41:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:41:58.979360 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07196e3-1ec7-4e6d-aee7-1e1d74271806 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:59.067317 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca3891-ed45-4fae-903f-cd9322c78b0a None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:59.087459 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07196e3-1ec7-4e6d-aee7-1e1d74271806 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:59.103615 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c9fd2-a687-46ba-9886-1ebcab28c9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:59.104359 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c9fd2-a687-46ba-9886-1ebcab28c9d0 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:59.104667 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c9fd2-a687-46ba-9886-1ebcab28c9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:59.104986 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c9fd2-a687-46ba-9886-1ebcab28c9d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:59.117511 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c9fd2-a687-46ba-9886-1ebcab28c9d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:59.119226 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c9fd2-a687-46ba-9886-1ebcab28c9d0 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:59.128319 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5be37-e135-4da9-9c02-5efe7686e5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:59.129288 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5be37-e135-4da9-9c02-5efe7686e5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:59.129740 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5be37-e135-4da9-9c02-5efe7686e5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:59.130222 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5be37-e135-4da9-9c02-5efe7686e5e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:59.131064 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d5be37-e135-4da9-9c02-5efe7686e5e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:59.131575 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d5be37-e135-4da9-9c02-5efe7686e5e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:59.133175 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d5be37-e135-4da9-9c02-5efe7686e5e7 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:59.135794 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-343c9fd2-a687-46ba-9886-1ebcab28c9d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:59.135794 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:59.135794 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:59.135794 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:59.135794 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:59.135794 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:59.135794 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:59.135794 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:59.135794 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:59.135794 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:59.135794 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:59.135794 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:59.135794 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:41:59.135794 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:41:59.135794 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:41:59.135794 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:41:59.136757 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:59.136757 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:59.136757 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:59.136757 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:59.136757 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:59.136757 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:59.136757 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:59.136757 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:59.136757 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:59.136757 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:59.136757 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:59.136757 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:59.136757 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:59.136757 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:59.136757 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:59.136757 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:59.136757 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:41:59.137645 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:41:59.137645 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:59.137645 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:59.141700 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 285/558] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:59.142824 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c9fd2-a687-46ba-9886-1ebcab28c9d0 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:59.146389 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 274/559] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Aug 28 00:41:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:59.147537 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5be37-e135-4da9-9c02-5efe7686e5e7 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:59.181006 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:59.193954 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:59.254116 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c9fd2-a687-46ba-9886-1ebcab28c9d0 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:59.260751 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5be37-e135-4da9-9c02-5efe7686e5e7 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:59.290333 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29d29c-9b8c-4604-a15b-0473079df15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:59.290942 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29d29c-9b8c-4604-a15b-0473079df15e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:59.291222 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29d29c-9b8c-4604-a15b-0473079df15e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:59.291494 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29d29c-9b8c-4604-a15b-0473079df15e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:59.299617 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c30828-77ac-4a25-82da-d99e543dbce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:59.300488 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c30828-77ac-4a25-82da-d99e543dbce6 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:59.300960 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c30828-77ac-4a25-82da-d99e543dbce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:59.301696 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c30828-77ac-4a25-82da-d99e543dbce6 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:59.302039 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29d29c-9b8c-4604-a15b-0473079df15e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:59.302741 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c30828-77ac-4a25-82da-d99e543dbce6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:59.303214 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c30828-77ac-4a25-82da-d99e543dbce6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:59.304761 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c30828-77ac-4a25-82da-d99e543dbce6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:59.307651 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-1d29d29c-9b8c-4604-a15b-0473079df15e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:41:59.307651 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:59.307651 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:59.307651 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:59.307651 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:59.307651 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:59.307651 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:59.307651 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:59.307651 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:59.307651 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:59.307651 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:59.307651 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:59.307651 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:59.307651 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:59.307651 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:59.307651 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:59.308581 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:59.308581 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:59.308581 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:59.308581 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:59.308581 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:59.308581 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:59.308581 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:59.308581 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:59.308581 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:59.308581 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:59.308581 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:59.308581 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:59.308581 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:59.308581 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:59.308581 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:59.308581 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:59.309419 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:59.309419 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:59.309419 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:59.309419 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:59.309419 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:59.309419 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:59.309419 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:59.309419 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:59.309419 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:59.309419 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:59.309419 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:41:59.309419 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:59.309419 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 286/560] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Aug 28 00:41:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:59.309419 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29d29c-9b8c-4604-a15b-0473079df15e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:59.327034 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 275/561] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:59.327034 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c30828-77ac-4a25-82da-d99e543dbce6 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:59.421320 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29d29c-9b8c-4604-a15b-0473079df15e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:59.423663 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:59.425466 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:59.434553 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c30828-77ac-4a25-82da-d99e543dbce6 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:59.461168 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74d21a-7acf-4ed2-80ad-fb2d14e9ae35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:59.461798 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74d21a-7acf-4ed2-80ad-fb2d14e9ae35 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:59.462103 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74d21a-7acf-4ed2-80ad-fb2d14e9ae35 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:59.462374 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74d21a-7acf-4ed2-80ad-fb2d14e9ae35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:59.470111 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedfabe-6228-408e-876b-38482583b293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:59.470493 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedfabe-6228-408e-876b-38482583b293 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:59.470772 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedfabe-6228-408e-876b-38482583b293 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:59.471045 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedfabe-6228-408e-876b-38482583b293 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:59.473790 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74d21a-7acf-4ed2-80ad-fb2d14e9ae35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:59.475280 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74d21a-7acf-4ed2-80ad-fb2d14e9ae35 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:59.482207 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daedfabe-6228-408e-876b-38482583b293 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:41:59.487581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-daedfabe-6228-408e-876b-38482583b293 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:41:59.487581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:59.487581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:59.487581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:59.487581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:59.487581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:59.487581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:59.487581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:59.487581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:59.487581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:59.487581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:59.487581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:59.487581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:41:59.487581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:41:59.487581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:41:59.487581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:41:59.488520 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:41:59.488520 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:41:59.488520 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:41:59.488520 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:41:59.488520 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:59.488520 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:59.488520 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:59.488520 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:59.488520 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:59.488520 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:59.488520 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:59.488520 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:59.488520 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:59.488520 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:59.488520 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:59.488520 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:59.489351 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:59.489351 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:59.489351 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:59.489351 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:59.489351 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:41:59.489351 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:41:59.489351 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:41:59.489351 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:41:59.489351 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:41:59.489351 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:41:59.489351 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:41:59.489351 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:59.490056 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-2f74d21a-7acf-4ed2-80ad-fb2d14e9ae35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:59.490056 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:59.490056 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:59.490056 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:59.490056 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:59.490056 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:59.490056 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:59.490056 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:59.490056 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:59.490056 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:59.490056 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:59.490056 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:59.490056 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:41:59.490056 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:41:59.490056 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:41:59.490056 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:41:59.490991 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:59.490991 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:59.490991 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:59.490991 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:59.490991 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:59.490991 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:59.490991 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:59.490991 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:59.490991 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:59.490991 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:59.490991 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:59.490991 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:59.490991 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:59.490991 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:59.490991 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:59.490991 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:59.490991 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:41:59.499301 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:41:59.499301 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:59.499301 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:59.499301 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 287/562] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:41:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:59.499301 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74d21a-7acf-4ed2-80ad-fb2d14e9ae35 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:59.500028 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 276/563] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Aug 28 00:41:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:59.500028 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedfabe-6228-408e-876b-38482583b293 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:59.598250 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74d21a-7acf-4ed2-80ad-fb2d14e9ae35 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:59.615895 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedfabe-6228-408e-876b-38482583b293 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:59.631959 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497c12e-3855-42e1-adbb-fec694c72941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:59.632568 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497c12e-3855-42e1-adbb-fec694c72941 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:59.632854 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497c12e-3855-42e1-adbb-fec694c72941 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:59.633126 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497c12e-3855-42e1-adbb-fec694c72941 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:59.633792 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497c12e-3855-42e1-adbb-fec694c72941 None admin] RBAC: Adding query filter params (name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:59.634131 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497c12e-3855-42e1-adbb-fec694c72941 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:59.635520 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497c12e-3855-42e1-adbb-fec694c72941 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:59.643721 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 288/564] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Aug 28 00:41:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:59.644535 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497c12e-3855-42e1-adbb-fec694c72941 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:59.659425 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270b908-8a11-48b4-b8d1-4559c009ea84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:59.660310 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270b908-8a11-48b4-b8d1-4559c009ea84 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:59.660731 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270b908-8a11-48b4-b8d1-4559c009ea84 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:59.661330 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270b908-8a11-48b4-b8d1-4559c009ea84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:59.665801 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:59.670278 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270b908-8a11-48b4-b8d1-4559c009ea84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:59.671949 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270b908-8a11-48b4-b8d1-4559c009ea84 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:59.683564 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-2270b908-8a11-48b4-b8d1-4559c009ea84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:41:59.683564 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:59.683564 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:59.683564 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:59.683564 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:59.683564 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:59.683564 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:59.683564 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:59.683564 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:59.683564 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:59.683564 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:59.683564 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:59.683564 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:41:59.683564 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:41:59.683564 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:41:59.684476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:41:59.684476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:59.684476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:59.684476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:59.684476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:59.684476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:59.684476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:59.684476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:59.684476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:59.684476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:59.684476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:59.684476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:59.684476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:59.684476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:59.684476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:59.684476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:59.684476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:59.685369 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:41:59.685369 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:41:59.685369 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:41:59.685369 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:41:59.685369 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:41:59.685369 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:41:59.685369 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:41:59.685369 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:41:59.685369 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 277/565] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:41:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:59.685999 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270b908-8a11-48b4-b8d1-4559c009ea84 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:59.703063 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:59.759784 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497c12e-3855-42e1-adbb-fec694c72941 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:59.794753 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a71c6-b969-4e26-b257-38a2c807cb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:59.795415 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a71c6-b969-4e26-b257-38a2c807cb9e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:59.795772 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a71c6-b969-4e26-b257-38a2c807cb9e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:59.796050 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a71c6-b969-4e26-b257-38a2c807cb9e None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:59.796716 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220a71c6-b969-4e26-b257-38a2c807cb9e None admin] RBAC: Adding query filter params (name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:59.797020 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220a71c6-b969-4e26-b257-38a2c807cb9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:59.798456 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220a71c6-b969-4e26-b257-38a2c807cb9e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:59.801819 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270b908-8a11-48b4-b8d1-4559c009ea84 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:59.806373 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 289/566] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Aug 28 00:41:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:59.807281 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a71c6-b969-4e26-b257-38a2c807cb9e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:59.840295 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368c4db-01bc-46ad-97ab-a7d28cebbd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:59.840915 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368c4db-01bc-46ad-97ab-a7d28cebbd38 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:59.841187 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368c4db-01bc-46ad-97ab-a7d28cebbd38 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:59.841451 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368c4db-01bc-46ad-97ab-a7d28cebbd38 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:59.842163 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368c4db-01bc-46ad-97ab-a7d28cebbd38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:59.842456 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368c4db-01bc-46ad-97ab-a7d28cebbd38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:59.843841 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368c4db-01bc-46ad-97ab-a7d28cebbd38 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:59.855967 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 278/567] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:41:59.856537 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368c4db-01bc-46ad-97ab-a7d28cebbd38 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:59.892255 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:59.912164 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a71c6-b969-4e26-b257-38a2c807cb9e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:59.927554 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:41:59.944983 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d3e75-2456-4d13-8beb-a3b6dc0df80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:59.945597 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d3e75-2456-4d13-8beb-a3b6dc0df80f None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:59.945885 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d3e75-2456-4d13-8beb-a3b6dc0df80f None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:59.946155 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d3e75-2456-4d13-8beb-a3b6dc0df80f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:59.956700 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d3e75-2456-4d13-8beb-a3b6dc0df80f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:59.957561 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368c4db-01bc-46ad-97ab-a7d28cebbd38 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:41:59.958187 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d3e75-2456-4d13-8beb-a3b6dc0df80f None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:41:59.972560 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-492d3e75-2456-4d13-8beb-a3b6dc0df80f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:59.972560 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:41:59.972560 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:41:59.972560 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:41:59.972560 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:41:59.972560 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:41:59.972560 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:41:59.972560 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:41:59.972560 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:41:59.972560 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:41:59.972560 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:41:59.972560 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:41:59.972560 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:41:59.972560 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:41:59.972560 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:41:59.972560 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:41:59.973571 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:41:59.973571 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:41:59.973571 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:41:59.973571 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:41:59.973571 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:41:59.973571 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:41:59.973571 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:41:59.973571 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:41:59.973571 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:41:59.973571 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:41:59.973571 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:41:59.973571 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:41:59.973571 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:41:59.973571 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:41:59.973571 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:41:59.973571 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:41:59.973571 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:41:59.974481 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:41:59.974481 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:41:59.974481 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:41:59.974481 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 290/568] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:41:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:41:59.975115 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a023a0c-2ffb-4213-876b-e839d21986ca None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:59.975368 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a023a0c-2ffb-4213-876b-e839d21986ca None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:59.975631 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a023a0c-2ffb-4213-876b-e839d21986ca None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:59.976834 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 291/569] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:41:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:41:59.977503 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a023a0c-2ffb-4213-876b-e839d21986ca None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:41:59.996000 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4229f-df90-46eb-bcc2-263e943f6fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:41:59.996598 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4229f-df90-46eb-bcc2-263e943f6fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:41:59.996870 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4229f-df90-46eb-bcc2-263e943f6fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:41:59.997131 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4229f-df90-46eb-bcc2-263e943f6fc2 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:41:59.997820 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4229f-df90-46eb-bcc2-263e943f6fc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:41:59.998144 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4229f-df90-46eb-bcc2-263e943f6fc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:41:59.999627 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4229f-df90-46eb-bcc2-263e943f6fc2 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:00.010662 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 279/570] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:41:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:00.011419 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4229f-df90-46eb-bcc2-263e943f6fc2 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:00.087689 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a023a0c-2ffb-4213-876b-e839d21986ca None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:00.118018 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:00.123705 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9fcc5-a521-459c-a443-2a64c3d00ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:00.124329 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9fcc5-a521-459c-a443-2a64c3d00ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:00.124605 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9fcc5-a521-459c-a443-2a64c3d00ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:00.124884 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9fcc5-a521-459c-a443-2a64c3d00ae5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:00.131525 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4229f-df90-46eb-bcc2-263e943f6fc2 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:00.135361 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9fcc5-a521-459c-a443-2a64c3d00ae5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:00.136817 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9fcc5-a521-459c-a443-2a64c3d00ae5 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:00.151098 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-5ea9fcc5-a521-459c-a443-2a64c3d00ae5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:00.151098 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:00.151098 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:00.151098 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:00.151098 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:00.151098 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:00.151098 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:00.151098 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:00.151098 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:00.151098 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:00.151098 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:00.151098 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:00.151098 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:00.151098 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:00.151098 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:00.151098 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:00.152162 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:00.152162 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:00.152162 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:00.152162 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:00.152162 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:00.152162 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:00.152162 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:00.152162 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:00.152162 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:00.152162 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:00.152162 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:00.152162 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:00.152162 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:00.152162 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:00.152162 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:00.152162 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:00.152162 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:00.153309 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:00.153309 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:00.153309 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:00.157017 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 292/571] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:41:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:00.157927 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9fcc5-a521-459c-a443-2a64c3d00ae5 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:00.163016 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:00.168891 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c320e5-6434-4ae0-82a9-841e048bb323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:00.169601 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c320e5-6434-4ae0-82a9-841e048bb323 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:00.169910 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c320e5-6434-4ae0-82a9-841e048bb323 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:00.170243 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c320e5-6434-4ae0-82a9-841e048bb323 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:00.177892 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c320e5-6434-4ae0-82a9-841e048bb323 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:00.179279 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c320e5-6434-4ae0-82a9-841e048bb323 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:00.191110 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-f9c320e5-6434-4ae0-82a9-841e048bb323 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:42:00.191110 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:00.191110 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:00.191110 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:00.191110 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:00.191110 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:00.191110 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:00.191110 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:00.191110 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:00.191110 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:00.191110 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:00.191110 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:00.191110 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:42:00.191110 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:42:00.191110 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:42:00.191110 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:42:00.196810 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:00.196810 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:00.196810 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:42:00.196810 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:00.196810 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:42:00.196810 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:00.196810 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:00.196810 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:00.196810 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:00.196810 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:00.196810 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:00.196810 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:00.196810 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:00.196810 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:00.196810 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:00.196810 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:00.196810 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:00.196810 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:00.198094 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:00.198094 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:00.198094 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:42:00.198094 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:42:00.198094 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:42:00.198094 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:42:00.198094 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:42:00.198094 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:42:00.198094 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:42:00.198094 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:00.198094 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 280/572] 10.222.0.52 () {56 vars in 1093 bytes} [Sun Aug 28 00:42:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:00.198094 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c812cef-6b7d-4192-bdec-dd7eeeb50f4a None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:00.198094 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c812cef-6b7d-4192-bdec-dd7eeeb50f4a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:00.198887 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c812cef-6b7d-4192-bdec-dd7eeeb50f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:00.211750 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-5c812cef-6b7d-4192-bdec-dd7eeeb50f4a None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:00.212948 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5c812cef-6b7d-4192-bdec-dd7eeeb50f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:00.255633 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9fcc5-a521-459c-a443-2a64c3d00ae5 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:00.281214 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 281/573] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:42:00.281826 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c812cef-6b7d-4192-bdec-dd7eeeb50f4a None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:00.290171 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fbb2b-0d27-47d1-b09f-b6afb2d7f903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:00.290780 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fbb2b-0d27-47d1-b09f-b6afb2d7f903 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:00.291061 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fbb2b-0d27-47d1-b09f-b6afb2d7f903 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:00.291329 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fbb2b-0d27-47d1-b09f-b6afb2d7f903 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:00.291959 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fbb2b-0d27-47d1-b09f-b6afb2d7f903 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:00.292257 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fbb2b-0d27-47d1-b09f-b6afb2d7f903 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:00.293824 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fbb2b-0d27-47d1-b09f-b6afb2d7f903 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:00.307012 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 293/574] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:00.307745 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fbb2b-0d27-47d1-b09f-b6afb2d7f903 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:00.356172 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:00.393581 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c812cef-6b7d-4192-bdec-dd7eeeb50f4a None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:00.414446 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fbb2b-0d27-47d1-b09f-b6afb2d7f903 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:00.419080 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:00.435412 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c98a47-5223-4e42-85bf-18513a523254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:00.436226 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c98a47-5223-4e42-85bf-18513a523254 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:00.436596 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c98a47-5223-4e42-85bf-18513a523254 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:00.436963 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c98a47-5223-4e42-85bf-18513a523254 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:00.437801 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c98a47-5223-4e42-85bf-18513a523254 None admin] RBAC: Adding query filter params (role.id=ce8c7035b6004d2f84c02ebc4a05f17b, scope.project.id=45c69e3e973c449895457bb610103a43, user.id=a80a6019cf424c16a1d461a632cf8568) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:00.438235 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c98a47-5223-4e42-85bf-18513a523254 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:00.439775 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c98a47-5223-4e42-85bf-18513a523254 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:00.453875 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 282/575] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:42:00 2022] GET /identity/v3/role_assignments?user.id=a80a6019cf424c16a1d461a632cf8568&scope.project.id=45c69e3e973c449895457bb610103a43&role.id=ce8c7035b6004d2f84c02ebc4a05f17b => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:00.453875 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c98a47-5223-4e42-85bf-18513a523254 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:00.465908 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cae19-e128-474e-b19e-5c8794c6a013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:00.466656 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cae19-e128-474e-b19e-5c8794c6a013 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:00.466935 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cae19-e128-474e-b19e-5c8794c6a013 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:00.467623 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cae19-e128-474e-b19e-5c8794c6a013 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:00.468360 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02cae19-e128-474e-b19e-5c8794c6a013 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:00.468664 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02cae19-e128-474e-b19e-5c8794c6a013 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:00.470487 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02cae19-e128-474e-b19e-5c8794c6a013 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:00.487596 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 294/576] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:00.488593 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cae19-e128-474e-b19e-5c8794c6a013 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:00.575568 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c98a47-5223-4e42-85bf-18513a523254 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:00.615358 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf440fec-974d-4609-8da2-e724b99d73f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:00.616212 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf440fec-974d-4609-8da2-e724b99d73f1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:00.616777 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf440fec-974d-4609-8da2-e724b99d73f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:00.616777 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf440fec-974d-4609-8da2-e724b99d73f1 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:00.617461 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf440fec-974d-4609-8da2-e724b99d73f1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:00.617759 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf440fec-974d-4609-8da2-e724b99d73f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:00.619234 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf440fec-974d-4609-8da2-e724b99d73f1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:00.619939 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cae19-e128-474e-b19e-5c8794c6a013 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:00.624508 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:00.639080 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 283/577] 10.222.0.52 () {56 vars in 1133 bytes} [Sun Aug 28 00:42:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:00.639080 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf440fec-974d-4609-8da2-e724b99d73f1 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:00.666454 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032221b-b85a-4a0b-a923-e82ca04ad318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:00.667082 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032221b-b85a-4a0b-a923-e82ca04ad318 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:00.667357 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032221b-b85a-4a0b-a923-e82ca04ad318 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:00.667621 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032221b-b85a-4a0b-a923-e82ca04ad318 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:00.676922 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1032221b-b85a-4a0b-a923-e82ca04ad318 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:00.678428 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1032221b-b85a-4a0b-a923-e82ca04ad318 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:00.689407 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:00.691016 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-1032221b-b85a-4a0b-a923-e82ca04ad318 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 28 00:42:00.691016 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:00.691016 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:00.691016 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:00.691016 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:00.691016 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:00.691016 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:00.691016 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:00.691016 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:00.691016 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:00.691016 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:00.691016 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:00.691016 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:42:00.691016 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:42:00.691016 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:42:00.691016 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:42:00.692306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:00.692306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:00.692306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:42:00.692306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:00.692306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:42:00.692306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:00.692306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:00.692306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:00.692306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:00.692306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:00.692306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:00.692306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:00.692306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:00.692306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:00.692306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:00.692306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:00.692306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:00.692306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:00.693238 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:00.693238 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:00.693238 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:42:00.693238 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:42:00.693238 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:42:00.693238 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:42:00.693238 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:42:00.693238 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:42:00.693238 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 28 00:42:00.693238 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:00.697022 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 295/578] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:42:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:00.697906 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032221b-b85a-4a0b-a923-e82ca04ad318 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:00.751255 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf440fec-974d-4609-8da2-e724b99d73f1 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:00.787989 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff4b02-cb27-4c77-9836-167ce1bd1d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:00.788948 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff4b02-cb27-4c77-9836-167ce1bd1d88 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:00.789451 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff4b02-cb27-4c77-9836-167ce1bd1d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:00.789879 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff4b02-cb27-4c77-9836-167ce1bd1d88 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:00.797720 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff4b02-cb27-4c77-9836-167ce1bd1d88 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:00.799460 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff4b02-cb27-4c77-9836-167ce1bd1d88 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:00.803569 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032221b-b85a-4a0b-a923-e82ca04ad318 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:00.811896 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-faff4b02-cb27-4c77-9836-167ce1bd1d88 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 00:42:00.811896 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:00.811896 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:00.811896 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:00.811896 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:00.811896 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:00.811896 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:00.811896 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:00.811896 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:00.811896 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:00.811896 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:00.811896 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:00.811896 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:42:00.811896 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:42:00.811896 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:42:00.811896 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:42:00.813004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:00.813004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:00.813004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:42:00.813004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:00.813004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:42:00.813004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:00.813004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:00.813004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:00.813004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:00.813004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:00.813004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:00.813004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:00.813004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:00.813004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:00.813004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:00.813004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:00.813004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:00.813004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:00.814130 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:00.814130 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:00.814130 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:42:00.814130 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:42:00.814130 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:42:00.814130 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:42:00.814130 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:42:00.814130 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:42:00.814130 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 00:42:00.814130 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:00.816003 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 284/579] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:42:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:00.816898 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff4b02-cb27-4c77-9836-167ce1bd1d88 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:00.858194 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f288a-cfa4-41ad-bdbe-c8955bbb55ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:00.858825 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f288a-cfa4-41ad-bdbe-c8955bbb55ad None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:00.859108 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f288a-cfa4-41ad-bdbe-c8955bbb55ad None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:00.859371 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f288a-cfa4-41ad-bdbe-c8955bbb55ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:00.869715 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f288a-cfa4-41ad-bdbe-c8955bbb55ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:42:00.875177 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-e83f288a-cfa4-41ad-bdbe-c8955bbb55ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:42:00.875177 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:00.875177 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:00.875177 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:00.875177 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:00.875177 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:00.875177 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:00.875177 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:00.875177 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:00.875177 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:00.875177 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:00.875177 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:00.875177 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:42:00.875177 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:42:00.875177 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:42:00.875177 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:42:00.876330 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:42:00.876330 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:42:00.876330 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:42:00.876330 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:42:00.876330 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:00.876330 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:00.876330 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:00.876330 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:00.876330 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:00.876330 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:00.876330 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:00.876330 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:00.876330 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:00.876330 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:00.876330 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:00.876330 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:00.877159 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:00.877159 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:00.877159 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:00.877159 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:00.877159 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:42:00.877159 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:42:00.877159 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:42:00.877159 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:42:00.877159 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:42:00.877159 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:42:00.877159 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:42:00.877159 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:00.877159 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 296/580] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Aug 28 00:42:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:00.877832 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f288a-cfa4-41ad-bdbe-c8955bbb55ad None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:00.906053 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:00.937589 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff4b02-cb27-4c77-9836-167ce1bd1d88 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:00.939177 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:00.974149 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998177d-64bc-4309-87d9-042bb911d5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:00.974695 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998177d-64bc-4309-87d9-042bb911d5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:00.974975 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998177d-64bc-4309-87d9-042bb911d5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:00.975245 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998177d-64bc-4309-87d9-042bb911d5e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:00.985537 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998177d-64bc-4309-87d9-042bb911d5e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:00.987041 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998177d-64bc-4309-87d9-042bb911d5e7 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:00.987448 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f288a-cfa4-41ad-bdbe-c8955bbb55ad None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:01.002390 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-e998177d-64bc-4309-87d9-042bb911d5e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:01.002390 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:01.002390 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:01.002390 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:01.002390 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:01.002390 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:01.002390 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:01.002390 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:01.002390 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:01.002390 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:01.002390 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:01.002390 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:01.002390 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:01.002390 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:01.002390 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:01.002390 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:01.003523 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:01.003523 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:01.003523 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:01.003523 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:01.003523 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:01.003523 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:01.003523 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:01.003523 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:01.003523 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:01.003523 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:01.003523 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:01.003523 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:01.003523 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:01.003523 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:01.003523 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:01.003523 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:01.003523 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:01.004395 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:01.004395 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:01.004395 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:01.004395 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 285/581] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:01.004395 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998177d-64bc-4309-87d9-042bb911d5e7 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:01.032357 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01777f0-2672-45f0-9d96-f2dedbe4b5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:01.033182 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01777f0-2672-45f0-9d96-f2dedbe4b5a0 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:01.033596 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01777f0-2672-45f0-9d96-f2dedbe4b5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:01.034078 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01777f0-2672-45f0-9d96-f2dedbe4b5a0 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:01.034812 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01777f0-2672-45f0-9d96-f2dedbe4b5a0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:01.035112 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01777f0-2672-45f0-9d96-f2dedbe4b5a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:01.036555 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01777f0-2672-45f0-9d96-f2dedbe4b5a0 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:01.059206 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 297/582] 10.222.0.52 () {56 vars in 1137 bytes} [Sun Aug 28 00:42:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:01.059206 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01777f0-2672-45f0-9d96-f2dedbe4b5a0 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:01.118796 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998177d-64bc-4309-87d9-042bb911d5e7 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:01.140992 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:01.157133 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67617673-9f97-4b1e-8f4a-66ac78d6293b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:01.157735 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67617673-9f97-4b1e-8f4a-66ac78d6293b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:01.158045 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67617673-9f97-4b1e-8f4a-66ac78d6293b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:01.158313 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67617673-9f97-4b1e-8f4a-66ac78d6293b None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:01.159037 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67617673-9f97-4b1e-8f4a-66ac78d6293b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:01.159443 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67617673-9f97-4b1e-8f4a-66ac78d6293b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:01.160766 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67617673-9f97-4b1e-8f4a-66ac78d6293b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:01.161672 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01777f0-2672-45f0-9d96-f2dedbe4b5a0 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:01.183006 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 286/583] 10.222.0.52 () {56 vars in 1137 bytes} [Sun Aug 28 00:42:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:01.183006 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67617673-9f97-4b1e-8f4a-66ac78d6293b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:01.195763 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:01.204828 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ba95b-798d-424e-b402-d0f7ba7920a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:01.205602 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ba95b-798d-424e-b402-d0f7ba7920a4 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:01.205913 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ba95b-798d-424e-b402-d0f7ba7920a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:01.206506 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ba95b-798d-424e-b402-d0f7ba7920a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:01.207452 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ba95b-798d-424e-b402-d0f7ba7920a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:01.207761 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ba95b-798d-424e-b402-d0f7ba7920a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:01.209636 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ba95b-798d-424e-b402-d0f7ba7920a4 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:01.220482 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 298/584] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Aug 28 00:42:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:01.222704 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ba95b-798d-424e-b402-d0f7ba7920a4 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:01.287038 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67617673-9f97-4b1e-8f4a-66ac78d6293b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:01.324205 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c010cf5-f4fa-4c14-ac8d-15972f693358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:01.324829 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c010cf5-f4fa-4c14-ac8d-15972f693358 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:01.325094 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c010cf5-f4fa-4c14-ac8d-15972f693358 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:01.325363 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c010cf5-f4fa-4c14-ac8d-15972f693358 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:01.326042 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c010cf5-f4fa-4c14-ac8d-15972f693358 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:01.326347 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c010cf5-f4fa-4c14-ac8d-15972f693358 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:01.327817 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c010cf5-f4fa-4c14-ac8d-15972f693358 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:01.330661 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ba95b-798d-424e-b402-d0f7ba7920a4 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:01.343541 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 287/585] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:01.343541 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c010cf5-f4fa-4c14-ac8d-15972f693358 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:01.370861 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1009130-e4f2-42dd-a587-2ce41d737071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:01.371420 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1009130-e4f2-42dd-a587-2ce41d737071 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:01.371696 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1009130-e4f2-42dd-a587-2ce41d737071 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:01.371964 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1009130-e4f2-42dd-a587-2ce41d737071 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:01.382877 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1009130-e4f2-42dd-a587-2ce41d737071 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:01.384408 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1009130-e4f2-42dd-a587-2ce41d737071 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:01.387552 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:01.401443 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-a1009130-e4f2-42dd-a587-2ce41d737071 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:01.401443 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:01.401443 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:01.401443 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:01.401443 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:01.401443 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:01.401443 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:01.401443 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:01.401443 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:01.401443 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:01.401443 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:01.401443 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:01.401443 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:01.401443 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:01.401443 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:01.401443 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:01.402485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:01.402485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:01.402485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:01.402485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:01.402485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:01.402485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:01.402485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:01.402485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:01.402485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:01.402485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:01.402485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:01.402485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:01.402485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:01.402485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:01.402485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:01.402485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:01.402485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:01.403383 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:01.403383 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:01.403383 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:01.403383 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 299/586] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:01.403383 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1009130-e4f2-42dd-a587-2ce41d737071 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:01.417214 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:01.449514 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c010cf5-f4fa-4c14-ac8d-15972f693358 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:01.488416 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b637e6-c968-467c-bfc6-c3a444c5cc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:01.489325 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b637e6-c968-467c-bfc6-c3a444c5cc90 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:01.489756 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b637e6-c968-467c-bfc6-c3a444c5cc90 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:01.490060 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b637e6-c968-467c-bfc6-c3a444c5cc90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:01.500999 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b637e6-c968-467c-bfc6-c3a444c5cc90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:01.502511 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b637e6-c968-467c-bfc6-c3a444c5cc90 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:01.512621 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1009130-e4f2-42dd-a587-2ce41d737071 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:01.519570 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-e8b637e6-c968-467c-bfc6-c3a444c5cc90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:01.519570 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:01.519570 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:01.519570 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:01.519570 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:01.519570 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:01.519570 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:01.519570 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:01.519570 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:01.519570 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:01.519570 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:01.519570 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:01.519570 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:01.519570 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:01.519570 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:01.519570 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:01.520752 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:01.520752 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:01.520752 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:01.520752 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:01.520752 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:01.520752 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:01.520752 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:01.520752 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:01.520752 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:01.520752 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:01.520752 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:01.520752 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:01.520752 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:01.520752 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:01.520752 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:01.520752 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:01.520752 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:01.521690 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:01.521690 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:01.521690 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:01.521690 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 288/587] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:01.521951 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b637e6-c968-467c-bfc6-c3a444c5cc90 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:01.559877 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0ad75-dfac-49ff-87c7-fe5989bc5f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:01.560501 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0ad75-dfac-49ff-87c7-fe5989bc5f9a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:01.560799 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0ad75-dfac-49ff-87c7-fe5989bc5f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:01.561246 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0ad75-dfac-49ff-87c7-fe5989bc5f9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:01.571915 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0ad75-dfac-49ff-87c7-fe5989bc5f9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:01.573358 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0ad75-dfac-49ff-87c7-fe5989bc5f9a None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:01.587287 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-d1b0ad75-dfac-49ff-87c7-fe5989bc5f9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:01.587287 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:01.587287 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:01.587287 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:01.587287 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:01.587287 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:01.587287 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:01.587287 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:01.587287 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:01.587287 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:01.587287 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:01.587287 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:01.587287 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:01.587287 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:01.587287 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:01.587287 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:01.588329 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:01.588329 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:01.588329 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:01.588329 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:01.588329 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:01.588329 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:01.588329 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:01.588329 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:01.588329 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:01.588329 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:01.588329 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:01.588329 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:01.588329 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:01.588329 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:01.588329 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:01.588329 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:01.588329 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:01.589246 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:01.589246 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:01.589246 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:01.589246 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 300/588] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:01.589246 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0ad75-dfac-49ff-87c7-fe5989bc5f9a None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:01.636177 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b637e6-c968-467c-bfc6-c3a444c5cc90 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:01.641952 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:01.661174 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:01.672623 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6667e78-f967-4601-9f8c-f4a780e1b21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:01.673255 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6667e78-f967-4601-9f8c-f4a780e1b21c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:01.673759 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6667e78-f967-4601-9f8c-f4a780e1b21c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:01.673968 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6667e78-f967-4601-9f8c-f4a780e1b21c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:01.681617 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6667e78-f967-4601-9f8c-f4a780e1b21c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:01.683405 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6667e78-f967-4601-9f8c-f4a780e1b21c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:01.695915 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-a6667e78-f967-4601-9f8c-f4a780e1b21c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:01.695915 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:01.695915 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:01.695915 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:01.695915 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:01.695915 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:01.695915 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:01.695915 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:01.695915 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:01.695915 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:01.695915 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:01.695915 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:01.695915 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:42:01.695915 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:42:01.695915 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:42:01.696855 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:42:01.696855 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:01.696855 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:01.696855 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:01.696855 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:01.696855 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:01.696855 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:01.696855 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:01.696855 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:01.696855 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:01.696855 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:01.696855 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:01.696855 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:01.696855 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:01.696855 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:01.696855 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:01.696855 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:01.698406 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:42:01.698406 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:42:01.698406 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:42:01.698406 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:42:01.698406 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:42:01.698406 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:42:01.698406 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:01.698406 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:01.698842 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0ad75-dfac-49ff-87c7-fe5989bc5f9a None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:01.698927 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 289/589] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:42:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:01.698927 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6667e78-f967-4601-9f8c-f4a780e1b21c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:01.736854 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91942dd2-295e-4cb0-835b-42058cc08bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:01.737458 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91942dd2-295e-4cb0-835b-42058cc08bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:01.737732 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91942dd2-295e-4cb0-835b-42058cc08bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:01.738028 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91942dd2-295e-4cb0-835b-42058cc08bf8 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:01.738662 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91942dd2-295e-4cb0-835b-42058cc08bf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:01.738959 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91942dd2-295e-4cb0-835b-42058cc08bf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:01.740323 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91942dd2-295e-4cb0-835b-42058cc08bf8 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:01.756805 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 301/590] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:01.756805 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91942dd2-295e-4cb0-835b-42058cc08bf8 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:01.808742 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6667e78-f967-4601-9f8c-f4a780e1b21c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:01.845501 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261e224-c8e2-45d1-a581-e1b5016d77a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:01.846139 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261e224-c8e2-45d1-a581-e1b5016d77a9 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:01.846419 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261e224-c8e2-45d1-a581-e1b5016d77a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:01.846689 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261e224-c8e2-45d1-a581-e1b5016d77a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:01.847342 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261e224-c8e2-45d1-a581-e1b5016d77a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:01.847636 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261e224-c8e2-45d1-a581-e1b5016d77a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:01.849025 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261e224-c8e2-45d1-a581-e1b5016d77a9 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:01.856433 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91942dd2-295e-4cb0-835b-42058cc08bf8 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:01.866817 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 290/591] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:01.867600 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:01.868268 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261e224-c8e2-45d1-a581-e1b5016d77a9 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:01.901988 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af1dcd-d8d2-49a4-ad67-855091bbedf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:01.902593 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af1dcd-d8d2-49a4-ad67-855091bbedf6 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:01.902866 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af1dcd-d8d2-49a4-ad67-855091bbedf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:01.903132 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af1dcd-d8d2-49a4-ad67-855091bbedf6 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:01.903768 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af1dcd-d8d2-49a4-ad67-855091bbedf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:01.904065 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af1dcd-d8d2-49a4-ad67-855091bbedf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:01.905560 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af1dcd-d8d2-49a4-ad67-855091bbedf6 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:01.917070 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:01.917242 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 302/592] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:01.922503 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af1dcd-d8d2-49a4-ad67-855091bbedf6 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:01.981392 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261e224-c8e2-45d1-a581-e1b5016d77a9 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:02.016824 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99c6b9-5590-4b1a-86ab-f1610991236c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:02.017487 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99c6b9-5590-4b1a-86ab-f1610991236c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:02.017693 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99c6b9-5590-4b1a-86ab-f1610991236c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:02.017989 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99c6b9-5590-4b1a-86ab-f1610991236c None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:02.018678 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d99c6b9-5590-4b1a-86ab-f1610991236c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:02.018975 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d99c6b9-5590-4b1a-86ab-f1610991236c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:02.020454 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d99c6b9-5590-4b1a-86ab-f1610991236c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:02.027947 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af1dcd-d8d2-49a4-ad67-855091bbedf6 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:02.032495 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 291/593] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:42:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:02.034748 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99c6b9-5590-4b1a-86ab-f1610991236c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:02.063558 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790488f7-a892-47a4-841e-104db86ac068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:02.064101 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790488f7-a892-47a4-841e-104db86ac068 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:02.064374 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790488f7-a892-47a4-841e-104db86ac068 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:02.064639 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790488f7-a892-47a4-841e-104db86ac068 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:02.071442 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790488f7-a892-47a4-841e-104db86ac068 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:02.072896 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790488f7-a892-47a4-841e-104db86ac068 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:02.084032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-790488f7-a892-47a4-841e-104db86ac068 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:02.084032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:02.084032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:02.084032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:02.084032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:02.084032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:02.084032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:02.084032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:02.084032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:02.084032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:02.084032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:02.084032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:02.084032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:42:02.084032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:42:02.084032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:42:02.084959 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:42:02.084959 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:02.084959 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:02.084959 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:02.084959 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:02.084959 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:02.084959 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:02.084959 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:02.084959 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:02.084959 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:02.084959 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:02.084959 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:02.084959 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:02.084959 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:02.084959 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:02.084959 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:02.084959 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:02.086331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:42:02.086331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:42:02.086331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:42:02.086331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:42:02.086331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:42:02.086331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:42:02.086331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:02.086331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:02.086331 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 303/594] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:42:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:02.086331 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790488f7-a892-47a4-841e-104db86ac068 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:02.114504 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:02.152665 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99c6b9-5590-4b1a-86ab-f1610991236c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:02.156869 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:02.189122 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790488f7-a892-47a4-841e-104db86ac068 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:02.191267 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddf6a5-5c6b-475e-8ffc-a9f4152272f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:02.191903 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddf6a5-5c6b-475e-8ffc-a9f4152272f4 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:02.192179 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddf6a5-5c6b-475e-8ffc-a9f4152272f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:02.192447 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddf6a5-5c6b-475e-8ffc-a9f4152272f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:02.199239 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ddf6a5-5c6b-475e-8ffc-a9f4152272f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:02.200693 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ddf6a5-5c6b-475e-8ffc-a9f4152272f4 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:02.212984 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-d3ddf6a5-5c6b-475e-8ffc-a9f4152272f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:02.212984 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:02.212984 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:02.212984 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:02.212984 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:02.212984 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:02.212984 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:02.212984 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:02.212984 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:02.212984 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:02.212984 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:02.212984 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:02.212984 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:42:02.212984 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:42:02.212984 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:42:02.213962 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:42:02.213962 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:02.213962 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:02.213962 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:02.213962 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:02.213962 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:02.213962 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:02.213962 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:02.213962 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:02.213962 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:02.213962 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:02.213962 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:02.213962 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:02.213962 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:02.213962 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:02.213962 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:02.213962 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:02.214861 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:42:02.214861 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:42:02.214861 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:42:02.214861 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:42:02.214861 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:42:02.214861 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:42:02.214861 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:02.214861 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:02.214861 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 292/595] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:42:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:02.214861 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddf6a5-5c6b-475e-8ffc-a9f4152272f4 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:02.229231 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f646b-e96d-436b-b59c-573937ae155e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:02.229882 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f646b-e96d-436b-b59c-573937ae155e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:02.230160 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f646b-e96d-436b-b59c-573937ae155e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:02.230427 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f646b-e96d-436b-b59c-573937ae155e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:02.238049 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f646b-e96d-436b-b59c-573937ae155e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:02.239728 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f646b-e96d-436b-b59c-573937ae155e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:02.250892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-926f646b-e96d-436b-b59c-573937ae155e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 00:42:02.250892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:02.250892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:02.250892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:02.250892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:02.250892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:02.250892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:02.250892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:02.250892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:02.250892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:02.250892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:02.250892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:02.250892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:42:02.250892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:42:02.250892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:42:02.250892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:42:02.251977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:02.251977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:02.251977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:42:02.251977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:02.251977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:42:02.251977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:02.251977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:02.251977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:02.251977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:02.251977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:02.251977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:02.251977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:02.251977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:02.251977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:02.251977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:02.251977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:02.251977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:02.251977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:02.253469 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:02.253469 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:02.253469 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:42:02.253469 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:42:02.253469 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:42:02.253469 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:42:02.253469 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:42:02.253469 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:42:02.253469 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 00:42:02.253469 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:02.253469 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 304/596] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Aug 28 00:42:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:02.253469 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f646b-e96d-436b-b59c-573937ae155e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:02.326037 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddf6a5-5c6b-475e-8ffc-a9f4152272f4 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:02.346134 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:02.359531 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f646b-e96d-436b-b59c-573937ae155e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:02.365226 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd989468-83e0-423a-a484-9b0c4956c9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:02.365923 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd989468-83e0-423a-a484-9b0c4956c9d6 None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:02.366208 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd989468-83e0-423a-a484-9b0c4956c9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:02.366483 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd989468-83e0-423a-a484-9b0c4956c9d6 None admin] PATH_INFO: `/v3/projects/45c69e3e973c449895457bb610103a43/users/f890ff4e7807477db7f17c2f6434dce8/roles/ce8c7035b6004d2f84c02ebc4a05f17b` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:02.381402 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd989468-83e0-423a-a484-9b0c4956c9d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=45c69e3e973c449895457bb610103a43, user_id=f890ff4e7807477db7f17c2f6434dce8, role_id=ce8c7035b6004d2f84c02ebc4a05f17b)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:02.382897 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd989468-83e0-423a-a484-9b0c4956c9d6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:02.393927 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572517f-c34d-4b38-8af2-2e4f0a16c02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:02.394535 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572517f-c34d-4b38-8af2-2e4f0a16c02e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:02.394817 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572517f-c34d-4b38-8af2-2e4f0a16c02e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:02.395089 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572517f-c34d-4b38-8af2-2e4f0a16c02e None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:02.395724 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 293/597] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Aug 28 00:42:02 2022] PUT /identity/v3/projects/45c69e3e973c449895457bb610103a43/users/f890ff4e7807477db7f17c2f6434dce8/roles/ce8c7035b6004d2f84c02ebc4a05f17b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:42:02.395814 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572517f-c34d-4b38-8af2-2e4f0a16c02e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:02.396076 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572517f-c34d-4b38-8af2-2e4f0a16c02e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:02.396522 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd989468-83e0-423a-a484-9b0c4956c9d6 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:02.397574 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572517f-c34d-4b38-8af2-2e4f0a16c02e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:02.410883 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 305/598] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:42:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:02.414942 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572517f-c34d-4b38-8af2-2e4f0a16c02e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:02.424640 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:02.536083 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd989468-83e0-423a-a484-9b0c4956c9d6 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:02.552821 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572517f-c34d-4b38-8af2-2e4f0a16c02e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:02.580256 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178d632-b12c-49d3-ad1b-b39f3981fd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:02.580846 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178d632-b12c-49d3-ad1b-b39f3981fd01 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:02.581126 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178d632-b12c-49d3-ad1b-b39f3981fd01 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:02.581446 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178d632-b12c-49d3-ad1b-b39f3981fd01 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:02.582264 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178d632-b12c-49d3-ad1b-b39f3981fd01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:02.582569 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178d632-b12c-49d3-ad1b-b39f3981fd01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:02.584022 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178d632-b12c-49d3-ad1b-b39f3981fd01 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:02.589332 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2d419-0cc0-4dce-95de-ba8f6ef1f9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:02.590018 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2d419-0cc0-4dce-95de-ba8f6ef1f9eb None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:02.590294 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2d419-0cc0-4dce-95de-ba8f6ef1f9eb None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:02.590673 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2d419-0cc0-4dce-95de-ba8f6ef1f9eb None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:02.591449 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f2d419-0cc0-4dce-95de-ba8f6ef1f9eb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:02.591753 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f2d419-0cc0-4dce-95de-ba8f6ef1f9eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:02.593377 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f2d419-0cc0-4dce-95de-ba8f6ef1f9eb None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:02.596795 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 294/599] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:42:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:02.600552 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081bc7c-5779-4641-a465-9895bbec70f3 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:02.600552 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081bc7c-5779-4641-a465-9895bbec70f3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:02.600552 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081bc7c-5779-4641-a465-9895bbec70f3 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:02.600552 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 295/600] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:02.600899 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081bc7c-5779-4641-a465-9895bbec70f3 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:02.615288 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 306/601] 10.222.0.52 () {56 vars in 1139 bytes} [Sun Aug 28 00:42:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:02.616435 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2d419-0cc0-4dce-95de-ba8f6ef1f9eb None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:02.625260 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:02.691262 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:02.717835 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081bc7c-5779-4641-a465-9895bbec70f3 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:02.730884 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2d419-0cc0-4dce-95de-ba8f6ef1f9eb None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:02.752418 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f6d8d-1009-42f5-815d-0fdbeabe0a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:02.753102 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f6d8d-1009-42f5-815d-0fdbeabe0a48 None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:02.753340 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f6d8d-1009-42f5-815d-0fdbeabe0a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:02.753607 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f6d8d-1009-42f5-815d-0fdbeabe0a48 None admin] PATH_INFO: `/v3/projects/45c69e3e973c449895457bb610103a43/users/34fd9f7932e14a409d7668d40ff6680e/roles/ce8c7035b6004d2f84c02ebc4a05f17b` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:02.768822 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f6d8d-1009-42f5-815d-0fdbeabe0a48 None admin] RBAC: Authorizing `identity:create_grant(project_id=45c69e3e973c449895457bb610103a43, user_id=34fd9f7932e14a409d7668d40ff6680e, role_id=ce8c7035b6004d2f84c02ebc4a05f17b)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:02.769728 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a180d-593f-4fc2-8c22-633e9bec2c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:02.770300 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f6d8d-1009-42f5-815d-0fdbeabe0a48 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:02.770416 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a180d-593f-4fc2-8c22-633e9bec2c4b None admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:02.770697 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a180d-593f-4fc2-8c22-633e9bec2c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:02.770968 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a180d-593f-4fc2-8c22-633e9bec2c4b None admin] PATH_INFO: `/v3/projects/45c69e3e973c449895457bb610103a43/users/3fbafa16c1ce4402ae4086e51767c05b/roles/ce8c7035b6004d2f84c02ebc4a05f17b` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:02.793873 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 296/602] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Aug 28 00:42:02 2022] PUT /identity/v3/projects/45c69e3e973c449895457bb610103a43/users/34fd9f7932e14a409d7668d40ff6680e/roles/ce8c7035b6004d2f84c02ebc4a05f17b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:42:02.793873 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebdbd1-b716-49a1-81fa-1f26e161886f None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:02.793873 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebdbd1-b716-49a1-81fa-1f26e161886f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:02.793873 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebdbd1-b716-49a1-81fa-1f26e161886f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:02.796343 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a180d-593f-4fc2-8c22-633e9bec2c4b None admin] RBAC: Authorizing `identity:create_grant(project_id=45c69e3e973c449895457bb610103a43, user_id=3fbafa16c1ce4402ae4086e51767c05b, role_id=ce8c7035b6004d2f84c02ebc4a05f17b)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:02.798567 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a180d-593f-4fc2-8c22-633e9bec2c4b None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:02.816650 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c1ebdbd1-b716-49a1-81fa-1f26e161886f None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:02.818027 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c1ebdbd1-b716-49a1-81fa-1f26e161886f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:02.821935 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 307/603] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Aug 28 00:42:02 2022] PUT /identity/v3/projects/45c69e3e973c449895457bb610103a43/users/3fbafa16c1ce4402ae4086e51767c05b/roles/ce8c7035b6004d2f84c02ebc4a05f17b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:42:02.822917 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a180d-593f-4fc2-8c22-633e9bec2c4b None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:02.965226 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 297/604] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:42:02.971928 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:03.030601 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a180d-593f-4fc2-8c22-633e9bec2c4b None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:03.069036 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909cd98-df3a-4785-b5b5-b632f1dfeda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:03.070018 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909cd98-df3a-4785-b5b5-b632f1dfeda0 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:03.070475 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909cd98-df3a-4785-b5b5-b632f1dfeda0 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:03.070923 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909cd98-df3a-4785-b5b5-b632f1dfeda0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:03.083013 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909cd98-df3a-4785-b5b5-b632f1dfeda0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:03.084780 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909cd98-df3a-4785-b5b5-b632f1dfeda0 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:03.101183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-4909cd98-df3a-4785-b5b5-b632f1dfeda0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:03.101183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:03.101183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:03.101183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:03.101183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:03.101183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:03.101183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:03.101183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:03.101183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:03.101183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:03.101183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:03.101183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:03.101183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:03.101183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:03.101183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:03.101183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:03.102190 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:03.102190 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:03.102190 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:03.102190 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:03.102190 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:03.102190 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:03.102190 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:03.102190 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:03.102190 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:03.102190 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:03.102190 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:03.102190 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:03.102190 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:03.102190 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:03.102190 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:03.102190 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:03.102190 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:03.103107 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:03.103107 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:03.103107 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:03.104977 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 308/605] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:03.110889 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebdbd1-b716-49a1-81fa-1f26e161886f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:03.199087 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:03.264763 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebdbd1-b716-49a1-81fa-1f26e161886f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:03.309931 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78643a-2f2c-4ff0-a05c-bbcb139fbd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:03.310542 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78643a-2f2c-4ff0-a05c-bbcb139fbd57 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:03.311082 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78643a-2f2c-4ff0-a05c-bbcb139fbd57 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:03.311360 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78643a-2f2c-4ff0-a05c-bbcb139fbd57 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:03.312090 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78643a-2f2c-4ff0-a05c-bbcb139fbd57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:03.312391 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78643a-2f2c-4ff0-a05c-bbcb139fbd57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:03.313773 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78643a-2f2c-4ff0-a05c-bbcb139fbd57 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:03.329069 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 298/606] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:03.334258 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909cd98-df3a-4785-b5b5-b632f1dfeda0 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:03.408304 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78643a-2f2c-4ff0-a05c-bbcb139fbd57 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:03.474982 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909cd98-df3a-4785-b5b5-b632f1dfeda0 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:03.489096 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:03.515031 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8904c0-afbf-4305-9203-bf9e212b1388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:03.515578 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8904c0-afbf-4305-9203-bf9e212b1388 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:03.515856 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8904c0-afbf-4305-9203-bf9e212b1388 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:03.516128 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8904c0-afbf-4305-9203-bf9e212b1388 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:03.523885 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8904c0-afbf-4305-9203-bf9e212b1388 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:03.525348 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8904c0-afbf-4305-9203-bf9e212b1388 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:03.538643 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-3d8904c0-afbf-4305-9203-bf9e212b1388 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:03.538643 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:03.538643 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:03.538643 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:03.538643 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:03.538643 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:03.538643 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:03.538643 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:03.538643 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:03.538643 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:03.538643 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:03.538643 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:03.538643 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:42:03.538643 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:42:03.538643 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:42:03.539483 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:42:03.539483 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:03.539483 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:03.539483 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:03.539483 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:03.539483 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:03.539483 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:03.539483 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:03.539483 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:03.539483 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:03.539483 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:03.539483 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:03.539483 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:03.539483 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:03.539483 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:03.539483 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:03.539483 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:03.540395 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:42:03.540395 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:42:03.540395 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:42:03.540395 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:42:03.540395 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:42:03.540395 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:42:03.540395 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:03.540395 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:03.540395 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 309/607] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:42:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:03.547797 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8904c0-afbf-4305-9203-bf9e212b1388 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:03.655550 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8904c0-afbf-4305-9203-bf9e212b1388 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:03.690469 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5f11b-7622-43af-b29c-acb675f75681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:03.691639 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5f11b-7622-43af-b29c-acb675f75681 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:03.692142 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5f11b-7622-43af-b29c-acb675f75681 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:03.692511 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5f11b-7622-43af-b29c-acb675f75681 None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:03.693305 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5f11b-7622-43af-b29c-acb675f75681 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:03.697859 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5f11b-7622-43af-b29c-acb675f75681 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:03.697859 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5f11b-7622-43af-b29c-acb675f75681 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:03.708719 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 310/608] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:42:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:03.710505 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78643a-2f2c-4ff0-a05c-bbcb139fbd57 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:03.723900 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5f11b-7622-43af-b29c-acb675f75681 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:03.734221 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:03.771507 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad338f-d38a-4d5a-9b6d-d5725af26092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:03.772364 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad338f-d38a-4d5a-9b6d-d5725af26092 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:03.772797 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad338f-d38a-4d5a-9b6d-d5725af26092 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:03.773202 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad338f-d38a-4d5a-9b6d-d5725af26092 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:03.790199 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:03.798370 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad338f-d38a-4d5a-9b6d-d5725af26092 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:42:03.803631 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-01ad338f-d38a-4d5a-9b6d-d5725af26092 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:42:03.803631 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:03.803631 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:03.803631 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:03.803631 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:03.803631 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:03.803631 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:03.803631 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:03.803631 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:03.803631 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:03.803631 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:03.803631 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:03.803631 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:42:03.803631 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:42:03.803631 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:42:03.803631 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:42:03.804729 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:42:03.804729 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:42:03.804729 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:42:03.804729 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:42:03.804729 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:03.804729 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:03.804729 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:03.804729 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:03.804729 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:03.804729 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:03.804729 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:03.804729 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:03.804729 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:03.804729 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:03.804729 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:03.804729 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:03.805767 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:03.805767 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:03.805767 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:03.805767 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:03.805767 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:42:03.805767 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:42:03.805767 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:42:03.805767 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:42:03.805767 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:42:03.805767 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:42:03.805767 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:42:03.805767 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:03.814220 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 299/609] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Aug 28 00:42:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:03.815135 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad338f-d38a-4d5a-9b6d-d5725af26092 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:03.902726 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5f11b-7622-43af-b29c-acb675f75681 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:03.934529 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad338f-d38a-4d5a-9b6d-d5725af26092 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:03.971178 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168d387-6205-46ff-9910-3bc1718888d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:03.972006 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168d387-6205-46ff-9910-3bc1718888d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:03.972854 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168d387-6205-46ff-9910-3bc1718888d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:03.973611 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3c16e-09c7-4583-b07e-43ec894cf221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:03.974032 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168d387-6205-46ff-9910-3bc1718888d7 None admin] PATH_INFO: `/v3/projects/45c69e3e973c449895457bb610103a43/users/0ca94d8693c64e388bd0d15db07f5fd4/roles/ce8c7035b6004d2f84c02ebc4a05f17b` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:03.974716 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3c16e-09c7-4583-b07e-43ec894cf221 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:03.976043 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3c16e-09c7-4583-b07e-43ec894cf221 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:03.976400 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3c16e-09c7-4583-b07e-43ec894cf221 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:03.978588 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3c16e-09c7-4583-b07e-43ec894cf221 None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:03.979041 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3c16e-09c7-4583-b07e-43ec894cf221 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:03.980507 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3c16e-09c7-4583-b07e-43ec894cf221 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:03.999271 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 300/610] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Aug 28 00:42:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:04.001228 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168d387-6205-46ff-9910-3bc1718888d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=45c69e3e973c449895457bb610103a43, user_id=0ca94d8693c64e388bd0d15db07f5fd4, role_id=ce8c7035b6004d2f84c02ebc4a05f17b)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:04.003605 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3c16e-09c7-4583-b07e-43ec894cf221 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:04.004302 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168d387-6205-46ff-9910-3bc1718888d7 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:04.033971 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 311/611] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Aug 28 00:42:03 2022] PUT /identity/v3/projects/45c69e3e973c449895457bb610103a43/users/0ca94d8693c64e388bd0d15db07f5fd4/roles/ce8c7035b6004d2f84c02ebc4a05f17b => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:42:04.054233 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:04.125541 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3c16e-09c7-4583-b07e-43ec894cf221 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:04.163208 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1de668-b449-4b94-83db-4189e4284f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:04.163897 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1de668-b449-4b94-83db-4189e4284f61 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:04.164172 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1de668-b449-4b94-83db-4189e4284f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:04.164438 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1de668-b449-4b94-83db-4189e4284f61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:04.176821 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1de668-b449-4b94-83db-4189e4284f61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:04.178340 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1de668-b449-4b94-83db-4189e4284f61 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:04.193762 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-ea1de668-b449-4b94-83db-4189e4284f61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:04.193762 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:04.193762 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:04.193762 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:04.193762 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:04.193762 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:04.193762 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:04.193762 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:04.193762 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:04.193762 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:04.193762 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:04.193762 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:04.193762 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:04.193762 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:04.193762 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:04.193762 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:04.194808 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:04.194808 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:04.194808 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:04.194808 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:04.194808 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:04.194808 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:04.194808 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:04.194808 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:04.194808 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:04.194808 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:04.194808 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:04.194808 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:04.194808 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:04.194808 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:04.194808 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:04.194808 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:04.194808 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:04.195720 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:04.195720 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:04.195720 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:04.195720 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 301/612] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:42:04.203366 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168d387-6205-46ff-9910-3bc1718888d7 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:04.309562 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:04.334571 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168d387-6205-46ff-9910-3bc1718888d7 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:04.385519 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c990e5-510b-4ea0-b4da-1612a5cff16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:04.386166 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c990e5-510b-4ea0-b4da-1612a5cff16f None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:04.386441 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c990e5-510b-4ea0-b4da-1612a5cff16f None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:04.386710 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c990e5-510b-4ea0-b4da-1612a5cff16f None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:04.387353 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c990e5-510b-4ea0-b4da-1612a5cff16f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:04.387716 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c990e5-510b-4ea0-b4da-1612a5cff16f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:04.389231 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c990e5-510b-4ea0-b4da-1612a5cff16f None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:04.405904 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a16c6-982f-45de-aa70-f8fc51a714ac None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:04.406230 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a16c6-982f-45de-aa70-f8fc51a714ac None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:04.406446 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a16c6-982f-45de-aa70-f8fc51a714ac None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:04.407190 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 312/613] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:04.409076 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 302/614] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:04.412185 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c990e5-510b-4ea0-b4da-1612a5cff16f None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:04.413250 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f5cdc-26bc-4c91-bb3b-8e82a6c0fea3 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:04.413531 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f5cdc-26bc-4c91-bb3b-8e82a6c0fea3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:04.413803 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f5cdc-26bc-4c91-bb3b-8e82a6c0fea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:04.438847 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f27f5cdc-26bc-4c91-bb3b-8e82a6c0fea3 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:04.440046 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f27f5cdc-26bc-4c91-bb3b-8e82a6c0fea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:04.524173 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c990e5-510b-4ea0-b4da-1612a5cff16f None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:04.531935 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 303/615] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:42:04.559497 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93620d2e-277d-4fb9-b81f-594962ade531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:04.560313 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93620d2e-277d-4fb9-b81f-594962ade531 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:04.560590 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93620d2e-277d-4fb9-b81f-594962ade531 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:04.560970 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93620d2e-277d-4fb9-b81f-594962ade531 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:04.582538 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93620d2e-277d-4fb9-b81f-594962ade531 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:04.584816 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93620d2e-277d-4fb9-b81f-594962ade531 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:04.590105 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:04.604303 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-93620d2e-277d-4fb9-b81f-594962ade531 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:42:04.604303 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:04.604303 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:04.604303 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:04.604303 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:04.604303 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:04.604303 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:04.604303 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:04.604303 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:04.604303 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:04.604303 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:04.604303 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:04.604303 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:42:04.604303 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:42:04.604303 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:42:04.604303 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:42:04.605321 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:04.605321 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:04.605321 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:42:04.605321 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:04.605321 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:42:04.605321 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:04.605321 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:04.605321 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:04.605321 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:04.605321 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:04.605321 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:04.605321 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:04.605321 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:04.605321 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:04.605321 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:04.605321 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:04.605321 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:04.605321 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:04.606316 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:04.606316 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:04.606316 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:42:04.606316 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:42:04.606316 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:42:04.606316 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:42:04.606316 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:42:04.606316 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:42:04.606316 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:42:04.606316 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:04.606316 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 313/616] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:42:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:04.612103 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f5cdc-26bc-4c91-bb3b-8e82a6c0fea3 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:04.646210 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:04.752634 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f5cdc-26bc-4c91-bb3b-8e82a6c0fea3 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:04.795246 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2448db-230b-4817-afc9-17ab2568d132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:04.795857 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2448db-230b-4817-afc9-17ab2568d132 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:04.796129 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2448db-230b-4817-afc9-17ab2568d132 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:04.796400 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2448db-230b-4817-afc9-17ab2568d132 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:04.797138 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2448db-230b-4817-afc9-17ab2568d132 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:04.797434 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2448db-230b-4817-afc9-17ab2568d132 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:04.798899 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2448db-230b-4817-afc9-17ab2568d132 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:04.825503 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 304/617] 10.222.0.52 () {56 vars in 1135 bytes} [Sun Aug 28 00:42:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:04.831080 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93620d2e-277d-4fb9-b81f-594962ade531 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:04.914884 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2448db-230b-4817-afc9-17ab2568d132 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:04.974587 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93620d2e-277d-4fb9-b81f-594962ade531 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:05.012753 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e925b-9e04-4eb2-a3eb-3a5cd06396cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:05.013378 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e925b-9e04-4eb2-a3eb-3a5cd06396cd None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:05.013651 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e925b-9e04-4eb2-a3eb-3a5cd06396cd None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:05.014041 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e925b-9e04-4eb2-a3eb-3a5cd06396cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:05.025981 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e925b-9e04-4eb2-a3eb-3a5cd06396cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:05.027436 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e925b-9e04-4eb2-a3eb-3a5cd06396cd None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:05.044154 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-b73e925b-9e04-4eb2-a3eb-3a5cd06396cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:05.044154 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:05.044154 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:05.044154 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:05.044154 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:05.044154 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:05.044154 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:05.044154 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:05.044154 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:05.044154 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:05.044154 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:05.044154 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:05.044154 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:05.044154 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:05.044154 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:05.044154 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:05.045258 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:05.045258 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:05.045258 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:05.045258 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:05.045258 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:05.045258 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:05.045258 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:05.045258 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:05.045258 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:05.045258 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:05.045258 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:05.045258 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:05.045258 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:05.045258 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:05.045258 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:05.045258 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:05.045258 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:05.046184 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:05.046184 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:05.046184 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:05.046184 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 314/618] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:05.052170 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e925b-9e04-4eb2-a3eb-3a5cd06396cd None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:05.068498 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:05.114284 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:05.114853 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2448db-230b-4817-afc9-17ab2568d132 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:05.151730 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4986e9-b73e-4caa-9efb-25ff6f914e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:05.152714 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4986e9-b73e-4caa-9efb-25ff6f914e02 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:05.153216 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4986e9-b73e-4caa-9efb-25ff6f914e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:05.153700 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4986e9-b73e-4caa-9efb-25ff6f914e02 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:05.164553 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4986e9-b73e-4caa-9efb-25ff6f914e02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:42:05.169674 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-ab4986e9-b73e-4caa-9efb-25ff6f914e02 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:42:05.169674 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:05.169674 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:05.169674 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:05.169674 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:05.169674 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:05.169674 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:05.169674 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:05.169674 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:05.169674 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:05.169674 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:05.169674 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:05.169674 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:42:05.169674 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:42:05.169674 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:42:05.169674 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:42:05.170688 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:42:05.170688 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:42:05.170688 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:42:05.170688 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:42:05.170688 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:05.170688 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:05.170688 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:05.170688 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:05.170688 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:05.170688 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:05.170688 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:05.170688 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:05.170688 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:05.170688 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:05.170688 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:05.170688 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:05.171672 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:05.171672 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:05.171672 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:05.171672 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:05.171672 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:42:05.171672 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:42:05.171672 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:42:05.171672 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:42:05.171672 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:42:05.171672 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:42:05.171672 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:42:05.171672 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:05.172318 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e925b-9e04-4eb2-a3eb-3a5cd06396cd None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:05.174454 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 305/619] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Aug 28 00:42:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:42:05.175934 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446ad62-ee17-4cd3-bf51-2ee3044257d9 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:05.176377 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446ad62-ee17-4cd3-bf51-2ee3044257d9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:05.176807 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446ad62-ee17-4cd3-bf51-2ee3044257d9 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:05.182497 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 306/620] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:05.183562 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446ad62-ee17-4cd3-bf51-2ee3044257d9 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:05.234686 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3fd37-3736-4dc2-b5b7-e542e8de639c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:05.235846 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3fd37-3736-4dc2-b5b7-e542e8de639c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:05.236247 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3fd37-3736-4dc2-b5b7-e542e8de639c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:05.236583 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3fd37-3736-4dc2-b5b7-e542e8de639c None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:05.237354 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3fd37-3736-4dc2-b5b7-e542e8de639c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:05.237709 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3fd37-3736-4dc2-b5b7-e542e8de639c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:05.239898 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3fd37-3736-4dc2-b5b7-e542e8de639c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:05.254844 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 315/621] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:42:05.256449 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22893f38-1cbe-4eca-ad78-1315498fc28d None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:05.256903 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22893f38-1cbe-4eca-ad78-1315498fc28d None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:05.257333 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22893f38-1cbe-4eca-ad78-1315498fc28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:05.275804 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-22893f38-1cbe-4eca-ad78-1315498fc28d None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:05.277254 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-22893f38-1cbe-4eca-ad78-1315498fc28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:05.318824 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446ad62-ee17-4cd3-bf51-2ee3044257d9 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:05.347372 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 316/622] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:42:05.348493 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22893f38-1cbe-4eca-ad78-1315498fc28d None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:05.363093 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6352565-e7f0-48f7-80cd-97ab3d9abb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:05.365742 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6352565-e7f0-48f7-80cd-97ab3d9abb1e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:05.366003 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6352565-e7f0-48f7-80cd-97ab3d9abb1e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:05.366281 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6352565-e7f0-48f7-80cd-97ab3d9abb1e None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:05.366997 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6352565-e7f0-48f7-80cd-97ab3d9abb1e None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:05.367300 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6352565-e7f0-48f7-80cd-97ab3d9abb1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:05.369229 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6352565-e7f0-48f7-80cd-97ab3d9abb1e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:05.372180 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:05.385682 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 307/623] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Aug 28 00:42:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:05.385682 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c095fc-33e9-473f-920f-52001ec15afd None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:05.385682 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c095fc-33e9-473f-920f-52001ec15afd None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:05.385682 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c095fc-33e9-473f-920f-52001ec15afd None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:05.385682 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 308/624] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:05.386621 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c095fc-33e9-473f-920f-52001ec15afd None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:05.411231 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:05.476213 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22893f38-1cbe-4eca-ad78-1315498fc28d None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:05.513546 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b037d-86c7-4adc-83f3-7d3ea62a4af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:05.514644 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b037d-86c7-4adc-83f3-7d3ea62a4af3 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:05.515269 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b037d-86c7-4adc-83f3-7d3ea62a4af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:05.515811 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b037d-86c7-4adc-83f3-7d3ea62a4af3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:05.520128 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c095fc-33e9-473f-920f-52001ec15afd None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:05.524142 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b037d-86c7-4adc-83f3-7d3ea62a4af3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:05.526580 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b037d-86c7-4adc-83f3-7d3ea62a4af3 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:05.541897 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-955b037d-86c7-4adc-83f3-7d3ea62a4af3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:05.541897 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:05.541897 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:05.541897 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:05.541897 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:05.541897 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:05.541897 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:05.541897 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:05.541897 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:05.541897 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:05.541897 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:05.541897 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:05.541897 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:42:05.541897 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:42:05.541897 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:42:05.542845 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:42:05.542845 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:05.542845 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:05.542845 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:05.542845 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:05.542845 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:05.542845 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:05.542845 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:05.542845 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:05.542845 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:05.542845 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:05.542845 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:05.542845 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:05.542845 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:05.542845 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:05.542845 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:05.542845 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:05.544262 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:42:05.544262 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:42:05.544262 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:42:05.544262 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:42:05.544262 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:42:05.544262 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:42:05.544262 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:05.544262 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:05.551608 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 317/625] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:42:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:05.553174 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f58be8-3ca1-4ac8-8ba7-26cc6ab41104 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:05.553650 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f58be8-3ca1-4ac8-8ba7-26cc6ab41104 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:05.554138 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f58be8-3ca1-4ac8-8ba7-26cc6ab41104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:05.561744 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773e58f-e3c7-4448-8f52-5a688e960fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:05.563738 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773e58f-e3c7-4448-8f52-5a688e960fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:05.564026 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773e58f-e3c7-4448-8f52-5a688e960fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:05.564300 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773e58f-e3c7-4448-8f52-5a688e960fb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:05.575143 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-f7f58be8-3ca1-4ac8-8ba7-26cc6ab41104 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:05.576045 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773e58f-e3c7-4448-8f52-5a688e960fb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:05.577089 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f7f58be8-3ca1-4ac8-8ba7-26cc6ab41104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:05.577570 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773e58f-e3c7-4448-8f52-5a688e960fb8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:05.597529 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-5773e58f-e3c7-4448-8f52-5a688e960fb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:05.597529 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:05.597529 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:05.597529 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:05.597529 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:05.597529 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:05.597529 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:05.597529 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:05.597529 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:05.597529 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:05.597529 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:05.597529 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:05.597529 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:05.597529 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:05.597529 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:05.597529 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:05.598592 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:05.598592 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:05.598592 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:05.598592 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:05.598592 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:05.598592 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:05.598592 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:05.598592 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:05.598592 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:05.598592 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:05.598592 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:05.598592 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:05.598592 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:05.598592 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:05.598592 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:05.598592 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:05.598592 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:05.599489 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:05.599489 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:05.599489 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:05.606035 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 309/626] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:05.607117 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773e58f-e3c7-4448-8f52-5a688e960fb8 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:05.655961 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 318/627] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:42:05.659202 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:05.660281 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f58be8-3ca1-4ac8-8ba7-26cc6ab41104 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:05.703894 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:05.715587 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773e58f-e3c7-4448-8f52-5a688e960fb8 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:05.752696 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f4233-4eeb-4386-b2b3-c537bf6eedf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:05.753437 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f4233-4eeb-4386-b2b3-c537bf6eedf5 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:05.753615 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f4233-4eeb-4386-b2b3-c537bf6eedf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:05.753936 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f4233-4eeb-4386-b2b3-c537bf6eedf5 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:05.754874 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f4233-4eeb-4386-b2b3-c537bf6eedf5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:05.754982 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f4233-4eeb-4386-b2b3-c537bf6eedf5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:05.756367 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f4233-4eeb-4386-b2b3-c537bf6eedf5 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:05.773440 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 310/628] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:42:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:05.773440 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f4233-4eeb-4386-b2b3-c537bf6eedf5 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:05.799624 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f58be8-3ca1-4ac8-8ba7-26cc6ab41104 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:05.835175 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27564e55-a0d8-4195-849f-36f84944e58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:05.835787 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27564e55-a0d8-4195-849f-36f84944e58f None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:05.836046 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27564e55-a0d8-4195-849f-36f84944e58f None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:05.836319 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27564e55-a0d8-4195-849f-36f84944e58f None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:05.837312 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27564e55-a0d8-4195-849f-36f84944e58f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:05.837862 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27564e55-a0d8-4195-849f-36f84944e58f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:05.839435 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27564e55-a0d8-4195-849f-36f84944e58f None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:05.856594 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 319/629] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:05.857451 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27564e55-a0d8-4195-849f-36f84944e58f None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:05.894890 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f4233-4eeb-4386-b2b3-c537bf6eedf5 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:05.907835 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:05.933180 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67084a0-2aa3-424e-8908-a8749fa6bb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:05.933815 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67084a0-2aa3-424e-8908-a8749fa6bb4a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:05.934123 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67084a0-2aa3-424e-8908-a8749fa6bb4a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:05.934396 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67084a0-2aa3-424e-8908-a8749fa6bb4a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:05.945528 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67084a0-2aa3-424e-8908-a8749fa6bb4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:42:05.950425 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-a67084a0-2aa3-424e-8908-a8749fa6bb4a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:42:05.950425 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:05.950425 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:05.950425 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:05.950425 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:05.950425 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:05.950425 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:05.950425 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:05.950425 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:05.950425 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:05.950425 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:05.950425 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:05.950425 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:42:05.950425 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:42:05.950425 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:42:05.950425 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:42:05.951625 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:42:05.951625 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:42:05.951625 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:42:05.951625 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:42:05.951625 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:05.951625 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:05.951625 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:05.951625 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:05.951625 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:05.951625 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:05.951625 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:05.951625 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:05.951625 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:05.951625 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:05.951625 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:05.951625 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:05.955190 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:05.955190 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:05.955190 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:05.955190 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:05.955190 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:42:05.955190 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:42:05.955190 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:42:05.955190 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:42:05.955190 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:42:05.955190 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:42:05.955190 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:42:05.955190 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:05.955190 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 311/630] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Aug 28 00:42:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:05.955190 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67084a0-2aa3-424e-8908-a8749fa6bb4a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:05.968820 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:05.980359 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27564e55-a0d8-4195-849f-36f84944e58f None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:06.016971 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10993a50-8ed0-4c87-84ba-5ce45d4fe158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:06.017798 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10993a50-8ed0-4c87-84ba-5ce45d4fe158 None admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:06.018134 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10993a50-8ed0-4c87-84ba-5ce45d4fe158 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:06.018415 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10993a50-8ed0-4c87-84ba-5ce45d4fe158 None admin] PATH_INFO: `/v3/projects/45c69e3e973c449895457bb610103a43/users/a80a6019cf424c16a1d461a632cf8568/roles/ce8c7035b6004d2f84c02ebc4a05f17b` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:06.034409 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10993a50-8ed0-4c87-84ba-5ce45d4fe158 None admin] RBAC: Authorizing `identity:create_grant(project_id=45c69e3e973c449895457bb610103a43, user_id=a80a6019cf424c16a1d461a632cf8568, role_id=ce8c7035b6004d2f84c02ebc4a05f17b)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:06.035876 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10993a50-8ed0-4c87-84ba-5ce45d4fe158 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:06.051567 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 320/631] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Aug 28 00:42:05 2022] PUT /identity/v3/projects/45c69e3e973c449895457bb610103a43/users/a80a6019cf424c16a1d461a632cf8568/roles/ce8c7035b6004d2f84c02ebc4a05f17b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:42:06.052420 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10993a50-8ed0-4c87-84ba-5ce45d4fe158 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:06.089327 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67084a0-2aa3-424e-8908-a8749fa6bb4a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:06.135498 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e295a-8c1c-4f36-8bf2-be62d945b3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:06.136414 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e295a-8c1c-4f36-8bf2-be62d945b3b4 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:06.136709 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e295a-8c1c-4f36-8bf2-be62d945b3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:06.136966 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e295a-8c1c-4f36-8bf2-be62d945b3b4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:06.148037 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e295a-8c1c-4f36-8bf2-be62d945b3b4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:06.149903 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e295a-8c1c-4f36-8bf2-be62d945b3b4 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:06.167076 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-579e295a-8c1c-4f36-8bf2-be62d945b3b4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:42:06.167076 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:06.167076 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:06.167076 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:06.167076 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:06.167076 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:06.167076 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:06.167076 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:06.167076 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:06.167076 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:06.167076 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:06.167076 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:06.167076 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:42:06.167076 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:42:06.167076 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:42:06.167076 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:42:06.168250 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:06.168250 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:06.168250 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:42:06.168250 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:06.168250 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:42:06.168250 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:06.168250 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:06.168250 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:06.168250 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:06.168250 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:06.168250 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:06.168250 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:06.168250 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:06.168250 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:06.168250 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:06.168250 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:06.168250 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:06.168250 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:06.169533 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:06.169533 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:06.169533 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:42:06.169533 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:42:06.169533 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:42:06.169533 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:42:06.169533 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:42:06.169533 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:42:06.169533 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:42:06.169533 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:06.173613 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 312/632] 10.222.0.52 () {56 vars in 1093 bytes} [Sun Aug 28 00:42:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:06.175107 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e295a-8c1c-4f36-8bf2-be62d945b3b4 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:06.192690 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10993a50-8ed0-4c87-84ba-5ce45d4fe158 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:06.221815 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:06.245252 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86636490-a990-454b-8723-1e93266123ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:06.245957 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86636490-a990-454b-8723-1e93266123ea None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:06.246239 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86636490-a990-454b-8723-1e93266123ea None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:06.246509 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86636490-a990-454b-8723-1e93266123ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:06.258042 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86636490-a990-454b-8723-1e93266123ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:42:06.262520 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:06.263872 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-86636490-a990-454b-8723-1e93266123ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:42:06.263872 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:06.263872 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:06.263872 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:06.263872 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:06.263872 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:06.263872 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:06.263872 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:06.263872 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:06.263872 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:06.263872 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:06.263872 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:06.263872 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:42:06.263872 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:42:06.263872 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:42:06.263872 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:42:06.264946 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:42:06.264946 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:42:06.264946 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:42:06.264946 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:42:06.264946 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:06.264946 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:06.264946 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:06.264946 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:06.264946 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:06.264946 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:06.264946 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:06.264946 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:06.264946 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:06.264946 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:06.264946 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:06.264946 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:06.265792 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:06.265792 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:06.265792 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:06.265792 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:06.265792 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:42:06.265792 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:42:06.265792 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:42:06.265792 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:42:06.265792 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:42:06.265792 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:42:06.265792 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:42:06.265792 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:06.268146 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 321/633] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Aug 28 00:42:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:06.269133 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86636490-a990-454b-8723-1e93266123ea None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:06.314602 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e295a-8c1c-4f36-8bf2-be62d945b3b4 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:06.353049 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0910e-ec86-4938-b231-9fd8d450932c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:06.353658 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0910e-ec86-4938-b231-9fd8d450932c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:06.353961 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0910e-ec86-4938-b231-9fd8d450932c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:06.354234 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0910e-ec86-4938-b231-9fd8d450932c None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:06.354901 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0910e-ec86-4938-b231-9fd8d450932c None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:06.355238 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0910e-ec86-4938-b231-9fd8d450932c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:06.356588 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0910e-ec86-4938-b231-9fd8d450932c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:06.365744 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 313/634] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Aug 28 00:42:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:06.366610 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0910e-ec86-4938-b231-9fd8d450932c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:06.375277 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86636490-a990-454b-8723-1e93266123ea None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:06.418275 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec3c7f-76ef-4fa3-b4d0-15f36f38f902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:06.419334 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec3c7f-76ef-4fa3-b4d0-15f36f38f902 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:06.420080 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec3c7f-76ef-4fa3-b4d0-15f36f38f902 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:06.420496 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec3c7f-76ef-4fa3-b4d0-15f36f38f902 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:06.421471 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec3c7f-76ef-4fa3-b4d0-15f36f38f902 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:06.421955 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec3c7f-76ef-4fa3-b4d0-15f36f38f902 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:06.424073 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec3c7f-76ef-4fa3-b4d0-15f36f38f902 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:06.448187 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 322/635] 10.222.0.52 () {56 vars in 1133 bytes} [Sun Aug 28 00:42:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:06.449262 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec3c7f-76ef-4fa3-b4d0-15f36f38f902 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:06.469491 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:06.483940 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0910e-ec86-4938-b231-9fd8d450932c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:06.519555 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2f256-5d15-494b-b5df-6cbcb50233a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:06.520172 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2f256-5d15-494b-b5df-6cbcb50233a4 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:06.520450 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2f256-5d15-494b-b5df-6cbcb50233a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:06.520724 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2f256-5d15-494b-b5df-6cbcb50233a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:06.521394 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2f256-5d15-494b-b5df-6cbcb50233a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:06.521696 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2f256-5d15-494b-b5df-6cbcb50233a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:06.523120 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2f256-5d15-494b-b5df-6cbcb50233a4 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:06.530666 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:06.532817 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 314/636] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Aug 28 00:42:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:06.533957 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2f256-5d15-494b-b5df-6cbcb50233a4 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:06.590673 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec3c7f-76ef-4fa3-b4d0-15f36f38f902 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:06.625630 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed9846-66eb-4eac-887d-dcba1ff05a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:06.626281 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed9846-66eb-4eac-887d-dcba1ff05a4f None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:06.626555 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed9846-66eb-4eac-887d-dcba1ff05a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:06.626823 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed9846-66eb-4eac-887d-dcba1ff05a4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:06.637229 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed9846-66eb-4eac-887d-dcba1ff05a4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:06.638704 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed9846-66eb-4eac-887d-dcba1ff05a4f None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:06.646202 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2f256-5d15-494b-b5df-6cbcb50233a4 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:06.653344 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-4eed9846-66eb-4eac-887d-dcba1ff05a4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:06.653344 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:06.653344 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:06.653344 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:06.653344 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:06.653344 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:06.653344 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:06.653344 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:06.653344 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:06.653344 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:06.653344 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:06.653344 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:06.653344 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:06.653344 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:06.653344 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:06.653344 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:06.654963 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:06.654963 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:06.654963 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:06.654963 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:06.654963 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:06.654963 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:06.654963 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:06.654963 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:06.654963 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:06.654963 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:06.654963 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:06.654963 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:06.654963 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:06.654963 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:06.654963 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:06.654963 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:06.654963 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:06.656029 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:06.656029 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:06.656029 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:06.656029 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 323/637] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:06.656029 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed9846-66eb-4eac-887d-dcba1ff05a4f None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:06.686726 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49492ce-12f7-4b16-beeb-1aa3cfd4ec5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:06.687344 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49492ce-12f7-4b16-beeb-1aa3cfd4ec5a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:06.687646 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49492ce-12f7-4b16-beeb-1aa3cfd4ec5a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:06.687917 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49492ce-12f7-4b16-beeb-1aa3cfd4ec5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:06.716960 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:06.762679 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49492ce-12f7-4b16-beeb-1aa3cfd4ec5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:06.764306 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49492ce-12f7-4b16-beeb-1aa3cfd4ec5a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:06.767523 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed9846-66eb-4eac-887d-dcba1ff05a4f None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:06.778354 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:06.805249 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d1d6d-52e5-442a-a074-7c81b88753ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:06.806014 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d1d6d-52e5-442a-a074-7c81b88753ba None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:06.806291 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d1d6d-52e5-442a-a074-7c81b88753ba None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:06.806581 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d1d6d-52e5-442a-a074-7c81b88753ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:06.818174 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d1d6d-52e5-442a-a074-7c81b88753ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:06.819661 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d1d6d-52e5-442a-a074-7c81b88753ba None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:06.834803 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-f29d1d6d-52e5-442a-a074-7c81b88753ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:06.834803 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:06.834803 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:06.834803 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:06.834803 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:06.834803 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:06.834803 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:06.834803 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:06.834803 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:06.834803 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:06.834803 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:06.834803 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:06.834803 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:06.834803 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:06.834803 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:06.834803 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:06.836197 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:06.836197 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:06.836197 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:06.836197 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:06.836197 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:06.836197 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:06.836197 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:06.836197 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:06.836197 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:06.836197 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:06.836197 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:06.836197 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:06.836197 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:06.836197 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:06.836197 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:06.836197 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:06.836197 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:06.837128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:06.837128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:06.837128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:06.837128 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 324/638] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:06.837128 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37ca2b-9103-4ea8-9818-ac1a4f6b336e None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:06.837451 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37ca2b-9103-4ea8-9818-ac1a4f6b336e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:06.837998 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37ca2b-9103-4ea8-9818-ac1a4f6b336e None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:06.839123 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 325/639] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:06.839831 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37ca2b-9103-4ea8-9818-ac1a4f6b336e None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:06.874447 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 315/640] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:42:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:42:06.875291 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49492ce-12f7-4b16-beeb-1aa3cfd4ec5a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:06.940279 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:06.963925 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37ca2b-9103-4ea8-9818-ac1a4f6b336e None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:06.991236 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49492ce-12f7-4b16-beeb-1aa3cfd4ec5a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:06.999430 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c3550-197d-4b18-a965-3ca8c15d78bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:07.000034 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c3550-197d-4b18-a965-3ca8c15d78bb None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:07.000748 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c3550-197d-4b18-a965-3ca8c15d78bb None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:07.001034 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c3550-197d-4b18-a965-3ca8c15d78bb None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:07.001677 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c3550-197d-4b18-a965-3ca8c15d78bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:07.002012 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c3550-197d-4b18-a965-3ca8c15d78bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:07.004051 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c3550-197d-4b18-a965-3ca8c15d78bb None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:07.020919 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 326/641] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:07.020919 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e63290-9886-4a1b-aee4-c185a52ea5ef None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:07.020919 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e63290-9886-4a1b-aee4-c185a52ea5ef None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:07.020919 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e63290-9886-4a1b-aee4-c185a52ea5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:07.033701 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b1fda-234a-4ef8-93d4-aa701dbbf65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:07.034562 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b1fda-234a-4ef8-93d4-aa701dbbf65a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:07.034840 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b1fda-234a-4ef8-93d4-aa701dbbf65a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:07.035107 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b1fda-234a-4ef8-93d4-aa701dbbf65a None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:07.035751 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b1fda-234a-4ef8-93d4-aa701dbbf65a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:07.036050 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b1fda-234a-4ef8-93d4-aa701dbbf65a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:07.036399 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-99e63290-9886-4a1b-aee4-c185a52ea5ef None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:07.037567 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-99e63290-9886-4a1b-aee4-c185a52ea5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:07.037664 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b1fda-234a-4ef8-93d4-aa701dbbf65a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:07.055637 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 316/642] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:07.056242 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:07.056551 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b1fda-234a-4ef8-93d4-aa701dbbf65a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:07.107248 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 327/643] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:42:07.118090 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e63290-9886-4a1b-aee4-c185a52ea5ef None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:07.175687 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b1fda-234a-4ef8-93d4-aa701dbbf65a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:07.193458 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:07.217124 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9553fd-78ff-4b2b-b938-b9a867df1e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:07.217801 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9553fd-78ff-4b2b-b938-b9a867df1e5a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:07.218546 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9553fd-78ff-4b2b-b938-b9a867df1e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:07.218821 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9553fd-78ff-4b2b-b938-b9a867df1e5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:07.232962 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9553fd-78ff-4b2b-b938-b9a867df1e5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:07.235360 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9553fd-78ff-4b2b-b938-b9a867df1e5a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:07.245798 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e63290-9886-4a1b-aee4-c185a52ea5ef None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:07.259397 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-8d9553fd-78ff-4b2b-b938-b9a867df1e5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:07.259397 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:07.259397 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:07.259397 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:07.259397 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:07.259397 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:07.259397 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:07.259397 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:07.259397 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:07.259397 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:07.259397 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:07.259397 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:07.259397 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:07.259397 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:07.259397 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:07.259397 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:07.260460 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:07.260460 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:07.260460 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:07.260460 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:07.260460 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:07.260460 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:07.260460 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:07.260460 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:07.260460 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:07.260460 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:07.260460 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:07.260460 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:07.260460 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:07.260460 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:07.260460 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:07.260460 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:07.260460 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:07.261368 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:07.261368 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:07.261368 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:07.261368 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 317/644] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:07.261368 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9553fd-78ff-4b2b-b938-b9a867df1e5a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:07.286843 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7fda0-ac36-429a-9762-5cccb91972d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:07.287502 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7fda0-ac36-429a-9762-5cccb91972d6 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:07.287774 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7fda0-ac36-429a-9762-5cccb91972d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:07.288039 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7fda0-ac36-429a-9762-5cccb91972d6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:07.295737 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7fda0-ac36-429a-9762-5cccb91972d6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:07.297281 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7fda0-ac36-429a-9762-5cccb91972d6 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:07.309192 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-0ec7fda0-ac36-429a-9762-5cccb91972d6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 00:42:07.309192 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:07.309192 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:07.309192 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:07.309192 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:07.309192 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:07.309192 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:07.309192 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:07.309192 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:07.309192 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:07.309192 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:07.309192 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:07.309192 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:42:07.309192 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:42:07.309192 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:42:07.309192 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:42:07.310153 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:07.310153 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:07.310153 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:42:07.310153 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:07.310153 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:42:07.310153 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:07.310153 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:07.310153 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:07.310153 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:07.310153 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:07.310153 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:07.310153 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:07.310153 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:07.310153 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:07.310153 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:07.310153 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:07.310153 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:07.310153 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:07.311288 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:07.311288 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:07.311288 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:42:07.311288 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:42:07.311288 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:42:07.311288 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:42:07.311288 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:42:07.311288 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:42:07.311288 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 00:42:07.311288 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:07.311288 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 328/645] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:42:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:07.312533 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7fda0-ac36-429a-9762-5cccb91972d6 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:07.326716 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:07.371948 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9553fd-78ff-4b2b-b938-b9a867df1e5a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:07.408666 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6fff2-6574-4c22-9f93-83b567292e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:07.409869 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6fff2-6574-4c22-9f93-83b567292e64 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:07.410159 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6fff2-6574-4c22-9f93-83b567292e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:07.410429 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6fff2-6574-4c22-9f93-83b567292e64 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:07.414192 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7fda0-ac36-429a-9762-5cccb91972d6 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:07.418326 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a6fff2-6574-4c22-9f93-83b567292e64 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:07.419786 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a6fff2-6574-4c22-9f93-83b567292e64 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:07.431109 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-f6a6fff2-6574-4c22-9f93-83b567292e64 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 28 00:42:07.431109 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:07.431109 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:07.431109 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:07.431109 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:07.431109 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:07.431109 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:07.431109 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:07.431109 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:07.431109 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:07.431109 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:07.431109 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:07.431109 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:42:07.431109 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:42:07.431109 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:42:07.431109 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:42:07.432635 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:07.432635 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:07.432635 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:42:07.432635 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:07.432635 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:42:07.432635 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:07.432635 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:07.432635 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:07.432635 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:07.432635 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:07.432635 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:07.432635 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:07.432635 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:07.432635 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:07.432635 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:07.432635 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:07.432635 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:07.432635 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:07.433577 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:07.433577 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:07.433577 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:42:07.433577 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:42:07.433577 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:42:07.433577 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:42:07.433577 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:42:07.433577 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:42:07.433577 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 28 00:42:07.433577 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:07.433577 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 318/646] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:42:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:07.433577 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6fff2-6574-4c22-9f93-83b567292e64 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:07.454168 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afe966-e58e-4360-a5ad-5a9ec1c784a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:07.454699 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afe966-e58e-4360-a5ad-5a9ec1c784a2 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:07.454977 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afe966-e58e-4360-a5ad-5a9ec1c784a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:07.455242 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afe966-e58e-4360-a5ad-5a9ec1c784a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:07.456321 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96afe966-e58e-4360-a5ad-5a9ec1c784a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:07.456622 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96afe966-e58e-4360-a5ad-5a9ec1c784a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:07.458012 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96afe966-e58e-4360-a5ad-5a9ec1c784a2 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:07.461316 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:07.470969 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 329/647] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:07.471792 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afe966-e58e-4360-a5ad-5a9ec1c784a2 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:07.546808 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6fff2-6574-4c22-9f93-83b567292e64 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:07.549329 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:07.578965 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afe966-e58e-4360-a5ad-5a9ec1c784a2 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:07.584636 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a235298-f990-4035-bff2-825a72d75b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:07.585241 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a235298-f990-4035-bff2-825a72d75b03 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:07.585515 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a235298-f990-4035-bff2-825a72d75b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:07.585776 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a235298-f990-4035-bff2-825a72d75b03 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:07.586682 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a235298-f990-4035-bff2-825a72d75b03 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:07.586952 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a235298-f990-4035-bff2-825a72d75b03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:07.588493 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a235298-f990-4035-bff2-825a72d75b03 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:07.607366 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 319/648] 10.222.0.52 () {56 vars in 1137 bytes} [Sun Aug 28 00:42:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:07.612590 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a235298-f990-4035-bff2-825a72d75b03 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:07.613212 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11cde9-e4fe-4c0f-b995-cd7fcf12d085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:07.613855 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11cde9-e4fe-4c0f-b995-cd7fcf12d085 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:07.614139 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11cde9-e4fe-4c0f-b995-cd7fcf12d085 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:07.614407 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11cde9-e4fe-4c0f-b995-cd7fcf12d085 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:07.624817 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11cde9-e4fe-4c0f-b995-cd7fcf12d085 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:42:07.629562 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-2d11cde9-e4fe-4c0f-b995-cd7fcf12d085 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:42:07.629562 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:07.629562 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:07.629562 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:07.629562 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:07.629562 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:07.629562 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:07.629562 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:07.629562 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:07.629562 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:07.629562 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:07.629562 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:07.629562 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:42:07.629562 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:42:07.629562 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:42:07.629562 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:42:07.630698 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:42:07.630698 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:42:07.630698 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:42:07.630698 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:42:07.630698 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:07.630698 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:07.630698 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:07.630698 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:07.630698 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:07.630698 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:07.630698 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:07.630698 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:07.630698 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:07.630698 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:07.630698 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:07.630698 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:07.631552 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:07.631552 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:07.631552 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:07.631552 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:07.631552 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:42:07.631552 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:42:07.631552 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:42:07.631552 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:42:07.631552 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:42:07.631552 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:42:07.631552 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:42:07.631552 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:07.631552 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 330/649] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Aug 28 00:42:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:07.631552 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11cde9-e4fe-4c0f-b995-cd7fcf12d085 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:07.704150 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:07.722980 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a235298-f990-4035-bff2-825a72d75b03 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:07.731375 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11cde9-e4fe-4c0f-b995-cd7fcf12d085 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:07.758675 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564b3f5-cf06-45a4-b467-23d8c415f17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:07.759704 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564b3f5-cf06-45a4-b467-23d8c415f17a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:07.760208 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564b3f5-cf06-45a4-b467-23d8c415f17a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:07.760587 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:07.761175 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564b3f5-cf06-45a4-b467-23d8c415f17a None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:07.761941 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564b3f5-cf06-45a4-b467-23d8c415f17a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:07.762437 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564b3f5-cf06-45a4-b467-23d8c415f17a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:07.763866 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564b3f5-cf06-45a4-b467-23d8c415f17a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:07.767422 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9b55e-1506-4e88-9d68-d49d8ae87bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:07.768114 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9b55e-1506-4e88-9d68-d49d8ae87bae None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:07.768449 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9b55e-1506-4e88-9d68-d49d8ae87bae None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:07.768779 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9b55e-1506-4e88-9d68-d49d8ae87bae None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:07.775715 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be9b55e-1506-4e88-9d68-d49d8ae87bae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:07.777199 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be9b55e-1506-4e88-9d68-d49d8ae87bae None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:07.786350 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 320/650] 10.222.0.52 () {56 vars in 1137 bytes} [Sun Aug 28 00:42:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:07.786350 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564b3f5-cf06-45a4-b467-23d8c415f17a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:07.792937 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-8be9b55e-1506-4e88-9d68-d49d8ae87bae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:07.792937 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:07.792937 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:07.792937 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:07.792937 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:07.792937 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:07.792937 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:07.792937 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:07.792937 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:07.792937 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:07.792937 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:07.792937 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:07.792937 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:42:07.792937 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:42:07.792937 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:42:07.794034 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:42:07.794034 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:07.794034 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:07.794034 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:07.794034 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:07.794034 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:07.794034 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:07.794034 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:07.794034 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:07.794034 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:07.794034 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:07.794034 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:07.794034 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:07.794034 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:07.794034 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:07.794034 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:07.794034 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:07.795217 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:42:07.795217 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:42:07.795217 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:42:07.795217 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:42:07.795217 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:42:07.795217 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:42:07.795217 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:07.795217 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:07.800839 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 331/651] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:42:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:07.800839 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9b55e-1506-4e88-9d68-d49d8ae87bae None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:07.897112 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564b3f5-cf06-45a4-b467-23d8c415f17a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:07.903568 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9b55e-1506-4e88-9d68-d49d8ae87bae None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:07.933971 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04259e3c-9c9b-4018-8e74-0cc5d989dc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:07.934894 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04259e3c-9c9b-4018-8e74-0cc5d989dc96 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:07.935330 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04259e3c-9c9b-4018-8e74-0cc5d989dc96 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:07.935622 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04259e3c-9c9b-4018-8e74-0cc5d989dc96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:07.940318 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbc99d-f4d9-49b0-a75a-fefada8858f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:07.941033 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbc99d-f4d9-49b0-a75a-fefada8858f5 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:07.941403 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbc99d-f4d9-49b0-a75a-fefada8858f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:07.941764 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbc99d-f4d9-49b0-a75a-fefada8858f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:07.942548 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbc99d-f4d9-49b0-a75a-fefada8858f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:07.942936 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbc99d-f4d9-49b0-a75a-fefada8858f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:07.944809 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbc99d-f4d9-49b0-a75a-fefada8858f5 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:07.948462 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:07.953582 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 332/652] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Aug 28 00:42:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:07.954327 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbc99d-f4d9-49b0-a75a-fefada8858f5 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:08.011275 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:08.011448 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04259e3c-9c9b-4018-8e74-0cc5d989dc96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:08.012846 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04259e3c-9c9b-4018-8e74-0cc5d989dc96 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:08.058562 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbc99d-f4d9-49b0-a75a-fefada8858f5 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:08.095520 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bb2b4-66dc-4265-8e16-fbcda3b3122b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:08.096116 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bb2b4-66dc-4265-8e16-fbcda3b3122b None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:08.096389 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bb2b4-66dc-4265-8e16-fbcda3b3122b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:08.096650 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bb2b4-66dc-4265-8e16-fbcda3b3122b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:08.111966 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 321/653] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:42:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:42:08.112917 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04259e3c-9c9b-4018-8e74-0cc5d989dc96 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:08.156917 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:08.171312 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3bb2b4-66dc-4265-8e16-fbcda3b3122b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:08.172778 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3bb2b4-66dc-4265-8e16-fbcda3b3122b None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:08.212884 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04259e3c-9c9b-4018-8e74-0cc5d989dc96 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:08.224623 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:08.246832 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1383c2-16ef-4825-9fce-156a37c60a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:08.247436 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1383c2-16ef-4825-9fce-156a37c60a49 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:08.247711 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1383c2-16ef-4825-9fce-156a37c60a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:08.247980 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1383c2-16ef-4825-9fce-156a37c60a49 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:08.248765 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1383c2-16ef-4825-9fce-156a37c60a49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:08.249088 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1383c2-16ef-4825-9fce-156a37c60a49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:08.250556 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1383c2-16ef-4825-9fce-156a37c60a49 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:08.261815 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 322/654] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:42:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:08.262571 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1383c2-16ef-4825-9fce-156a37c60a49 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:08.270738 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 333/655] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:42:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:42:08.272055 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd65dcb-2c3f-4ff7-8405-7641910ea529 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:08.272345 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd65dcb-2c3f-4ff7-8405-7641910ea529 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:08.272623 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd65dcb-2c3f-4ff7-8405-7641910ea529 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:08.275338 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 334/656] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:08.276107 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd65dcb-2c3f-4ff7-8405-7641910ea529 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:08.363495 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1383c2-16ef-4825-9fce-156a37c60a49 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:08.364967 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:08.381296 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd65dcb-2c3f-4ff7-8405-7641910ea529 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:08.399200 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed724c-340c-4103-8e4f-f1e905f40c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:08.399819 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed724c-340c-4103-8e4f-f1e905f40c54 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:08.400097 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed724c-340c-4103-8e4f-f1e905f40c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:08.400368 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed724c-340c-4103-8e4f-f1e905f40c54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:08.410947 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed724c-340c-4103-8e4f-f1e905f40c54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:08.412434 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed724c-340c-4103-8e4f-f1e905f40c54 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:08.414119 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52adb6-3aa0-4b9d-a762-e7c2bd6a51c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:08.414754 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52adb6-3aa0-4b9d-a762-e7c2bd6a51c1 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:08.415024 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52adb6-3aa0-4b9d-a762-e7c2bd6a51c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:08.415289 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52adb6-3aa0-4b9d-a762-e7c2bd6a51c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:08.424952 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d52adb6-3aa0-4b9d-a762-e7c2bd6a51c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:08.426420 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d52adb6-3aa0-4b9d-a762-e7c2bd6a51c1 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:08.426522 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-95ed724c-340c-4103-8e4f-f1e905f40c54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:08.426522 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:08.426522 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:08.426522 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:08.426522 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:08.426522 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:08.426522 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:08.426522 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:08.426522 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:08.426522 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:08.426522 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:08.426522 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:08.426522 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:08.426522 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:08.426522 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:08.426522 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:08.427593 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:08.427593 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:08.427593 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:08.427593 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:08.427593 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:08.427593 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:08.427593 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:08.427593 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:08.427593 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:08.427593 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:08.427593 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:08.427593 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:08.427593 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:08.427593 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:08.427593 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:08.427593 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:08.427593 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:08.428676 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:08.428676 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:08.428676 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:08.428676 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 323/657] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:08.428952 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed724c-340c-4103-8e4f-f1e905f40c54 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:08.444784 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-9d52adb6-3aa0-4b9d-a762-e7c2bd6a51c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:08.444784 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:08.444784 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:08.444784 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:08.444784 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:08.444784 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:08.444784 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:08.444784 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:08.444784 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:08.444784 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:08.444784 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:08.444784 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:08.444784 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:08.444784 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:08.444784 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:08.444784 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:08.445985 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:08.445985 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:08.445985 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:08.445985 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:08.445985 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:08.445985 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:08.445985 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:08.445985 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:08.445985 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:08.445985 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:08.445985 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:08.445985 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:08.445985 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:08.445985 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:08.445985 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:08.445985 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:08.445985 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:08.446914 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:08.446914 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:08.446914 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:08.446914 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 335/658] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:08.447157 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52adb6-3aa0-4b9d-a762-e7c2bd6a51c1 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:08.455862 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:08.538814 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed724c-340c-4103-8e4f-f1e905f40c54 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:08.549358 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52adb6-3aa0-4b9d-a762-e7c2bd6a51c1 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:08.572111 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cfed0-2241-4fe6-993c-73bc03dd8361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:08.572706 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cfed0-2241-4fe6-993c-73bc03dd8361 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:08.572984 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cfed0-2241-4fe6-993c-73bc03dd8361 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:08.573252 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cfed0-2241-4fe6-993c-73bc03dd8361 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:08.574013 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5cfed0-2241-4fe6-993c-73bc03dd8361 None admin] RBAC: Adding query filter params (role.id=ce8c7035b6004d2f84c02ebc4a05f17b, scope.project.id=45c69e3e973c449895457bb610103a43, user.id=f890ff4e7807477db7f17c2f6434dce8) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:08.574321 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5cfed0-2241-4fe6-993c-73bc03dd8361 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:08.575760 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5cfed0-2241-4fe6-993c-73bc03dd8361 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:08.581471 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 324/659] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:42:08 2022] GET /identity/v3/role_assignments?user.id=f890ff4e7807477db7f17c2f6434dce8&scope.project.id=45c69e3e973c449895457bb610103a43&role.id=ce8c7035b6004d2f84c02ebc4a05f17b => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:08.582720 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c28b8f-e48b-49af-932e-1a3cc59bce0c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:08.583007 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c28b8f-e48b-49af-932e-1a3cc59bce0c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:08.583282 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c28b8f-e48b-49af-932e-1a3cc59bce0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:08.586840 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879c054-4f16-44fd-9e5f-6806d90e9498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:08.587584 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879c054-4f16-44fd-9e5f-6806d90e9498 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:08.587953 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879c054-4f16-44fd-9e5f-6806d90e9498 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:08.588314 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879c054-4f16-44fd-9e5f-6806d90e9498 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:08.600774 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1879c054-4f16-44fd-9e5f-6806d90e9498 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:08.602473 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1879c054-4f16-44fd-9e5f-6806d90e9498 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:08.607271 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-99c28b8f-e48b-49af-932e-1a3cc59bce0c None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:08.608950 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-99c28b8f-e48b-49af-932e-1a3cc59bce0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:08.619632 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-1879c054-4f16-44fd-9e5f-6806d90e9498 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:08.619632 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:08.619632 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:08.619632 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:08.619632 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:08.619632 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:08.619632 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:08.619632 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:08.619632 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:08.619632 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:08.619632 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:08.619632 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:08.619632 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:08.619632 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:08.619632 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:08.619632 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:08.620837 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:08.620837 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:08.620837 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:08.620837 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:08.620837 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:08.620837 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:08.620837 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:08.620837 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:08.620837 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:08.620837 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:08.620837 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:08.620837 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:08.620837 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:08.620837 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:08.620837 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:08.620837 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:08.620837 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:08.621951 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:08.621951 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:08.621951 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:08.621951 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 336/660] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:08.622212 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879c054-4f16-44fd-9e5f-6806d90e9498 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:08.627558 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:08.688642 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 325/661] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:42:08.690355 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:08.699086 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c28b8f-e48b-49af-932e-1a3cc59bce0c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:08.745775 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879c054-4f16-44fd-9e5f-6806d90e9498 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:08.788008 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7947912-d4cd-4702-8ebe-6a3835728ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:08.788544 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7947912-d4cd-4702-8ebe-6a3835728ef5 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:08.788823 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7947912-d4cd-4702-8ebe-6a3835728ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:08.789103 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7947912-d4cd-4702-8ebe-6a3835728ef5 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:08.789755 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7947912-d4cd-4702-8ebe-6a3835728ef5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:08.790153 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7947912-d4cd-4702-8ebe-6a3835728ef5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:08.791540 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7947912-d4cd-4702-8ebe-6a3835728ef5 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:08.806590 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 337/662] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:08.807505 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7947912-d4cd-4702-8ebe-6a3835728ef5 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:08.827412 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c28b8f-e48b-49af-932e-1a3cc59bce0c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:08.870058 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cef97a-e989-4fe3-9e8c-53e556a0f6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:08.870760 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cef97a-e989-4fe3-9e8c-53e556a0f6ef None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:08.871029 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cef97a-e989-4fe3-9e8c-53e556a0f6ef None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:08.871299 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cef97a-e989-4fe3-9e8c-53e556a0f6ef None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:08.871947 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cef97a-e989-4fe3-9e8c-53e556a0f6ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:08.872243 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cef97a-e989-4fe3-9e8c-53e556a0f6ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:08.875430 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cef97a-e989-4fe3-9e8c-53e556a0f6ef None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:08.894081 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 326/663] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:08.894932 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cef97a-e989-4fe3-9e8c-53e556a0f6ef None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:08.910805 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:08.927794 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7947912-d4cd-4702-8ebe-6a3835728ef5 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:08.946169 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:08.967382 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec0846-350f-4df1-bb55-f9159ebcf34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:08.967995 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec0846-350f-4df1-bb55-f9159ebcf34b None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:08.968280 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec0846-350f-4df1-bb55-f9159ebcf34b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:08.968601 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec0846-350f-4df1-bb55-f9159ebcf34b None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:08.969265 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec0846-350f-4df1-bb55-f9159ebcf34b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:08.969565 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec0846-350f-4df1-bb55-f9159ebcf34b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:08.971288 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec0846-350f-4df1-bb55-f9159ebcf34b None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:08.983583 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 338/664] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:08.984409 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec0846-350f-4df1-bb55-f9159ebcf34b None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:09.013445 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cef97a-e989-4fe3-9e8c-53e556a0f6ef None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:09.051916 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d35a0-b765-4491-8bf2-67a32c96ca17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:09.052340 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d35a0-b765-4491-8bf2-67a32c96ca17 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:09.052741 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d35a0-b765-4491-8bf2-67a32c96ca17 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:09.053174 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d35a0-b765-4491-8bf2-67a32c96ca17 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:09.063699 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d35a0-b765-4491-8bf2-67a32c96ca17 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:09.066034 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d35a0-b765-4491-8bf2-67a32c96ca17 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:09.081055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-618d35a0-b765-4491-8bf2-67a32c96ca17 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 00:42:09.081055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:09.081055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:09.081055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:09.081055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:09.081055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:09.081055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:09.081055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:09.081055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:09.081055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:09.081055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:09.081055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:09.081055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:42:09.081055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:42:09.081055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:42:09.081055 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:42:09.082216 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:09.082216 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:09.082216 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:42:09.082216 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:09.082216 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:42:09.082216 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:09.082216 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:09.082216 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:09.082216 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:09.082216 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:09.082216 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:09.082216 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:09.082216 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:09.082216 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:09.082216 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:09.082216 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:09.082216 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:09.082216 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:09.083368 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:09.083368 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:09.083368 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:42:09.083368 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:42:09.083368 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:42:09.083368 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:42:09.083368 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:42:09.083368 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:42:09.083368 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 00:42:09.083368 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:09.090430 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 327/665] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Aug 28 00:42:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:09.091152 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d35a0-b765-4491-8bf2-67a32c96ca17 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:09.092468 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec0846-350f-4df1-bb55-f9159ebcf34b None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:09.128501 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1523f0-8aff-4356-8858-2de4df62df4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:09.129213 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1523f0-8aff-4356-8858-2de4df62df4e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:09.129558 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1523f0-8aff-4356-8858-2de4df62df4e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:09.129920 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1523f0-8aff-4356-8858-2de4df62df4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:09.136865 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1523f0-8aff-4356-8858-2de4df62df4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:09.138441 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1523f0-8aff-4356-8858-2de4df62df4e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:09.151273 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-7b1523f0-8aff-4356-8858-2de4df62df4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:09.151273 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:09.151273 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:09.151273 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:09.151273 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:09.151273 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:09.151273 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:09.151273 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:09.151273 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:09.151273 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:09.151273 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:09.151273 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:09.151273 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:42:09.151273 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:42:09.151273 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:42:09.152201 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:42:09.152201 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:09.152201 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:09.152201 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:09.152201 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:09.152201 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:09.152201 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:09.152201 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:09.152201 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:09.152201 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:09.152201 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:09.152201 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:09.152201 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:09.152201 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:09.152201 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:09.152201 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:09.152201 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:09.153525 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:42:09.153525 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:42:09.153525 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:42:09.153525 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:42:09.153525 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:42:09.153525 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:42:09.153525 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:09.153525 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:09.153525 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 339/666] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:42:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:09.153525 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1523f0-8aff-4356-8858-2de4df62df4e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:09.164279 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:09.204410 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:09.205771 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d35a0-b765-4491-8bf2-67a32c96ca17 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:09.241208 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed0aa3-91a3-4e12-a303-a15256be090b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:09.241833 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed0aa3-91a3-4e12-a303-a15256be090b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:09.242131 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed0aa3-91a3-4e12-a303-a15256be090b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:09.242396 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed0aa3-91a3-4e12-a303-a15256be090b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:09.253159 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed0aa3-91a3-4e12-a303-a15256be090b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:42:09.258361 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-cfed0aa3-91a3-4e12-a303-a15256be090b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:42:09.258361 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:09.258361 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:09.258361 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:09.258361 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:09.258361 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:09.258361 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:09.258361 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:09.258361 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:09.258361 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:09.258361 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:09.258361 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:09.258361 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:42:09.258361 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:42:09.258361 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:42:09.258361 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:42:09.259306 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:42:09.259306 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:42:09.259306 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:42:09.259306 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:42:09.259306 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:09.259306 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:09.259306 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:09.259306 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:09.259306 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:09.259306 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:09.259306 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:09.259306 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:09.259306 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:09.259306 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:09.259306 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:09.259306 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:09.260199 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:09.260199 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:09.260199 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:09.260199 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:09.260199 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:42:09.260199 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:42:09.260199 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:42:09.260199 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:42:09.260199 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:42:09.260199 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:42:09.260199 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:42:09.260199 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:09.260199 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 328/667] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Aug 28 00:42:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:09.260199 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed0aa3-91a3-4e12-a303-a15256be090b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:09.276480 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1523f0-8aff-4356-8858-2de4df62df4e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:09.317523 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be76d15-815e-4c3c-a87a-148b2c218bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:09.318110 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be76d15-815e-4c3c-a87a-148b2c218bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:09.318386 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be76d15-815e-4c3c-a87a-148b2c218bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:09.318653 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be76d15-815e-4c3c-a87a-148b2c218bb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:09.326159 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be76d15-815e-4c3c-a87a-148b2c218bb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:09.327768 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be76d15-815e-4c3c-a87a-148b2c218bb2 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:09.339191 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-3be76d15-815e-4c3c-a87a-148b2c218bb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:09.339191 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:09.339191 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:09.339191 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:09.339191 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:09.339191 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:09.339191 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:09.339191 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:09.339191 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:09.339191 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:09.339191 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:09.339191 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:09.339191 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:42:09.339191 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:42:09.339191 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:42:09.340116 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:42:09.340116 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:09.340116 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:09.340116 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:09.340116 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:09.340116 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:09.340116 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:09.340116 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:09.340116 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:09.340116 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:09.340116 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:09.340116 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:09.340116 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:09.340116 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:09.340116 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:09.340116 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:09.340116 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:09.341062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:42:09.341062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:42:09.341062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:42:09.341062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:42:09.341062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:42:09.341062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:42:09.341062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:09.341062 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:09.345589 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 340/668] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:42:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:09.346420 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be76d15-815e-4c3c-a87a-148b2c218bb2 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:09.368768 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed0aa3-91a3-4e12-a303-a15256be090b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:09.396632 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:09.405985 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56fbd4-81d5-4cb8-84ca-bbc51428ba9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:09.406514 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56fbd4-81d5-4cb8-84ca-bbc51428ba9d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:09.406786 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56fbd4-81d5-4cb8-84ca-bbc51428ba9d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:09.407054 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56fbd4-81d5-4cb8-84ca-bbc51428ba9d None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:09.407767 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56fbd4-81d5-4cb8-84ca-bbc51428ba9d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:09.408062 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56fbd4-81d5-4cb8-84ca-bbc51428ba9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:09.409485 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56fbd4-81d5-4cb8-84ca-bbc51428ba9d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:09.427802 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 329/669] 10.222.0.52 () {56 vars in 1139 bytes} [Sun Aug 28 00:42:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:09.428615 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56fbd4-81d5-4cb8-84ca-bbc51428ba9d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:09.452413 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:09.456973 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be76d15-815e-4c3c-a87a-148b2c218bb2 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:09.492118 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3ef86-eb7f-42a5-a33d-e1319fd1cd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:09.492728 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3ef86-eb7f-42a5-a33d-e1319fd1cd52 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:09.493006 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3ef86-eb7f-42a5-a33d-e1319fd1cd52 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:09.493280 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3ef86-eb7f-42a5-a33d-e1319fd1cd52 None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:09.494006 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3ef86-eb7f-42a5-a33d-e1319fd1cd52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:09.494312 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3ef86-eb7f-42a5-a33d-e1319fd1cd52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:09.495749 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3ef86-eb7f-42a5-a33d-e1319fd1cd52 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:09.512206 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 341/670] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:42:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:09.512206 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3ef86-eb7f-42a5-a33d-e1319fd1cd52 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:09.542946 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56fbd4-81d5-4cb8-84ca-bbc51428ba9d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:09.580560 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd396cdc-cac1-48e5-9884-30705ec51c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:09.581249 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd396cdc-cac1-48e5-9884-30705ec51c9c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:09.581586 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd396cdc-cac1-48e5-9884-30705ec51c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:09.581964 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd396cdc-cac1-48e5-9884-30705ec51c9c None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:09.582717 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd396cdc-cac1-48e5-9884-30705ec51c9c None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:09.583084 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd396cdc-cac1-48e5-9884-30705ec51c9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:09.584527 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd396cdc-cac1-48e5-9884-30705ec51c9c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:09.597709 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 330/671] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Aug 28 00:42:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:09.597709 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd396cdc-cac1-48e5-9884-30705ec51c9c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:09.620296 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3ef86-eb7f-42a5-a33d-e1319fd1cd52 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:09.652834 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:09.662480 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ddf53-7975-4b33-9e15-4f4004d203c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:09.663365 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ddf53-7975-4b33-9e15-4f4004d203c7 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:09.663641 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ddf53-7975-4b33-9e15-4f4004d203c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:09.663905 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ddf53-7975-4b33-9e15-4f4004d203c7 None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:09.664594 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ddf53-7975-4b33-9e15-4f4004d203c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:09.665511 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ddf53-7975-4b33-9e15-4f4004d203c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:09.666372 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ddf53-7975-4b33-9e15-4f4004d203c7 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:09.682725 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 342/672] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:42:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:09.682725 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ddf53-7975-4b33-9e15-4f4004d203c7 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:09.700606 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:09.719021 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd396cdc-cac1-48e5-9884-30705ec51c9c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:09.754012 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24a7cf-91d1-4deb-bc5a-e1884cc9204a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:09.754777 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24a7cf-91d1-4deb-bc5a-e1884cc9204a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:09.755143 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24a7cf-91d1-4deb-bc5a-e1884cc9204a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:09.755501 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24a7cf-91d1-4deb-bc5a-e1884cc9204a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:09.792793 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ddf53-7975-4b33-9e15-4f4004d203c7 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:09.827822 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f319899-bcf4-4862-806b-22d1944d23d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:09.828400 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f319899-bcf4-4862-806b-22d1944d23d0 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:09.828821 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f319899-bcf4-4862-806b-22d1944d23d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:09.828958 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f319899-bcf4-4862-806b-22d1944d23d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:09.829517 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24a7cf-91d1-4deb-bc5a-e1884cc9204a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:09.829999 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f319899-bcf4-4862-806b-22d1944d23d0 None admin] RBAC: Adding query filter params (role.id=ce8c7035b6004d2f84c02ebc4a05f17b, scope.project.id=45c69e3e973c449895457bb610103a43, user.id=3fbafa16c1ce4402ae4086e51767c05b) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:09.829999 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f319899-bcf4-4862-806b-22d1944d23d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:09.831095 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24a7cf-91d1-4deb-bc5a-e1884cc9204a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:09.831489 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f319899-bcf4-4862-806b-22d1944d23d0 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:09.845926 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 343/673] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:42:09 2022] GET /identity/v3/role_assignments?user.id=3fbafa16c1ce4402ae4086e51767c05b&scope.project.id=45c69e3e973c449895457bb610103a43&role.id=ce8c7035b6004d2f84c02ebc4a05f17b => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:09.845926 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f319899-bcf4-4862-806b-22d1944d23d0 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:09.894565 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:09.932350 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:09.954787 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f319899-bcf4-4862-806b-22d1944d23d0 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:09.971759 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 331/674] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:42:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:42:09.973034 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24a7cf-91d1-4deb-bc5a-e1884cc9204a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:09.997392 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063ba03-e694-42c7-8551-f6de12ca7dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:09.998231 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063ba03-e694-42c7-8551-f6de12ca7dae None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:09.998512 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063ba03-e694-42c7-8551-f6de12ca7dae None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:09.998791 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063ba03-e694-42c7-8551-f6de12ca7dae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:10.010903 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063ba03-e694-42c7-8551-f6de12ca7dae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:10.012382 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063ba03-e694-42c7-8551-f6de12ca7dae None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:10.028015 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-e063ba03-e694-42c7-8551-f6de12ca7dae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:10.028015 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:10.028015 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:10.028015 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:10.028015 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:10.028015 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:10.028015 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:10.028015 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:10.028015 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:10.028015 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:10.028015 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:10.028015 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:10.028015 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:10.028015 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:10.028015 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:10.028015 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:10.029317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:10.029317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:10.029317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:10.029317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:10.029317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:10.029317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:10.029317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:10.029317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:10.029317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:10.029317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:10.029317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:10.029317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:10.029317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:10.029317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:10.029317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:10.029317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:10.029317 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:10.030473 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:10.030473 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:10.030473 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:10.031933 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 344/675] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:10.032817 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063ba03-e694-42c7-8551-f6de12ca7dae None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:10.095506 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24a7cf-91d1-4deb-bc5a-e1884cc9204a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:10.135915 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e19b3-2d8f-4e93-9776-c04758524b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:10.136799 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e19b3-2d8f-4e93-9776-c04758524b02 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:10.137074 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e19b3-2d8f-4e93-9776-c04758524b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:10.137341 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e19b3-2d8f-4e93-9776-c04758524b02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:10.138105 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e19b3-2d8f-4e93-9776-c04758524b02 None admin] RBAC: Adding query filter params (role.id=ce8c7035b6004d2f84c02ebc4a05f17b, scope.project.id=45c69e3e973c449895457bb610103a43, user.id=34fd9f7932e14a409d7668d40ff6680e) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:10.138412 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e19b3-2d8f-4e93-9776-c04758524b02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:10.140393 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e19b3-2d8f-4e93-9776-c04758524b02 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:10.148444 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 332/676] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:42:09 2022] GET /identity/v3/role_assignments?user.id=34fd9f7932e14a409d7668d40ff6680e&scope.project.id=45c69e3e973c449895457bb610103a43&role.id=ce8c7035b6004d2f84c02ebc4a05f17b => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:10.149436 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e19b3-2d8f-4e93-9776-c04758524b02 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:10.157522 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063ba03-e694-42c7-8551-f6de12ca7dae None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:10.188294 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:10.233358 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78320288-43e1-4b37-ba60-6aa150df8d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:10.234207 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78320288-43e1-4b37-ba60-6aa150df8d0f None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:10.234483 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78320288-43e1-4b37-ba60-6aa150df8d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:10.234748 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78320288-43e1-4b37-ba60-6aa150df8d0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:10.242591 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:10.252427 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78320288-43e1-4b37-ba60-6aa150df8d0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:10.253961 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78320288-43e1-4b37-ba60-6aa150df8d0f None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:10.269020 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-78320288-43e1-4b37-ba60-6aa150df8d0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:10.269020 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:10.269020 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:10.269020 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:10.269020 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:10.269020 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:10.269020 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:10.269020 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:10.269020 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:10.269020 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:10.269020 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:10.269020 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:10.269020 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:10.269020 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:10.269020 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:10.269020 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:10.270091 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:10.270091 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:10.270091 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:10.270091 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:10.270091 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:10.270091 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:10.270091 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:10.270091 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:10.270091 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:10.270091 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:10.270091 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:10.270091 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:10.270091 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:10.270091 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:10.270091 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:10.270091 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:10.270091 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:10.271632 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:10.271632 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:10.271632 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:10.271632 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 345/677] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:10.275925 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78320288-43e1-4b37-ba60-6aa150df8d0f None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:10.359935 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e19b3-2d8f-4e93-9776-c04758524b02 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:10.405935 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30458209-9050-44a4-9eb6-885ffe593ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:10.406962 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30458209-9050-44a4-9eb6-885ffe593ddd None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:10.408008 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30458209-9050-44a4-9eb6-885ffe593ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:10.408507 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30458209-9050-44a4-9eb6-885ffe593ddd None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:10.409654 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30458209-9050-44a4-9eb6-885ffe593ddd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:10.410441 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30458209-9050-44a4-9eb6-885ffe593ddd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:10.412828 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30458209-9050-44a4-9eb6-885ffe593ddd None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:10.419842 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78320288-43e1-4b37-ba60-6aa150df8d0f None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:10.439111 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 333/678] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:10.440744 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30458209-9050-44a4-9eb6-885ffe593ddd None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:10.459961 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1becc-a482-4bcc-a583-7e50881531f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:10.460620 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1becc-a482-4bcc-a583-7e50881531f1 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:10.460896 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1becc-a482-4bcc-a583-7e50881531f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:10.461161 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1becc-a482-4bcc-a583-7e50881531f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:10.461798 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1becc-a482-4bcc-a583-7e50881531f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:10.462122 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1becc-a482-4bcc-a583-7e50881531f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:10.463577 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1becc-a482-4bcc-a583-7e50881531f1 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:10.478149 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 346/679] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:42:10.483403 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1becc-a482-4bcc-a583-7e50881531f1 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:10.534777 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:10.560865 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:10.581325 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30458209-9050-44a4-9eb6-885ffe593ddd None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:10.626979 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8359d-ab64-421d-9527-3b7f8d9020e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:10.628214 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8359d-ab64-421d-9527-3b7f8d9020e0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:10.629076 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8359d-ab64-421d-9527-3b7f8d9020e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:10.629801 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8359d-ab64-421d-9527-3b7f8d9020e0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:10.634548 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1becc-a482-4bcc-a583-7e50881531f1 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:10.640632 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8359d-ab64-421d-9527-3b7f8d9020e0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:10.642457 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8359d-ab64-421d-9527-3b7f8d9020e0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:10.658296 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-c6d8359d-ab64-421d-9527-3b7f8d9020e0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:42:10.658296 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:10.658296 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:10.658296 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:10.658296 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:10.658296 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:10.658296 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:10.658296 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:10.658296 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:10.658296 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:10.658296 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:10.658296 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:10.658296 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:42:10.658296 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:42:10.658296 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:42:10.658296 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:42:10.659457 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:10.659457 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:10.659457 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:42:10.659457 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:10.659457 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:42:10.659457 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:10.659457 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:10.659457 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:10.659457 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:10.659457 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:10.659457 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:10.659457 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:10.659457 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:10.659457 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:10.659457 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:10.659457 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:10.659457 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:10.659457 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:10.660419 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:10.660419 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:10.660419 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:42:10.660419 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:42:10.660419 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:42:10.660419 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:42:10.660419 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:42:10.660419 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:42:10.660419 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:42:10.660419 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:10.660419 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 334/680] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:42:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:42:10.661975 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae439c1-0258-4839-9256-c89e6da5fa96 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:10.661975 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae439c1-0258-4839-9256-c89e6da5fa96 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:10.661975 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae439c1-0258-4839-9256-c89e6da5fa96 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:10.663252 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 335/681] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:10.666069 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae439c1-0258-4839-9256-c89e6da5fa96 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:10.687687 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7ad7d-9cd7-4b78-8f2e-bf8baf7ca29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:10.689206 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7ad7d-9cd7-4b78-8f2e-bf8baf7ca29a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:10.689698 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7ad7d-9cd7-4b78-8f2e-bf8baf7ca29a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:10.690204 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7ad7d-9cd7-4b78-8f2e-bf8baf7ca29a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:10.699918 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7ad7d-9cd7-4b78-8f2e-bf8baf7ca29a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:10.702441 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7ad7d-9cd7-4b78-8f2e-bf8baf7ca29a None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:10.722838 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-a6b7ad7d-9cd7-4b78-8f2e-bf8baf7ca29a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:10.722838 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:10.722838 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:10.722838 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:10.722838 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:10.722838 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:10.722838 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:10.722838 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:10.722838 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:10.722838 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:10.722838 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:10.722838 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:10.722838 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:42:10.722838 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:42:10.722838 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:42:10.724009 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:42:10.724009 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:10.724009 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:10.724009 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:10.724009 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:10.724009 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:10.724009 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:10.724009 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:10.724009 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:10.724009 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:10.724009 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:10.724009 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:10.724009 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:10.724009 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:10.724009 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:10.724009 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:10.724009 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:10.725166 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:42:10.725166 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:42:10.725166 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:42:10.725166 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:42:10.725166 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:42:10.725166 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:42:10.725166 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:10.725166 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:10.727984 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 347/682] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:42:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:10.729505 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ea8c4-aab4-4448-a5ef-a6d9dcbda327 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:10.730017 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ea8c4-aab4-4448-a5ef-a6d9dcbda327 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:10.731024 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ea8c4-aab4-4448-a5ef-a6d9dcbda327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:10.755413 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-489ea8c4-aab4-4448-a5ef-a6d9dcbda327 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:10.756891 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-489ea8c4-aab4-4448-a5ef-a6d9dcbda327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:10.795681 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae439c1-0258-4839-9256-c89e6da5fa96 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:10.827213 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:10.833182 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765a4c0-cc72-4555-a302-749fea77965c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:10.833812 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765a4c0-cc72-4555-a302-749fea77965c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:10.834207 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765a4c0-cc72-4555-a302-749fea77965c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:10.834569 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765a4c0-cc72-4555-a302-749fea77965c None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:10.835407 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765a4c0-cc72-4555-a302-749fea77965c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:10.835809 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765a4c0-cc72-4555-a302-749fea77965c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:10.837428 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765a4c0-cc72-4555-a302-749fea77965c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:10.849363 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 348/683] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:42:10.849363 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ea8c4-aab4-4448-a5ef-a6d9dcbda327 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:10.868593 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 336/684] 10.222.0.52 () {56 vars in 1135 bytes} [Sun Aug 28 00:42:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:10.873075 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765a4c0-cc72-4555-a302-749fea77965c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:10.920089 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:11.021864 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765a4c0-cc72-4555-a302-749fea77965c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:11.060036 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ea8c4-aab4-4448-a5ef-a6d9dcbda327 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:11.060554 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e9e0f-d405-4629-beae-5b0cb82e745f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:11.061401 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e9e0f-d405-4629-beae-5b0cb82e745f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:11.061863 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e9e0f-d405-4629-beae-5b0cb82e745f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:11.062157 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e9e0f-d405-4629-beae-5b0cb82e745f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:11.127238 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:11.139591 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e9e0f-d405-4629-beae-5b0cb82e745f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:11.141104 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e9e0f-d405-4629-beae-5b0cb82e745f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:11.162270 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12cbc5c-d8d6-4d2e-97ec-9bc76539c73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:11.163309 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cbc5c-d8d6-4d2e-97ec-9bc76539c73a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:11.163777 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cbc5c-d8d6-4d2e-97ec-9bc76539c73a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:11.164274 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cbc5c-d8d6-4d2e-97ec-9bc76539c73a None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:11.165179 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12cbc5c-d8d6-4d2e-97ec-9bc76539c73a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:11.165727 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12cbc5c-d8d6-4d2e-97ec-9bc76539c73a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:11.167377 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12cbc5c-d8d6-4d2e-97ec-9bc76539c73a None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:11.180955 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 349/685] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:42:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:11.182111 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12cbc5c-d8d6-4d2e-97ec-9bc76539c73a None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:11.261614 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 337/686] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:42:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:42:11.262848 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e9e0f-d405-4629-beae-5b0cb82e745f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:11.283207 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:11.290894 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12cbc5c-d8d6-4d2e-97ec-9bc76539c73a None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:11.325777 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384ae47-a3f7-46cb-b3df-121e5a383b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:11.326886 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384ae47-a3f7-46cb-b3df-121e5a383b49 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:11.327570 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384ae47-a3f7-46cb-b3df-121e5a383b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:11.328039 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384ae47-a3f7-46cb-b3df-121e5a383b49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:11.338967 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5384ae47-a3f7-46cb-b3df-121e5a383b49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:42:11.345446 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-5384ae47-a3f7-46cb-b3df-121e5a383b49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:42:11.345446 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:11.345446 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:11.345446 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:11.345446 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:11.345446 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:11.345446 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:11.345446 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:11.345446 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:11.345446 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:11.345446 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:11.345446 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:11.345446 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:42:11.345446 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:42:11.345446 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:42:11.345446 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:42:11.346419 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:42:11.346419 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:42:11.346419 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:42:11.346419 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:42:11.346419 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:11.346419 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:11.346419 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:11.346419 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:11.346419 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:11.346419 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:11.346419 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:11.346419 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:11.346419 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:11.346419 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:11.346419 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:11.346419 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:11.347289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:11.347289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:11.347289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:11.347289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:11.347289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:42:11.347289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:42:11.347289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:42:11.347289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:42:11.347289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:42:11.347289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:42:11.347289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:42:11.347289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:11.354393 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 350/687] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:42:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:11.355560 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384ae47-a3f7-46cb-b3df-121e5a383b49 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:11.371514 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:11.382808 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e9e0f-d405-4629-beae-5b0cb82e745f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:11.425259 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0cde7-7e0b-42f6-86b2-d7a4f9973e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:11.425876 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0cde7-7e0b-42f6-86b2-d7a4f9973e1f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:11.426155 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0cde7-7e0b-42f6-86b2-d7a4f9973e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:11.426426 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0cde7-7e0b-42f6-86b2-d7a4f9973e1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:11.427154 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0cde7-7e0b-42f6-86b2-d7a4f9973e1f None admin] RBAC: Adding query filter params (role.id=ce8c7035b6004d2f84c02ebc4a05f17b, scope.project.id=45c69e3e973c449895457bb610103a43, user.id=0ca94d8693c64e388bd0d15db07f5fd4) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:11.427457 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0cde7-7e0b-42f6-86b2-d7a4f9973e1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:11.429520 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0cde7-7e0b-42f6-86b2-d7a4f9973e1f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:11.437030 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 338/688] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:42:11 2022] GET /identity/v3/role_assignments?user.id=0ca94d8693c64e388bd0d15db07f5fd4&scope.project.id=45c69e3e973c449895457bb610103a43&role.id=ce8c7035b6004d2f84c02ebc4a05f17b => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:11.437819 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0cde7-7e0b-42f6-86b2-d7a4f9973e1f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:11.468939 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384ae47-a3f7-46cb-b3df-121e5a383b49 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:11.507194 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a70d7-d74a-4614-a309-c607939abaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:11.508281 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a70d7-d74a-4614-a309-c607939abaf1 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:11.508848 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a70d7-d74a-4614-a309-c607939abaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:11.509313 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a70d7-d74a-4614-a309-c607939abaf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:11.522153 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a70d7-d74a-4614-a309-c607939abaf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:11.523998 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a70d7-d74a-4614-a309-c607939abaf1 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:11.556307 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-130a70d7-d74a-4614-a309-c607939abaf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:11.556307 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:11.556307 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:11.556307 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:11.556307 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:11.556307 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:11.556307 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:11.556307 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:11.556307 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:11.556307 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:11.556307 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:11.556307 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:11.556307 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:11.556307 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:11.556307 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:11.556307 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:11.557331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:11.557331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:11.557331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:11.557331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:11.557331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:11.557331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:11.557331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:11.557331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:11.557331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:11.557331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:11.557331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:11.557331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:11.557331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:11.557331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:11.557331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:11.557331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:11.557331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:11.558312 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:11.558312 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:11.558312 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:11.558312 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 351/689] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:11.563412 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a70d7-d74a-4614-a309-c607939abaf1 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:11.578186 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0cde7-7e0b-42f6-86b2-d7a4f9973e1f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:11.579410 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:11.655573 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddc893-dabc-46fb-8b56-94685c4f2160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:11.656184 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddc893-dabc-46fb-8b56-94685c4f2160 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:11.656458 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddc893-dabc-46fb-8b56-94685c4f2160 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:11.656724 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddc893-dabc-46fb-8b56-94685c4f2160 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:11.657388 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cddc893-dabc-46fb-8b56-94685c4f2160 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:11.657685 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cddc893-dabc-46fb-8b56-94685c4f2160 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:11.659085 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cddc893-dabc-46fb-8b56-94685c4f2160 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:11.673221 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 339/690] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:42:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:11.678817 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddc893-dabc-46fb-8b56-94685c4f2160 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:11.705296 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:11.725814 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a70d7-d74a-4614-a309-c607939abaf1 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:11.765145 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2857189-671d-4b34-b1ac-02c7eef1e395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:11.765752 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2857189-671d-4b34-b1ac-02c7eef1e395 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:11.766073 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2857189-671d-4b34-b1ac-02c7eef1e395 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:11.766600 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2857189-671d-4b34-b1ac-02c7eef1e395 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:11.766987 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2857189-671d-4b34-b1ac-02c7eef1e395 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:11.767283 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2857189-671d-4b34-b1ac-02c7eef1e395 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:11.768654 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2857189-671d-4b34-b1ac-02c7eef1e395 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:11.782296 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 352/691] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:11.788269 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2857189-671d-4b34-b1ac-02c7eef1e395 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:11.815195 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddc893-dabc-46fb-8b56-94685c4f2160 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:11.864561 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1af90-cf3a-4f3c-8862-4017e3d91f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:11.864561 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1af90-cf3a-4f3c-8862-4017e3d91f7a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:11.865276 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1af90-cf3a-4f3c-8862-4017e3d91f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:11.865276 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1af90-cf3a-4f3c-8862-4017e3d91f7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:11.866462 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:11.895961 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1af90-cf3a-4f3c-8862-4017e3d91f7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:11.897430 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1af90-cf3a-4f3c-8862-4017e3d91f7a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:11.925434 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-58e1af90-cf3a-4f3c-8862-4017e3d91f7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:11.925434 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:11.925434 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:11.925434 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:11.925434 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:11.925434 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:11.925434 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:11.925434 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:11.925434 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:11.925434 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:11.925434 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:11.925434 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:11.925434 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:11.925434 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:11.925434 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:11.925434 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:11.926472 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:11.926472 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:11.926472 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:11.926472 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:11.926472 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:11.926472 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:11.926472 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:11.926472 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:11.926472 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:11.926472 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:11.926472 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:11.926472 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:11.926472 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:11.926472 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:11.926472 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:11.926472 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:11.926472 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:11.927377 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:11.927377 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:11.927377 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:11.938045 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 340/692] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:11.938992 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1af90-cf3a-4f3c-8862-4017e3d91f7a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:11.941301 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2857189-671d-4b34-b1ac-02c7eef1e395 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:12.001329 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b9353-e64f-4445-8a48-21d3cf1a0457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:12.002547 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b9353-e64f-4445-8a48-21d3cf1a0457 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:12.002824 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b9353-e64f-4445-8a48-21d3cf1a0457 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:12.003087 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b9353-e64f-4445-8a48-21d3cf1a0457 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:12.020037 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b9353-e64f-4445-8a48-21d3cf1a0457 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:12.021511 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b9353-e64f-4445-8a48-21d3cf1a0457 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:12.048939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-b94b9353-e64f-4445-8a48-21d3cf1a0457 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:12.048939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:12.048939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:12.048939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:12.048939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:12.048939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:12.048939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:12.048939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:12.048939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:12.048939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:12.048939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:12.048939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:12.048939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:42:12.048939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:42:12.048939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:42:12.049928 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:42:12.049928 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:12.049928 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:12.049928 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:12.049928 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:12.049928 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:12.049928 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:12.049928 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:12.049928 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:12.049928 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:12.049928 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:12.049928 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:12.049928 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:12.049928 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:12.049928 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:12.049928 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:12.049928 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:12.050831 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:42:12.050831 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:42:12.050831 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:42:12.050831 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:42:12.050831 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:42:12.050831 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:42:12.050831 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:12.050831 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:12.050831 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 353/693] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:42:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:12.067639 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b9353-e64f-4445-8a48-21d3cf1a0457 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:12.084078 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:12.122129 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1af90-cf3a-4f3c-8862-4017e3d91f7a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:12.157795 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5182c-0bcc-45b1-94dd-44fda5e33a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:12.158529 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5182c-0bcc-45b1-94dd-44fda5e33a17 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:12.158873 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5182c-0bcc-45b1-94dd-44fda5e33a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:12.159260 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5182c-0bcc-45b1-94dd-44fda5e33a17 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:12.159970 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5182c-0bcc-45b1-94dd-44fda5e33a17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:12.160377 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5182c-0bcc-45b1-94dd-44fda5e33a17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:12.161870 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5182c-0bcc-45b1-94dd-44fda5e33a17 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:12.175522 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 341/694] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:12.176967 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0589e0-c6e5-4be6-b7a6-aaec3a780265 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:12.177367 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0589e0-c6e5-4be6-b7a6-aaec3a780265 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:12.177729 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0589e0-c6e5-4be6-b7a6-aaec3a780265 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:12.183305 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 342/695] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:12.184312 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0589e0-c6e5-4be6-b7a6-aaec3a780265 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:12.204623 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b9353-e64f-4445-8a48-21d3cf1a0457 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:12.245068 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:12.251499 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac52f9-471f-464c-a814-439fec04bcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:12.252244 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac52f9-471f-464c-a814-439fec04bcd7 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:12.252457 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac52f9-471f-464c-a814-439fec04bcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:12.252728 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac52f9-471f-464c-a814-439fec04bcd7 None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:12.254351 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac52f9-471f-464c-a814-439fec04bcd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:12.254890 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac52f9-471f-464c-a814-439fec04bcd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:12.257406 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac52f9-471f-464c-a814-439fec04bcd7 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:12.273710 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 354/696] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:42:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:42:12.275295 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12f1c3-221c-471a-bcd5-d57d7a6a1dc6 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:12.275772 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12f1c3-221c-471a-bcd5-d57d7a6a1dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:12.276231 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12f1c3-221c-471a-bcd5-d57d7a6a1dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:12.298989 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-1b12f1c3-221c-471a-bcd5-d57d7a6a1dc6 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:12.300834 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1b12f1c3-221c-471a-bcd5-d57d7a6a1dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:12.308029 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0589e0-c6e5-4be6-b7a6-aaec3a780265 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:12.345944 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:12.357240 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e1447-45c1-4739-8575-4f2e38031c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:12.358571 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e1447-45c1-4739-8575-4f2e38031c0a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:12.358855 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e1447-45c1-4739-8575-4f2e38031c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:12.360546 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e1447-45c1-4739-8575-4f2e38031c0a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:12.372318 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e1447-45c1-4739-8575-4f2e38031c0a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:12.374900 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e1447-45c1-4739-8575-4f2e38031c0a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:12.389266 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-a77e1447-45c1-4739-8575-4f2e38031c0a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:42:12.389266 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:12.389266 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:12.389266 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:12.389266 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:12.389266 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:12.389266 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:12.389266 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:12.389266 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:12.389266 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:12.389266 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:12.389266 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:12.389266 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:42:12.389266 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:42:12.389266 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:42:12.389266 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:42:12.390399 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:12.390399 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:12.390399 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:42:12.390399 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:12.390399 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:42:12.390399 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:12.390399 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:12.390399 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:12.390399 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:12.390399 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:12.390399 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:12.390399 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:12.390399 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:12.390399 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:12.390399 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:12.390399 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:12.390399 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:12.390399 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:12.391396 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:12.391396 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:12.391396 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:42:12.391396 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:42:12.391396 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:42:12.391396 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:42:12.391396 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:42:12.391396 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:42:12.391396 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:42:12.391396 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:12.391940 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 355/697] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:42:12.391940 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12f1c3-221c-471a-bcd5-d57d7a6a1dc6 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:12.398541 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 343/698] 10.222.0.52 () {56 vars in 1093 bytes} [Sun Aug 28 00:42:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:12.399575 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e1447-45c1-4739-8575-4f2e38031c0a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:12.514845 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e1447-45c1-4739-8575-4f2e38031c0a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:12.554844 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6f22e-c0d2-48cf-be33-7f9880cbe263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:12.555707 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6f22e-c0d2-48cf-be33-7f9880cbe263 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:12.556416 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6f22e-c0d2-48cf-be33-7f9880cbe263 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:12.557248 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6f22e-c0d2-48cf-be33-7f9880cbe263 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:12.558237 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6f22e-c0d2-48cf-be33-7f9880cbe263 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:12.558734 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6f22e-c0d2-48cf-be33-7f9880cbe263 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:12.560349 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6f22e-c0d2-48cf-be33-7f9880cbe263 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:12.573860 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12f1c3-221c-471a-bcd5-d57d7a6a1dc6 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:12.586508 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 344/699] 10.222.0.52 () {56 vars in 1133 bytes} [Sun Aug 28 00:42:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:12.591620 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996a94e-6118-436c-a3ab-40fe6af8199d None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:12.591620 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996a94e-6118-436c-a3ab-40fe6af8199d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:12.591620 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996a94e-6118-436c-a3ab-40fe6af8199d None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:12.594286 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 345/700] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:12.596044 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996a94e-6118-436c-a3ab-40fe6af8199d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:12.600185 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:12.625296 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2c3ea-71ab-4777-a7f8-ee34992a64c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:12.626505 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2c3ea-71ab-4777-a7f8-ee34992a64c2 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:12.627343 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2c3ea-71ab-4777-a7f8-ee34992a64c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:12.628078 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2c3ea-71ab-4777-a7f8-ee34992a64c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:12.629237 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2c3ea-71ab-4777-a7f8-ee34992a64c2 None admin] RBAC: Adding query filter params (role.id=ce8c7035b6004d2f84c02ebc4a05f17b, scope.project.id=45c69e3e973c449895457bb610103a43, user.id=a80a6019cf424c16a1d461a632cf8568) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:12.630110 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2c3ea-71ab-4777-a7f8-ee34992a64c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:12.631588 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2c3ea-71ab-4777-a7f8-ee34992a64c2 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:12.637894 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 356/701] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:42:12 2022] GET /identity/v3/role_assignments?user.id=a80a6019cf424c16a1d461a632cf8568&scope.project.id=45c69e3e973c449895457bb610103a43&role.id=ce8c7035b6004d2f84c02ebc4a05f17b => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:12.639221 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7384a-2f1f-478e-9051-c0cc4cd03917 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:12.639508 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7384a-2f1f-478e-9051-c0cc4cd03917 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:12.639783 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7384a-2f1f-478e-9051-c0cc4cd03917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:12.658092 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:12.659586 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-3ad7384a-2f1f-478e-9051-c0cc4cd03917 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:12.660880 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3ad7384a-2f1f-478e-9051-c0cc4cd03917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:12.734587 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 357/702] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:42:12.740049 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996a94e-6118-436c-a3ab-40fe6af8199d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:12.787671 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7384a-2f1f-478e-9051-c0cc4cd03917 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:12.797209 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e5278-c8cd-49dc-841b-63fa1da294e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:12.797972 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e5278-c8cd-49dc-841b-63fa1da294e1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:12.798253 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e5278-c8cd-49dc-841b-63fa1da294e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:12.798521 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e5278-c8cd-49dc-841b-63fa1da294e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:12.902224 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e5278-c8cd-49dc-841b-63fa1da294e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:12.903690 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e5278-c8cd-49dc-841b-63fa1da294e1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:12.937460 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7384a-2f1f-478e-9051-c0cc4cd03917 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:12.953232 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:12.963070 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:12.982919 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb3670-4074-4a60-a51f-09c4f591ae75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:12.984048 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb3670-4074-4a60-a51f-09c4f591ae75 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:12.985046 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb3670-4074-4a60-a51f-09c4f591ae75 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:12.985488 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb3670-4074-4a60-a51f-09c4f591ae75 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:12.986536 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb3670-4074-4a60-a51f-09c4f591ae75 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:12.989345 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb3670-4074-4a60-a51f-09c4f591ae75 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:13.003606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-63fb3670-4074-4a60-a51f-09c4f591ae75 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:42:13.003606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:13.003606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:42:13.003606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:42:13.003606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:42:13.003606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:42:13.003606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:42:13.003606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:13.003606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:42:13.003606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:13.003606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:42:13.003606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:13.003606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:13.003606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:13.003606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:13.003606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:13.003606 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:13.004940 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:13.004940 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:13.004940 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:13.004940 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:13.004940 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:13.004940 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:13.004940 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:42:13.004940 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:42:13.004940 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:42:13.004940 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:42:13.004940 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:13.004940 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:13.004940 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:13.004940 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:13.004940 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:13.004940 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:13.006036 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:13.006036 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:13.006036 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:13.006036 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:13.006036 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:13.006036 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:13.006036 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:13.006036 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:13.006036 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:13.006036 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:13.006036 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:42:13.006036 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:13.006036 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:42:13.006036 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:13.007154 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 358/703] 10.222.0.52 () {56 vars in 1129 bytes} [Sun Aug 28 00:42:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:42:13.014228 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb3670-4074-4a60-a51f-09c4f591ae75 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:13.028245 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 346/704] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:42:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:42:13.034861 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e5278-c8cd-49dc-841b-63fa1da294e1 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:13.136413 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb3670-4074-4a60-a51f-09c4f591ae75 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:13.139305 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e5278-c8cd-49dc-841b-63fa1da294e1 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:13.178076 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf956ad8-416f-47dc-98e4-c011c2bfa795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:13.178691 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf956ad8-416f-47dc-98e4-c011c2bfa795 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:13.178970 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf956ad8-416f-47dc-98e4-c011c2bfa795 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:13.179237 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf956ad8-416f-47dc-98e4-c011c2bfa795 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:13.179877 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf956ad8-416f-47dc-98e4-c011c2bfa795 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:13.180179 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf956ad8-416f-47dc-98e4-c011c2bfa795 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:13.181584 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf956ad8-416f-47dc-98e4-c011c2bfa795 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:13.190786 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 359/705] 10.222.0.52 () {56 vars in 1124 bytes} [Sun Aug 28 00:42:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:42:13.190786 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf956ad8-416f-47dc-98e4-c011c2bfa795 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:13.193177 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c5170-ac03-4437-835b-68956dc4c5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:13.194107 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c5170-ac03-4437-835b-68956dc4c5f7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:13.194582 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c5170-ac03-4437-835b-68956dc4c5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:13.195044 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c5170-ac03-4437-835b-68956dc4c5f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:13.209800 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c5170-ac03-4437-835b-68956dc4c5f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:13.212125 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c5170-ac03-4437-835b-68956dc4c5f7 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:13.222328 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:13.231319 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-917c5170-ac03-4437-835b-68956dc4c5f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:13.231319 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:13.231319 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:13.231319 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:13.231319 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:13.231319 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:13.231319 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:13.231319 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:13.231319 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:13.231319 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:13.231319 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:13.231319 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:13.231319 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:13.231319 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:13.231319 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:13.231319 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:13.232273 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:13.232273 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:13.232273 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:13.232273 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:13.232273 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:13.232273 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:13.232273 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:13.232273 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:13.232273 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:13.232273 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:13.232273 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:13.232273 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:13.232273 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:13.232273 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:13.232273 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:13.232273 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:13.232273 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:13.233264 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:13.233264 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:13.233264 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:13.233264 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 347/706] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:13.233508 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c5170-ac03-4437-835b-68956dc4c5f7 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:13.241648 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:13.304088 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf956ad8-416f-47dc-98e4-c011c2bfa795 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:13.347717 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46bb5f4-590b-4835-8778-e4449337d748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:13.349119 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bb5f4-590b-4835-8778-e4449337d748 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:13.349889 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bb5f4-590b-4835-8778-e4449337d748 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:13.350339 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bb5f4-590b-4835-8778-e4449337d748 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:13.360991 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c5170-ac03-4437-835b-68956dc4c5f7 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:13.365995 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46bb5f4-590b-4835-8778-e4449337d748 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:13.367668 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46bb5f4-590b-4835-8778-e4449337d748 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:13.388411 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-b46bb5f4-590b-4835-8778-e4449337d748 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:13.388411 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:13.388411 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:13.388411 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:13.388411 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:13.388411 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:13.388411 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:13.388411 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:13.388411 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:13.388411 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:13.388411 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:13.388411 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:13.388411 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:13.388411 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:13.388411 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:13.388411 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:13.389506 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:13.389506 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:13.389506 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:13.389506 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:13.389506 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:13.389506 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:13.389506 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:13.389506 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:13.389506 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:13.389506 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:13.389506 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:13.389506 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:13.389506 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:13.389506 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:13.389506 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:13.389506 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:13.389506 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:13.390442 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:13.390442 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:13.390442 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:13.392250 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 360/707] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:13.393070 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46bb5f4-590b-4835-8778-e4449337d748 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:13.401227 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8551cc8-f983-45a4-8d9e-e77d3d49b98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:13.401859 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8551cc8-f983-45a4-8d9e-e77d3d49b98e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:13.402146 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8551cc8-f983-45a4-8d9e-e77d3d49b98e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:13.402420 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8551cc8-f983-45a4-8d9e-e77d3d49b98e None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:13.403059 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8551cc8-f983-45a4-8d9e-e77d3d49b98e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:13.403360 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8551cc8-f983-45a4-8d9e-e77d3d49b98e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:13.404886 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8551cc8-f983-45a4-8d9e-e77d3d49b98e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:13.417905 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 348/708] 10.222.0.52 () {56 vars in 1124 bytes} [Sun Aug 28 00:42:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:13.417905 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8551cc8-f983-45a4-8d9e-e77d3d49b98e None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:13.529226 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:13.580479 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:13.591006 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46bb5f4-590b-4835-8778-e4449337d748 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:13.629162 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07ecb7-aa7e-478d-b844-97e0e1198bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:13.630159 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07ecb7-aa7e-478d-b844-97e0e1198bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:13.630691 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07ecb7-aa7e-478d-b844-97e0e1198bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:13.631185 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07ecb7-aa7e-478d-b844-97e0e1198bc0 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:13.632031 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07ecb7-aa7e-478d-b844-97e0e1198bc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:13.632536 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07ecb7-aa7e-478d-b844-97e0e1198bc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:13.634146 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07ecb7-aa7e-478d-b844-97e0e1198bc0 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:13.636187 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8551cc8-f983-45a4-8d9e-e77d3d49b98e None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:13.648297 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 361/709] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:13.653286 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07ecb7-aa7e-478d-b844-97e0e1198bc0 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:13.681814 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78320474-a8c6-4cf3-8590-82a3429532b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:13.682558 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78320474-a8c6-4cf3-8590-82a3429532b5 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:13.682907 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78320474-a8c6-4cf3-8590-82a3429532b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:13.683278 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78320474-a8c6-4cf3-8590-82a3429532b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:13.684876 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78320474-a8c6-4cf3-8590-82a3429532b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:13.684876 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78320474-a8c6-4cf3-8590-82a3429532b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:13.686585 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78320474-a8c6-4cf3-8590-82a3429532b5 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:13.701894 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 349/710] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:13.707184 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78320474-a8c6-4cf3-8590-82a3429532b5 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:13.805786 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07ecb7-aa7e-478d-b844-97e0e1198bc0 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:13.816084 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78320474-a8c6-4cf3-8590-82a3429532b5 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:13.842389 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:13.855854 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4b4a0-94f5-4043-b19d-524a5a432d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:13.856495 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4b4a0-94f5-4043-b19d-524a5a432d20 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:13.856773 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4b4a0-94f5-4043-b19d-524a5a432d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:13.857043 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4b4a0-94f5-4043-b19d-524a5a432d20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:13.859213 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058943e8-388d-4657-b295-ce88ec361270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:13.860327 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058943e8-388d-4657-b295-ce88ec361270 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:13.861185 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058943e8-388d-4657-b295-ce88ec361270 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:13.861654 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058943e8-388d-4657-b295-ce88ec361270 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:13.862535 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058943e8-388d-4657-b295-ce88ec361270 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:13.864327 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058943e8-388d-4657-b295-ce88ec361270 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:13.865385 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4b4a0-94f5-4043-b19d-524a5a432d20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:13.866871 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4b4a0-94f5-4043-b19d-524a5a432d20 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:13.879812 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-4ea4b4a0-94f5-4043-b19d-524a5a432d20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:13.879812 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:13.879812 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:13.879812 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:13.879812 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:13.879812 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:13.879812 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:13.879812 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:13.879812 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:13.879812 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:13.879812 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:13.879812 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:13.879812 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:42:13.879812 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:42:13.879812 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:42:13.880780 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:42:13.880780 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:13.880780 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:13.880780 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:13.880780 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:13.880780 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:13.880780 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:13.880780 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:13.880780 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:13.880780 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:13.880780 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:13.880780 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:13.880780 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:13.880780 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:13.880780 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:13.880780 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:13.880780 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:13.881687 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:42:13.881687 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:42:13.881687 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:42:13.881687 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:42:13.881687 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:42:13.881687 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:42:13.881687 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:13.881687 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:13.881687 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 362/711] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:42:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:13.882781 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff168e-bd8c-4868-b655-7891691b5c2f None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:13.883111 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff168e-bd8c-4868-b655-7891691b5c2f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:13.883407 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff168e-bd8c-4868-b655-7891691b5c2f None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:13.889978 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 363/712] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:13.890841 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff168e-bd8c-4868-b655-7891691b5c2f None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:13.896631 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 350/713] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Aug 28 00:42:13 2022] POST /identity/v3/users => generated 254 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:42:13.898748 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db29e5-93db-452f-a59d-c35dc1497127 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:13.899238 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db29e5-93db-452f-a59d-c35dc1497127 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:13.899717 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db29e5-93db-452f-a59d-c35dc1497127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:13.911483 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:13.926006 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e2db29e5-93db-452f-a59d-c35dc1497127 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:13.928347 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e2db29e5-93db-452f-a59d-c35dc1497127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:14.015224 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 351/714] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:42:14.046531 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff168e-bd8c-4868-b655-7891691b5c2f None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:14.100328 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39443eb-7027-4169-ae6b-83910c6d162f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:14.100992 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39443eb-7027-4169-ae6b-83910c6d162f None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:14.101274 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39443eb-7027-4169-ae6b-83910c6d162f None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:14.101597 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39443eb-7027-4169-ae6b-83910c6d162f None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:14.102329 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39443eb-7027-4169-ae6b-83910c6d162f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:14.102634 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39443eb-7027-4169-ae6b-83910c6d162f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:14.104085 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39443eb-7027-4169-ae6b-83910c6d162f None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:14.118884 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 364/715] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:42:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:14.124574 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db29e5-93db-452f-a59d-c35dc1497127 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:14.234779 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db29e5-93db-452f-a59d-c35dc1497127 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:14.246194 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:14.274723 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca5eef-c8c6-4a4e-b271-0a67cb0291d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:14.275602 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca5eef-c8c6-4a4e-b271-0a67cb0291d8 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:14.276072 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca5eef-c8c6-4a4e-b271-0a67cb0291d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:14.276516 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca5eef-c8c6-4a4e-b271-0a67cb0291d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:14.277428 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca5eef-c8c6-4a4e-b271-0a67cb0291d8 None admin] RBAC: Adding query filter params (role.id=cc013581bb07418d9ec6a3a1d282ea53, scope.project.id=45c69e3e973c449895457bb610103a43, user.id=f890ff4e7807477db7f17c2f6434dce8) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:14.277933 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca5eef-c8c6-4a4e-b271-0a67cb0291d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:14.280247 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca5eef-c8c6-4a4e-b271-0a67cb0291d8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:14.286239 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 352/716] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:42:14 2022] GET /identity/v3/role_assignments?user.id=f890ff4e7807477db7f17c2f6434dce8&scope.project.id=45c69e3e973c449895457bb610103a43&role.id=cc013581bb07418d9ec6a3a1d282ea53 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:14.402827 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39443eb-7027-4169-ae6b-83910c6d162f None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:14.477985 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:14.508981 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39443eb-7027-4169-ae6b-83910c6d162f None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:14.550757 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c7c17-6453-4f30-87a2-cbaab1819e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:14.551732 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c7c17-6453-4f30-87a2-cbaab1819e91 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:14.552223 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c7c17-6453-4f30-87a2-cbaab1819e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:14.552729 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c7c17-6453-4f30-87a2-cbaab1819e91 None admin] PATH_INFO: `/v3/services/network` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:14.553506 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c7c17-6453-4f30-87a2-cbaab1819e91 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:14.555088 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c7c17-6453-4f30-87a2-cbaab1819e91 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:14.564467 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-df9c7c17-6453-4f30-87a2-cbaab1819e91 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:42:14.564467 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:14.564467 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:42:14.564467 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:42:14.564467 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:42:14.564467 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:42:14.564467 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:42:14.564467 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:14.564467 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:42:14.564467 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:14.564467 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:42:14.564467 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:14.564467 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:14.564467 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:14.564467 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:14.564467 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:14.564467 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:14.565549 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:14.565549 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:14.565549 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:14.565549 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:14.565549 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:14.565549 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:14.565549 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:42:14.565549 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:42:14.565549 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:42:14.565549 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:42:14.565549 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:14.565549 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:14.565549 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:14.565549 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:14.565549 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:14.565549 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:14.566445 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:14.566445 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:14.566445 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:14.566445 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:14.566445 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:14.566445 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:14.566445 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:14.566445 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:14.566445 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:14.566445 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:14.566445 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:42:14.566445 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:14.566445 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:42:14.566445 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:14.569211 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 365/717] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:42:14 2022] GET /identity/v3/services/network => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:14.578984 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca5eef-c8c6-4a4e-b271-0a67cb0291d8 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:14.706605 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca5eef-c8c6-4a4e-b271-0a67cb0291d8 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:14.742463 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ace446-5c3f-4fd3-8c68-5f744033aa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:14.743432 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ace446-5c3f-4fd3-8c68-5f744033aa3a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:14.743899 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ace446-5c3f-4fd3-8c68-5f744033aa3a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:14.744397 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ace446-5c3f-4fd3-8c68-5f744033aa3a None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:14.745244 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ace446-5c3f-4fd3-8c68-5f744033aa3a None admin] RBAC: Adding query filter params (name=network) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:14.745743 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ace446-5c3f-4fd3-8c68-5f744033aa3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:14.747341 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ace446-5c3f-4fd3-8c68-5f744033aa3a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:14.752336 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 353/718] 10.222.0.52 () {56 vars in 1112 bytes} [Sun Aug 28 00:42:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:14.758899 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c7c17-6453-4f30-87a2-cbaab1819e91 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:14.879497 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c7c17-6453-4f30-87a2-cbaab1819e91 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:14.925334 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ff62d-3f05-46f1-a057-de77299867cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:14.926393 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ff62d-3f05-46f1-a057-de77299867cf None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:14.926865 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ff62d-3f05-46f1-a057-de77299867cf None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:14.927366 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ff62d-3f05-46f1-a057-de77299867cf None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:14.928207 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ff62d-3f05-46f1-a057-de77299867cf None admin] RBAC: Adding query filter params (type=network) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:14.928713 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ff62d-3f05-46f1-a057-de77299867cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:14.930313 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ff62d-3f05-46f1-a057-de77299867cf None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:14.935359 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:14.939814 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 366/719] 10.222.0.52 () {56 vars in 1112 bytes} [Sun Aug 28 00:42:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:15.216165 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbbdfc-3e2d-45c3-8745-0ec9e553914c None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:15.217295 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbbdfc-3e2d-45c3-8745-0ec9e553914c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:15.217811 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbbdfc-3e2d-45c3-8745-0ec9e553914c None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:15.219591 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 354/720] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:15.225620 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ce37d-20f1-45f0-be1e-b31227688e79 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:15.226166 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ce37d-20f1-45f0-be1e-b31227688e79 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:15.226647 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ce37d-20f1-45f0-be1e-b31227688e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:15.245390 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-603ce37d-20f1-45f0-be1e-b31227688e79 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:15.246901 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-603ce37d-20f1-45f0-be1e-b31227688e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:15.326663 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 367/721] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:42:15.610812 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbbdfc-3e2d-45c3-8745-0ec9e553914c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:15.658256 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:15.686681 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d8486-ffa4-460d-9e2b-806867a9ccff None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:15.687202 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d8486-ffa4-460d-9e2b-806867a9ccff None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:15.687579 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d8486-ffa4-460d-9e2b-806867a9ccff None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:15.689191 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 368/722] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:15.694489 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8045e5-6ff1-4dbf-92f2-9d83b34f5fd2 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:15.695040 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8045e5-6ff1-4dbf-92f2-9d83b34f5fd2 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:15.695515 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8045e5-6ff1-4dbf-92f2-9d83b34f5fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:15.727922 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-ce8045e5-6ff1-4dbf-92f2-9d83b34f5fd2 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:15.729475 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ce8045e5-6ff1-4dbf-92f2-9d83b34f5fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:15.759637 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbbdfc-3e2d-45c3-8745-0ec9e553914c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:15.829107 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079a4f2-2227-4a41-8d28-ff398c14e311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:15.830999 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079a4f2-2227-4a41-8d28-ff398c14e311 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:15.832920 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079a4f2-2227-4a41-8d28-ff398c14e311 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:15.833461 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079a4f2-2227-4a41-8d28-ff398c14e311 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:15.855240 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079a4f2-2227-4a41-8d28-ff398c14e311 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:42:15.860716 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-6079a4f2-2227-4a41-8d28-ff398c14e311 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:42:15.860716 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:15.860716 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:15.860716 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:15.860716 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:15.860716 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:15.860716 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:15.860716 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:15.860716 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:15.860716 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:15.860716 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:15.860716 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:15.860716 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:42:15.860716 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:42:15.860716 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:42:15.860716 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:42:15.861691 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:42:15.861691 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:42:15.861691 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:42:15.861691 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:42:15.861691 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:15.861691 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:15.861691 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:15.861691 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:15.861691 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:15.861691 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:15.861691 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:15.861691 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:15.861691 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:15.861691 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:15.861691 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:15.861691 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:15.862581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:15.862581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:15.862581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:15.862581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:15.862581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:42:15.862581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:42:15.862581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:42:15.862581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:42:15.862581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:42:15.862581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:42:15.862581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:42:15.862581 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:15.868271 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 369/723] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:42:15.873832 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 355/724] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:42:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:15.875512 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8045e5-6ff1-4dbf-92f2-9d83b34f5fd2 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:15.945562 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:15.999936 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8045e5-6ff1-4dbf-92f2-9d83b34f5fd2 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:16.048471 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bbc13-df33-4a49-9d1d-a9216a93defd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:16.049090 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bbc13-df33-4a49-9d1d-a9216a93defd None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:16.049370 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bbc13-df33-4a49-9d1d-a9216a93defd None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:16.049640 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bbc13-df33-4a49-9d1d-a9216a93defd None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:16.050336 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bbc13-df33-4a49-9d1d-a9216a93defd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:16.050640 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bbc13-df33-4a49-9d1d-a9216a93defd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:16.052016 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bbc13-df33-4a49-9d1d-a9216a93defd None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:16.065729 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 370/725] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:42:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:42:16.071706 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079a4f2-2227-4a41-8d28-ff398c14e311 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:16.184332 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:16.191571 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079a4f2-2227-4a41-8d28-ff398c14e311 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:16.235881 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541df38-646c-4e7b-8333-e91d4471a0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:16.237343 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541df38-646c-4e7b-8333-e91d4471a0b9 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:16.237821 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541df38-646c-4e7b-8333-e91d4471a0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:16.238327 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541df38-646c-4e7b-8333-e91d4471a0b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:16.243740 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bbc13-df33-4a49-9d1d-a9216a93defd None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:16.253650 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541df38-646c-4e7b-8333-e91d4471a0b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:16.255517 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541df38-646c-4e7b-8333-e91d4471a0b9 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:16.279304 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-4541df38-646c-4e7b-8333-e91d4471a0b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:16.279304 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:16.279304 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:16.279304 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:16.279304 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:16.279304 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:16.279304 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:16.279304 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:16.279304 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:16.279304 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:16.279304 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:16.279304 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:16.279304 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:16.279304 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:16.279304 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:16.279304 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:16.280443 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:16.280443 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:16.280443 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:16.280443 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:16.280443 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:16.280443 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:16.280443 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:16.280443 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:16.280443 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:16.280443 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:16.280443 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:16.280443 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:16.280443 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:16.280443 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:16.280443 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:16.280443 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:16.280443 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:16.281336 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:16.281336 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:16.281336 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:16.282880 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 356/726] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:16.289022 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541df38-646c-4e7b-8333-e91d4471a0b9 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:16.434522 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541df38-646c-4e7b-8333-e91d4471a0b9 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:16.438264 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bbc13-df33-4a49-9d1d-a9216a93defd None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:16.475705 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63440893-0f1b-4952-a167-e0d081703ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:16.478634 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63440893-0f1b-4952-a167-e0d081703ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:16.479751 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63440893-0f1b-4952-a167-e0d081703ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:16.481693 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63440893-0f1b-4952-a167-e0d081703ed3 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:16.484862 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63440893-0f1b-4952-a167-e0d081703ed3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:16.485405 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63440893-0f1b-4952-a167-e0d081703ed3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:16.487087 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63440893-0f1b-4952-a167-e0d081703ed3 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:16.498316 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:16.510112 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 357/727] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:42:16.512169 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63440893-0f1b-4952-a167-e0d081703ed3 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:16.517824 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bed1b4-10c3-4bab-828d-fea03e1eac25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:16.519752 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bed1b4-10c3-4bab-828d-fea03e1eac25 None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:16.520252 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bed1b4-10c3-4bab-828d-fea03e1eac25 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:16.520747 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bed1b4-10c3-4bab-828d-fea03e1eac25 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:16.527734 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bed1b4-10c3-4bab-828d-fea03e1eac25 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:16.529643 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bed1b4-10c3-4bab-828d-fea03e1eac25 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:16.537539 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:16.566842 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 371/728] 10.222.0.52 () {60 vars in 1141 bytes} [Sun Aug 28 00:42:16 2022] POST /identity/v3/services => generated 251 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:42:16.652588 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436137d-c2fc-419b-be5d-3a91c0552799 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:16.653231 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436137d-c2fc-419b-be5d-3a91c0552799 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:16.653733 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436137d-c2fc-419b-be5d-3a91c0552799 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:16.655897 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 372/729] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:42:16.657145 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63440893-0f1b-4952-a167-e0d081703ed3 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:16.664707 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb93bdf-23ea-4faf-aa78-80f91f788cb4 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:16.665346 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb93bdf-23ea-4faf-aa78-80f91f788cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:16.665824 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb93bdf-23ea-4faf-aa78-80f91f788cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:16.688524 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-9bb93bdf-23ea-4faf-aa78-80f91f788cb4 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:16.690998 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9bb93bdf-23ea-4faf-aa78-80f91f788cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:16.740011 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ae96d-fb41-4510-9b0a-0046b1488e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:16.742483 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ae96d-fb41-4510-9b0a-0046b1488e25 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:16.743912 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ae96d-fb41-4510-9b0a-0046b1488e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:16.745080 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ae96d-fb41-4510-9b0a-0046b1488e25 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:16.761677 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ae96d-fb41-4510-9b0a-0046b1488e25 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:16.763539 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ae96d-fb41-4510-9b0a-0046b1488e25 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:16.777532 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-9f0ae96d-fb41-4510-9b0a-0046b1488e25 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:42:16.777532 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:16.777532 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:16.777532 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:16.777532 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:16.777532 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:16.777532 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:16.777532 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:16.777532 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:16.777532 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:16.777532 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:16.777532 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:16.777532 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:42:16.777532 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:42:16.777532 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:42:16.777532 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:42:16.778542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:16.778542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:16.778542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:42:16.778542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:16.778542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:42:16.778542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:16.778542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:16.778542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:16.778542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:16.778542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:16.778542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:16.778542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:16.778542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:16.778542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:16.778542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:16.778542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:16.778542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:16.778542 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:16.779569 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:16.779569 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:16.779569 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:42:16.779569 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:42:16.779569 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:42:16.779569 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:42:16.779569 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:42:16.779569 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:42:16.779569 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:42:16.779569 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:16.782159 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 358/730] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:42:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:16.783664 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47d2c3-595b-48b4-82f3-fee71f235ea3 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:16.784169 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47d2c3-595b-48b4-82f3-fee71f235ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:16.784635 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47d2c3-595b-48b4-82f3-fee71f235ea3 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:16.786501 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 359/731] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:16.787470 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47d2c3-595b-48b4-82f3-fee71f235ea3 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:16.798241 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 373/732] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:42:16.799324 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7899f6-36f7-4f4a-9a6f-32e2aa539053 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:16.799612 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7899f6-36f7-4f4a-9a6f-32e2aa539053 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:16.799944 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7899f6-36f7-4f4a-9a6f-32e2aa539053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:16.849727 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-be7899f6-36f7-4f4a-9a6f-32e2aa539053 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:16.851083 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-be7899f6-36f7-4f4a-9a6f-32e2aa539053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:16.864797 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:16.909518 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47d2c3-595b-48b4-82f3-fee71f235ea3 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:16.963232 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac422c-88f8-4b8a-8321-474f7e95eb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:16.965457 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac422c-88f8-4b8a-8321-474f7e95eb24 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:16.967076 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac422c-88f8-4b8a-8321-474f7e95eb24 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:16.967555 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac422c-88f8-4b8a-8321-474f7e95eb24 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:16.970620 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac422c-88f8-4b8a-8321-474f7e95eb24 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:16.972203 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac422c-88f8-4b8a-8321-474f7e95eb24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:16.974845 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac422c-88f8-4b8a-8321-474f7e95eb24 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:17.006854 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 374/733] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:42:17.010936 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 360/734] 10.222.0.52 () {56 vars in 1135 bytes} [Sun Aug 28 00:42:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:17.018946 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7899f6-36f7-4f4a-9a6f-32e2aa539053 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:17.079425 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:17.119190 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac422c-88f8-4b8a-8321-474f7e95eb24 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:17.158291 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7899f6-36f7-4f4a-9a6f-32e2aa539053 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:17.212621 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87fab2-4cb6-4f4b-a15a-a6736dce84d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:17.213293 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87fab2-4cb6-4f4b-a15a-a6736dce84d1 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:17.213514 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87fab2-4cb6-4f4b-a15a-a6736dce84d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:17.213786 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87fab2-4cb6-4f4b-a15a-a6736dce84d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:17.322853 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87fab2-4cb6-4f4b-a15a-a6736dce84d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:17.324323 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87fab2-4cb6-4f4b-a15a-a6736dce84d1 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:17.330555 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac422c-88f8-4b8a-8321-474f7e95eb24 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:17.356873 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:17.374436 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e722f-23b9-422d-a487-1154c574ce4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:17.375322 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e722f-23b9-422d-a487-1154c574ce4a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:17.376010 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e722f-23b9-422d-a487-1154c574ce4a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:17.376287 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e722f-23b9-422d-a487-1154c574ce4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:17.389976 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e722f-23b9-422d-a487-1154c574ce4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:42:17.393552 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:17.397762 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-de5e722f-23b9-422d-a487-1154c574ce4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:42:17.397762 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:17.397762 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:17.397762 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:17.397762 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:17.397762 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:17.397762 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:17.397762 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:17.397762 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:17.397762 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:17.397762 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:17.397762 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:17.397762 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:42:17.397762 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:42:17.397762 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:42:17.397762 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:42:17.398940 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:42:17.398940 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:42:17.398940 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:42:17.398940 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:42:17.398940 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:17.398940 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:17.398940 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:17.398940 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:17.398940 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:17.398940 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:17.398940 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:17.398940 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:17.398940 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:17.398940 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:17.398940 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:17.398940 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:17.399788 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:17.399788 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:17.399788 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:17.399788 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:17.399788 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:42:17.399788 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:42:17.399788 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:42:17.399788 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:42:17.399788 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:42:17.399788 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:42:17.399788 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:42:17.399788 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:17.401999 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 361/735] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:42:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:17.402892 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e722f-23b9-422d-a487-1154c574ce4a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:17.470819 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 375/736] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:42:17 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:42:17.471674 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87fab2-4cb6-4f4b-a15a-a6736dce84d1 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:17.526731 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e722f-23b9-422d-a487-1154c574ce4a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:17.567494 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b5fde-a0d3-4b25-8e7a-7a3686be3865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:17.568141 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b5fde-a0d3-4b25-8e7a-7a3686be3865 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:17.568411 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b5fde-a0d3-4b25-8e7a-7a3686be3865 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:17.568673 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b5fde-a0d3-4b25-8e7a-7a3686be3865 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:17.579083 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b5fde-a0d3-4b25-8e7a-7a3686be3865 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:42:17.580075 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87fab2-4cb6-4f4b-a15a-a6736dce84d1 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:17.583806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-769b5fde-a0d3-4b25-8e7a-7a3686be3865 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:42:17.583806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:17.583806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:17.583806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:17.583806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:17.583806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:17.583806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:17.583806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:17.583806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:17.583806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:17.583806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:17.583806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:17.583806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:42:17.583806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:42:17.583806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:42:17.583806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:42:17.584752 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:42:17.584752 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:42:17.584752 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:42:17.584752 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:42:17.584752 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:17.584752 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:17.584752 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:17.584752 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:17.584752 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:17.584752 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:17.584752 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:17.584752 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:17.584752 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:17.584752 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:17.584752 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:17.584752 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:17.586224 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:17.586224 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:17.586224 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:17.586224 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:17.586224 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:42:17.586224 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:42:17.586224 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:42:17.586224 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:42:17.586224 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:42:17.586224 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:42:17.586224 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:42:17.586224 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:17.586224 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 362/737] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Aug 28 00:42:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:17.586224 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b5fde-a0d3-4b25-8e7a-7a3686be3865 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:17.623815 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073ba33-6d5d-42e4-9d9a-e849c248b25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:17.623815 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073ba33-6d5d-42e4-9d9a-e849c248b25e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:17.624197 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073ba33-6d5d-42e4-9d9a-e849c248b25e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:17.624420 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073ba33-6d5d-42e4-9d9a-e849c248b25e None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:17.625018 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073ba33-6d5d-42e4-9d9a-e849c248b25e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:17.625321 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073ba33-6d5d-42e4-9d9a-e849c248b25e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:17.626789 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073ba33-6d5d-42e4-9d9a-e849c248b25e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:17.634320 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:17.635744 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 376/738] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:42:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:17.637018 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849bed4-13e9-48cf-a753-d831ed1105b9 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:17.637363 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849bed4-13e9-48cf-a753-d831ed1105b9 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:17.637640 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849bed4-13e9-48cf-a753-d831ed1105b9 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:17.641976 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 377/739] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:17.641976 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849bed4-13e9-48cf-a753-d831ed1105b9 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:17.647629 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:17.701986 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b5fde-a0d3-4b25-8e7a-7a3686be3865 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:17.738835 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9a3ee-1e8e-4c43-b689-71dd91c76b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:17.739381 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9a3ee-1e8e-4c43-b689-71dd91c76b34 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:17.739662 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9a3ee-1e8e-4c43-b689-71dd91c76b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:17.739928 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9a3ee-1e8e-4c43-b689-71dd91c76b34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:17.750732 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9a3ee-1e8e-4c43-b689-71dd91c76b34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:17.752204 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9a3ee-1e8e-4c43-b689-71dd91c76b34 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:17.754058 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849bed4-13e9-48cf-a753-d831ed1105b9 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:17.767580 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-99c9a3ee-1e8e-4c43-b689-71dd91c76b34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:17.767580 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:17.767580 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:17.767580 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:17.767580 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:17.767580 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:17.767580 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:17.767580 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:17.767580 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:17.767580 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:17.767580 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:17.767580 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:17.767580 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:17.767580 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:17.767580 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:17.767580 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:17.768783 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:17.768783 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:17.768783 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:17.768783 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:17.768783 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:17.768783 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:17.768783 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:17.768783 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:17.768783 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:17.768783 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:17.768783 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:17.768783 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:17.768783 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:17.768783 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:17.768783 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:17.768783 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:17.768783 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:17.769743 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:17.769743 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:17.769743 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:17.769743 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 363/740] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:17.770021 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9a3ee-1e8e-4c43-b689-71dd91c76b34 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:17.800239 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2008b6-b395-4d04-b5b1-9601fc48f66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:17.800844 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2008b6-b395-4d04-b5b1-9601fc48f66f None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:17.801122 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2008b6-b395-4d04-b5b1-9601fc48f66f None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:17.801591 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2008b6-b395-4d04-b5b1-9601fc48f66f None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:17.802069 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2008b6-b395-4d04-b5b1-9601fc48f66f None admin] RBAC: Adding query filter params (name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:17.802371 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2008b6-b395-4d04-b5b1-9601fc48f66f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:17.803823 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2008b6-b395-4d04-b5b1-9601fc48f66f None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:17.813550 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 378/741] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Aug 28 00:42:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:17.819359 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464aae1c-10ad-4468-9948-7bf578c5b623 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:17.819647 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464aae1c-10ad-4468-9948-7bf578c5b623 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:17.819940 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464aae1c-10ad-4468-9948-7bf578c5b623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:17.838825 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-464aae1c-10ad-4468-9948-7bf578c5b623 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:17.840074 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-464aae1c-10ad-4468-9948-7bf578c5b623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:17.873411 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:17.882132 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9a3ee-1e8e-4c43-b689-71dd91c76b34 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:17.906630 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:17.914326 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 379/742] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:42:17.914975 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464aae1c-10ad-4468-9948-7bf578c5b623 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:17.928372 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eee017-a91e-4697-8c42-15fa1889ccda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:17.929315 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eee017-a91e-4697-8c42-15fa1889ccda None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:17.930090 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eee017-a91e-4697-8c42-15fa1889ccda None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:17.931014 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eee017-a91e-4697-8c42-15fa1889ccda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:17.947122 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eee017-a91e-4697-8c42-15fa1889ccda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:17.949127 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eee017-a91e-4697-8c42-15fa1889ccda None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:17.968511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-15eee017-a91e-4697-8c42-15fa1889ccda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:17.968511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:17.968511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:17.968511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:17.968511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:17.968511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:17.968511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:17.968511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:17.968511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:17.968511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:17.968511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:17.968511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:17.968511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:17.968511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:17.968511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:17.968511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:17.969489 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:17.969489 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:17.969489 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:17.969489 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:17.969489 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:17.969489 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:17.969489 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:17.969489 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:17.969489 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:17.969489 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:17.969489 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:17.969489 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:17.969489 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:17.969489 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:17.969489 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:17.969489 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:17.969489 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:17.971048 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:17.971048 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:17.971048 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:17.974626 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 364/743] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:17.975463 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eee017-a91e-4697-8c42-15fa1889ccda None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:18.036522 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464aae1c-10ad-4468-9948-7bf578c5b623 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:18.075315 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76a118-9642-43ca-b890-e5fb6cb7698f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:18.075999 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76a118-9642-43ca-b890-e5fb6cb7698f None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:18.076339 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76a118-9642-43ca-b890-e5fb6cb7698f None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:18.076610 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76a118-9642-43ca-b890-e5fb6cb7698f None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:18.077260 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76a118-9642-43ca-b890-e5fb6cb7698f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:18.077560 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76a118-9642-43ca-b890-e5fb6cb7698f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:18.078970 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76a118-9642-43ca-b890-e5fb6cb7698f None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:18.094103 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eee017-a91e-4697-8c42-15fa1889ccda None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:18.095924 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 380/744] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:18.096834 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76a118-9642-43ca-b890-e5fb6cb7698f None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:18.139021 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5edec-9215-4f6d-a1a6-9afbfeeb5ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:18.139800 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5edec-9215-4f6d-a1a6-9afbfeeb5ede None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:18.140078 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5edec-9215-4f6d-a1a6-9afbfeeb5ede None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:18.140349 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5edec-9215-4f6d-a1a6-9afbfeeb5ede None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:18.151505 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af5edec-9215-4f6d-a1a6-9afbfeeb5ede None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:18.153045 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af5edec-9215-4f6d-a1a6-9afbfeeb5ede None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:18.160675 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:18.165512 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:18.171187 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-4af5edec-9215-4f6d-a1a6-9afbfeeb5ede None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:18.171187 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:18.171187 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:18.171187 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:18.171187 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:18.171187 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:18.171187 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:18.171187 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:18.171187 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:18.171187 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:18.171187 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:18.171187 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:18.171187 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:18.171187 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:18.171187 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:18.171187 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:18.172345 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:18.172345 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:18.172345 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:18.172345 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:18.172345 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:18.172345 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:18.172345 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:18.172345 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:18.172345 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:18.172345 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:18.172345 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:18.172345 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:18.172345 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:18.172345 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:18.172345 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:18.172345 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:18.172345 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:18.173440 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:18.173440 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:18.173440 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:18.180340 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 365/745] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:18.180340 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5edec-9215-4f6d-a1a6-9afbfeeb5ede None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:18.227270 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76a118-9642-43ca-b890-e5fb6cb7698f None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:18.262918 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919c3c7-1c3f-4573-b191-ffb650637f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:18.263528 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919c3c7-1c3f-4573-b191-ffb650637f64 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:18.263839 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919c3c7-1c3f-4573-b191-ffb650637f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:18.264111 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919c3c7-1c3f-4573-b191-ffb650637f64 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:18.264775 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919c3c7-1c3f-4573-b191-ffb650637f64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:18.265055 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919c3c7-1c3f-4573-b191-ffb650637f64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:18.266487 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919c3c7-1c3f-4573-b191-ffb650637f64 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:18.285064 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 381/746] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:18.285064 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919c3c7-1c3f-4573-b191-ffb650637f64 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:18.294404 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5edec-9215-4f6d-a1a6-9afbfeeb5ede None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:18.329509 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f429d3-0c4c-481f-bc78-8d3c5c12c2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:18.330187 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f429d3-0c4c-481f-bc78-8d3c5c12c2a6 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:18.330464 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f429d3-0c4c-481f-bc78-8d3c5c12c2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:18.330735 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f429d3-0c4c-481f-bc78-8d3c5c12c2a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:18.339721 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f429d3-0c4c-481f-bc78-8d3c5c12c2a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:18.341460 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f429d3-0c4c-481f-bc78-8d3c5c12c2a6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:18.355238 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-b9f429d3-0c4c-481f-bc78-8d3c5c12c2a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:18.355238 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:18.355238 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:18.355238 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:18.355238 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:18.355238 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:18.355238 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:18.355238 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:18.355238 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:18.355238 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:18.355238 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:18.355238 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:18.355238 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:42:18.355238 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:42:18.355238 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:42:18.356206 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:42:18.356206 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:18.356206 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:18.356206 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:18.356206 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:18.356206 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:18.356206 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:18.356206 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:18.356206 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:18.356206 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:18.356206 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:18.356206 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:18.356206 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:18.356206 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:18.356206 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:18.356206 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:18.356206 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:18.357145 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:42:18.357145 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:42:18.357145 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:42:18.357145 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:42:18.357145 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:42:18.357145 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:42:18.357145 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:18.357145 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:18.357145 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 366/747] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:42:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:18.357145 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f429d3-0c4c-481f-bc78-8d3c5c12c2a6 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:18.407088 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919c3c7-1c3f-4573-b191-ffb650637f64 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:18.421025 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:18.427701 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:18.447613 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c463477-be2b-442d-bef2-f4aac3ce514b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:18.448224 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c463477-be2b-442d-bef2-f4aac3ce514b None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:18.448508 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c463477-be2b-442d-bef2-f4aac3ce514b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:18.448776 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c463477-be2b-442d-bef2-f4aac3ce514b None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:18.449423 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c463477-be2b-442d-bef2-f4aac3ce514b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:18.449726 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c463477-be2b-442d-bef2-f4aac3ce514b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:18.451137 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c463477-be2b-442d-bef2-f4aac3ce514b None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:18.463609 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 382/748] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:18.464427 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c463477-be2b-442d-bef2-f4aac3ce514b None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:18.465965 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f429d3-0c4c-481f-bc78-8d3c5c12c2a6 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:18.501932 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad07bb5-01ee-4310-8ad5-0a26cdd00637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:18.502897 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad07bb5-01ee-4310-8ad5-0a26cdd00637 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:18.503386 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad07bb5-01ee-4310-8ad5-0a26cdd00637 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:18.503871 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad07bb5-01ee-4310-8ad5-0a26cdd00637 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:18.504727 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad07bb5-01ee-4310-8ad5-0a26cdd00637 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:18.506331 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad07bb5-01ee-4310-8ad5-0a26cdd00637 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:18.525992 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 367/749] 10.222.0.52 () {60 vars in 1141 bytes} [Sun Aug 28 00:42:18 2022] POST /identity/v3/services => generated 240 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:42:18.527211 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad07bb5-01ee-4310-8ad5-0a26cdd00637 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:18.597811 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c463477-be2b-442d-bef2-f4aac3ce514b None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:18.658335 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959aa85-56a2-4960-9552-bc8bb63623bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:18.659029 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959aa85-56a2-4960-9552-bc8bb63623bb None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:18.659236 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959aa85-56a2-4960-9552-bc8bb63623bb None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:18.659504 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959aa85-56a2-4960-9552-bc8bb63623bb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:18.668186 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959aa85-56a2-4960-9552-bc8bb63623bb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:18.668895 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad07bb5-01ee-4310-8ad5-0a26cdd00637 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:18.669723 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959aa85-56a2-4960-9552-bc8bb63623bb None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:18.682457 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-7959aa85-56a2-4960-9552-bc8bb63623bb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:42:18.682457 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:18.682457 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:18.682457 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:18.682457 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:18.682457 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:18.682457 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:18.682457 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:18.682457 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:18.682457 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:18.682457 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:18.682457 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:18.682457 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:42:18.682457 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:42:18.682457 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:42:18.682457 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:42:18.683468 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:18.683468 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:18.683468 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:42:18.683468 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:18.683468 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:42:18.683468 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:18.683468 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:18.683468 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:18.683468 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:18.683468 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:18.683468 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:18.683468 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:18.683468 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:18.683468 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:18.683468 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:18.683468 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:18.683468 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:18.683468 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:18.684403 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:18.684403 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:18.684403 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:42:18.684403 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:42:18.684403 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:42:18.684403 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:42:18.684403 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:42:18.684403 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:42:18.684403 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:42:18.684403 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:18.684403 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 383/750] 10.222.0.52 () {56 vars in 1093 bytes} [Sun Aug 28 00:42:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:18.684403 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959aa85-56a2-4960-9552-bc8bb63623bb None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:18.696933 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:18.716651 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73206d-469f-4152-8b27-0191cf8cf013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:18.716993 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73206d-469f-4152-8b27-0191cf8cf013 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:18.717256 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73206d-469f-4152-8b27-0191cf8cf013 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:18.717533 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73206d-469f-4152-8b27-0191cf8cf013 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:18.718264 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e73206d-469f-4152-8b27-0191cf8cf013 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:18.718571 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e73206d-469f-4152-8b27-0191cf8cf013 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:18.720367 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e73206d-469f-4152-8b27-0191cf8cf013 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:18.723701 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:18.734422 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 368/751] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:42:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:18.736050 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a72139-fcb9-4168-92bf-e6f75b3231df None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:18.736528 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a72139-fcb9-4168-92bf-e6f75b3231df None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:18.737040 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a72139-fcb9-4168-92bf-e6f75b3231df None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:18.738444 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 369/752] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:18.739303 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a72139-fcb9-4168-92bf-e6f75b3231df None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:18.799995 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959aa85-56a2-4960-9552-bc8bb63623bb None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:18.842839 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71a063-fa73-46c6-b9eb-b830bf005b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:18.843519 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71a063-fa73-46c6-b9eb-b830bf005b70 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:18.843774 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71a063-fa73-46c6-b9eb-b830bf005b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:18.844068 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71a063-fa73-46c6-b9eb-b830bf005b70 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:18.852668 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf71a063-fa73-46c6-b9eb-b830bf005b70 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:18.853590 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a72139-fcb9-4168-92bf-e6f75b3231df None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:18.854097 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf71a063-fa73-46c6-b9eb-b830bf005b70 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:18.867719 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-cf71a063-fa73-46c6-b9eb-b830bf005b70 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:42:18.867719 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:18.867719 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:18.867719 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:18.867719 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:18.867719 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:18.867719 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:18.867719 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:18.867719 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:18.867719 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:18.867719 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:18.867719 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:18.867719 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:42:18.867719 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:42:18.867719 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:42:18.867719 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:42:18.868889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:18.868889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:18.868889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:42:18.868889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:18.868889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:42:18.868889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:18.868889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:18.868889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:18.868889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:18.868889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:18.868889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:18.868889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:18.868889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:18.868889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:18.868889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:18.868889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:18.868889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:18.868889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:18.870078 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:18.870078 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:18.870078 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:42:18.870078 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:42:18.870078 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:42:18.870078 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:42:18.870078 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:42:18.870078 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:42:18.870078 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:42:18.870078 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:18.879745 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 384/753] 10.222.0.52 () {56 vars in 1117 bytes} [Sun Aug 28 00:42:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:18.879745 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71a063-fa73-46c6-b9eb-b830bf005b70 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:18.896930 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09c4b2-028f-44ca-b3aa-7490477969ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:18.897767 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09c4b2-028f-44ca-b3aa-7490477969ba None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:18.898245 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09c4b2-028f-44ca-b3aa-7490477969ba None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:18.898663 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09c4b2-028f-44ca-b3aa-7490477969ba None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:18.899579 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09c4b2-028f-44ca-b3aa-7490477969ba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:18.899942 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09c4b2-028f-44ca-b3aa-7490477969ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:18.901564 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09c4b2-028f-44ca-b3aa-7490477969ba None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:18.924989 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 370/754] 10.222.0.52 () {56 vars in 1133 bytes} [Sun Aug 28 00:42:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:18.924989 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f61a8-bd4a-4706-a1ac-26e6f776d0b5 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:18.924989 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f61a8-bd4a-4706-a1ac-26e6f776d0b5 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:18.924989 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f61a8-bd4a-4706-a1ac-26e6f776d0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:18.941388 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-869f61a8-bd4a-4706-a1ac-26e6f776d0b5 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:18.942666 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-869f61a8-bd4a-4706-a1ac-26e6f776d0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:18.975428 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:18.980864 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:18.991265 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71a063-fa73-46c6-b9eb-b830bf005b70 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:19.020024 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 371/755] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:42:19.021224 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f61a8-bd4a-4706-a1ac-26e6f776d0b5 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:19.035966 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd967e-859d-4f27-b37a-435f8e4d2664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:19.036876 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd967e-859d-4f27-b37a-435f8e4d2664 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:19.037213 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd967e-859d-4f27-b37a-435f8e4d2664 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:19.037536 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd967e-859d-4f27-b37a-435f8e4d2664 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:19.038807 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd967e-859d-4f27-b37a-435f8e4d2664 None admin] RBAC: Adding query filter params (role.id=cc013581bb07418d9ec6a3a1d282ea53, scope.project.id=45c69e3e973c449895457bb610103a43, user.id=a80a6019cf424c16a1d461a632cf8568) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:19.039114 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd967e-859d-4f27-b37a-435f8e4d2664 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:19.041126 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd967e-859d-4f27-b37a-435f8e4d2664 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:19.049998 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 385/756] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:42:18 2022] GET /identity/v3/role_assignments?user.id=a80a6019cf424c16a1d461a632cf8568&scope.project.id=45c69e3e973c449895457bb610103a43&role.id=cc013581bb07418d9ec6a3a1d282ea53 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:19.051195 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd967e-859d-4f27-b37a-435f8e4d2664 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:19.207593 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f61a8-bd4a-4706-a1ac-26e6f776d0b5 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:19.272445 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd967e-859d-4f27-b37a-435f8e4d2664 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:19.278405 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65e302-e1e4-4ebe-a547-92a7a61f8d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:19.278807 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65e302-e1e4-4ebe-a547-92a7a61f8d6b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:19.279080 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65e302-e1e4-4ebe-a547-92a7a61f8d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:19.279381 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65e302-e1e4-4ebe-a547-92a7a61f8d6b None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:19.280221 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65e302-e1e4-4ebe-a547-92a7a61f8d6b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:19.280530 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65e302-e1e4-4ebe-a547-92a7a61f8d6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:19.286072 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65e302-e1e4-4ebe-a547-92a7a61f8d6b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:19.309590 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 372/757] 10.222.0.52 () {56 vars in 1149 bytes} [Sun Aug 28 00:42:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:19.310469 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65e302-e1e4-4ebe-a547-92a7a61f8d6b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:19.335039 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac3359-965e-4f10-8b4d-f4af4924d9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:19.335675 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac3359-965e-4f10-8b4d-f4af4924d9ae None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:19.335947 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac3359-965e-4f10-8b4d-f4af4924d9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:19.336221 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac3359-965e-4f10-8b4d-f4af4924d9ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:19.341090 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:19.350620 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac3359-965e-4f10-8b4d-f4af4924d9ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:19.352262 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac3359-965e-4f10-8b4d-f4af4924d9ae None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:19.370162 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-2aac3359-965e-4f10-8b4d-f4af4924d9ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:19.370162 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:19.370162 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:19.370162 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:19.370162 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:19.370162 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:19.370162 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:19.370162 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:19.370162 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:19.370162 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:19.370162 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:19.370162 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:19.370162 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:19.370162 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:19.370162 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:19.370162 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:19.371157 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:19.371157 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:19.371157 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:19.371157 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:19.371157 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:19.371157 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:19.371157 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:19.371157 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:19.371157 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:19.371157 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:19.371157 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:19.371157 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:19.371157 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:19.371157 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:19.371157 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:19.371157 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:19.371157 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:19.373292 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:19.373292 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:19.373292 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:19.373292 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 386/758] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:19.375916 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac3359-965e-4f10-8b4d-f4af4924d9ae None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:19.392198 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:19.428824 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65e302-e1e4-4ebe-a547-92a7a61f8d6b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:19.477263 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f0e37-97ca-4bef-9b5c-7a85a2ce2bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:19.478088 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f0e37-97ca-4bef-9b5c-7a85a2ce2bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:19.478368 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f0e37-97ca-4bef-9b5c-7a85a2ce2bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:19.478638 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f0e37-97ca-4bef-9b5c-7a85a2ce2bb2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:19.479228 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f0e37-97ca-4bef-9b5c-7a85a2ce2bb2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:19.481259 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f0e37-97ca-4bef-9b5c-7a85a2ce2bb2 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:19.495851 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac3359-965e-4f10-8b4d-f4af4924d9ae None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:19.496013 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-8f1f0e37-97ca-4bef-9b5c-7a85a2ce2bb2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:42:19.496013 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:19.496013 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:42:19.496013 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:42:19.496013 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:42:19.496013 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:42:19.496013 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:42:19.496013 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:19.496013 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:42:19.496013 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:19.496013 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:42:19.496013 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:19.496013 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:19.496013 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:19.496013 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:19.496013 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:19.496013 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:19.496970 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:19.496970 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:19.496970 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:19.496970 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:19.496970 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:19.496970 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:19.496970 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:42:19.496970 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:42:19.496970 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:42:19.496970 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:42:19.496970 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:19.496970 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:19.496970 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:19.496970 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:19.496970 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:19.496970 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:19.497806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:19.497806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:19.497806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:19.497806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:19.497806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:19.497806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:19.497806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:19.497806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:19.497806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:19.497806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:19.497806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:42:19.497806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:19.497806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:42:19.497806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:19.502339 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 373/759] 10.222.0.52 () {56 vars in 1129 bytes} [Sun Aug 28 00:42:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:19.504194 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f0e37-97ca-4bef-9b5c-7a85a2ce2bb2 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:19.543286 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2bdd46-eba0-4715-9dd7-b95c3e2cff9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:19.544797 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bdd46-eba0-4715-9dd7-b95c3e2cff9a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:19.545369 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bdd46-eba0-4715-9dd7-b95c3e2cff9a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:19.545987 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bdd46-eba0-4715-9dd7-b95c3e2cff9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:19.616211 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:19.629397 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f0e37-97ca-4bef-9b5c-7a85a2ce2bb2 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:19.637823 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2bdd46-eba0-4715-9dd7-b95c3e2cff9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:19.639894 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2bdd46-eba0-4715-9dd7-b95c3e2cff9a None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:19.651533 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:19.666047 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2f364-eb17-4cdd-9abe-ab86d4bb7d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:19.666750 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2f364-eb17-4cdd-9abe-ab86d4bb7d74 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:19.667125 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2f364-eb17-4cdd-9abe-ab86d4bb7d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:19.667441 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2f364-eb17-4cdd-9abe-ab86d4bb7d74 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:19.668297 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2f364-eb17-4cdd-9abe-ab86d4bb7d74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:19.668429 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2f364-eb17-4cdd-9abe-ab86d4bb7d74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:19.670261 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2f364-eb17-4cdd-9abe-ab86d4bb7d74 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:19.687273 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 374/760] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:19.688264 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2f364-eb17-4cdd-9abe-ab86d4bb7d74 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:19.756290 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 387/761] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:42:19 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:42:19.757457 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2bdd46-eba0-4715-9dd7-b95c3e2cff9a None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:19.793631 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2f364-eb17-4cdd-9abe-ab86d4bb7d74 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:19.828186 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2eebe-da4e-4319-a750-9d9030231274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:19.828690 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2eebe-da4e-4319-a750-9d9030231274 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:19.829033 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2eebe-da4e-4319-a750-9d9030231274 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:19.829370 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2eebe-da4e-4319-a750-9d9030231274 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:19.830097 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2eebe-da4e-4319-a750-9d9030231274 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:19.830458 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2eebe-da4e-4319-a750-9d9030231274 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:19.831923 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2eebe-da4e-4319-a750-9d9030231274 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:19.836597 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 375/762] 10.222.0.52 () {56 vars in 1124 bytes} [Sun Aug 28 00:42:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:19.841690 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2eebe-da4e-4319-a750-9d9030231274 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:19.856504 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:19.868422 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2bdd46-eba0-4715-9dd7-b95c3e2cff9a None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:19.879643 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:19.908094 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699317f-050f-41c2-873b-d0b12f341b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:19.909111 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699317f-050f-41c2-873b-d0b12f341b45 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:19.909564 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699317f-050f-41c2-873b-d0b12f341b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:19.910031 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699317f-050f-41c2-873b-d0b12f341b45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:19.917722 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699317f-050f-41c2-873b-d0b12f341b45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:19.919646 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699317f-050f-41c2-873b-d0b12f341b45 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:19.932443 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-a699317f-050f-41c2-873b-d0b12f341b45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:19.932443 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:19.932443 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:19.932443 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:19.932443 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:19.932443 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:19.932443 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:19.932443 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:19.932443 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:19.932443 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:19.932443 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:19.932443 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:19.932443 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:42:19.932443 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:42:19.932443 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:42:19.933371 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:42:19.933371 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:19.933371 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:19.933371 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:19.933371 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:19.933371 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:19.933371 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:19.933371 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:19.933371 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:19.933371 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:19.933371 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:19.933371 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:19.933371 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:19.933371 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:19.933371 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:19.933371 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:19.933371 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:19.934295 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:42:19.934295 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:42:19.934295 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:42:19.934295 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:42:19.934295 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:42:19.934295 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:42:19.934295 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:19.934295 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:19.936968 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 388/763] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:42:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:19.937965 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699317f-050f-41c2-873b-d0b12f341b45 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:19.949483 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2eebe-da4e-4319-a750-9d9030231274 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:19.994301 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b94e1-96ff-46da-a8bb-9cf58e1c53f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:19.995413 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b94e1-96ff-46da-a8bb-9cf58e1c53f1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:19.995828 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b94e1-96ff-46da-a8bb-9cf58e1c53f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:19.996234 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b94e1-96ff-46da-a8bb-9cf58e1c53f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:20.010274 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b94e1-96ff-46da-a8bb-9cf58e1c53f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:20.012612 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b94e1-96ff-46da-a8bb-9cf58e1c53f1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:20.031811 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-5c9b94e1-96ff-46da-a8bb-9cf58e1c53f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:20.031811 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:20.031811 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:20.031811 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:20.031811 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:20.031811 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:20.031811 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:20.031811 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:20.031811 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:20.031811 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:20.031811 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:20.031811 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:20.031811 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:20.031811 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:20.031811 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:20.031811 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:20.032977 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:20.032977 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:20.032977 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:20.032977 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:20.032977 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:20.032977 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:20.032977 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:20.032977 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:20.032977 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:20.032977 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:20.032977 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:20.032977 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:20.032977 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:20.032977 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:20.032977 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:20.032977 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:20.032977 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:20.034125 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:20.034125 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:20.034125 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:20.036257 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 376/764] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:20.037452 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b94e1-96ff-46da-a8bb-9cf58e1c53f1 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:20.068100 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699317f-050f-41c2-873b-d0b12f341b45 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:20.113031 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7eeb5-c348-4915-abd4-7e0445b878e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:20.113699 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7eeb5-c348-4915-abd4-7e0445b878e7 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:20.114016 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7eeb5-c348-4915-abd4-7e0445b878e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:20.114385 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7eeb5-c348-4915-abd4-7e0445b878e7 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:20.115126 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7eeb5-c348-4915-abd4-7e0445b878e7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:20.115433 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7eeb5-c348-4915-abd4-7e0445b878e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:20.116875 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7eeb5-c348-4915-abd4-7e0445b878e7 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:20.118127 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:20.123740 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 389/765] 10.222.0.52 () {56 vars in 1124 bytes} [Sun Aug 28 00:42:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:20.124720 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7eeb5-c348-4915-abd4-7e0445b878e7 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:20.162508 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:20.166072 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b94e1-96ff-46da-a8bb-9cf58e1c53f1 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:20.203026 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d8011-b814-4e37-b797-b2a8226b57a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:20.203637 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d8011-b814-4e37-b797-b2a8226b57a5 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:20.203912 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d8011-b814-4e37-b797-b2a8226b57a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:20.204177 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d8011-b814-4e37-b797-b2a8226b57a5 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:20.204979 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d8011-b814-4e37-b797-b2a8226b57a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:20.205284 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d8011-b814-4e37-b797-b2a8226b57a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:20.206838 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d8011-b814-4e37-b797-b2a8226b57a5 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:20.226129 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 377/766] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:42:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:20.227120 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d8011-b814-4e37-b797-b2a8226b57a5 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:20.239886 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7eeb5-c348-4915-abd4-7e0445b878e7 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:20.277301 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff15a1-330d-4f50-82f9-c677f0955556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:20.278098 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff15a1-330d-4f50-82f9-c677f0955556 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:20.278512 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff15a1-330d-4f50-82f9-c677f0955556 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:20.278849 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff15a1-330d-4f50-82f9-c677f0955556 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:20.279728 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff15a1-330d-4f50-82f9-c677f0955556 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:20.280140 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff15a1-330d-4f50-82f9-c677f0955556 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:20.281873 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff15a1-330d-4f50-82f9-c677f0955556 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:20.303363 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 390/767] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:20.304365 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff15a1-330d-4f50-82f9-c677f0955556 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:20.328562 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d8011-b814-4e37-b797-b2a8226b57a5 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:20.353323 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:20.365169 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed33fe-b255-4e23-b1b5-fcba46c94932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:20.365823 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed33fe-b255-4e23-b1b5-fcba46c94932 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:20.366093 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed33fe-b255-4e23-b1b5-fcba46c94932 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:20.366395 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed33fe-b255-4e23-b1b5-fcba46c94932 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:20.367060 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed33fe-b255-4e23-b1b5-fcba46c94932 None admin] RBAC: Adding query filter params (interface=public, service_id=0bf41144cc4c4e37ac8256bd26ba4c6e, region_id=RegionOne) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:20.367362 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed33fe-b255-4e23-b1b5-fcba46c94932 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:20.368908 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed33fe-b255-4e23-b1b5-fcba46c94932 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:20.380942 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 378/768] 10.222.0.52 () {56 vars in 1251 bytes} [Sun Aug 28 00:42:20 2022] GET /identity/v3/endpoints?service_id=0bf41144cc4c4e37ac8256bd26ba4c6e&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:20.381817 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed33fe-b255-4e23-b1b5-fcba46c94932 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:20.429056 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff15a1-330d-4f50-82f9-c677f0955556 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:20.443727 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:20.486828 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed33fe-b255-4e23-b1b5-fcba46c94932 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:20.497572 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f9729-3660-4674-84cf-b01d02e42000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:20.498787 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f9729-3660-4674-84cf-b01d02e42000 None admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:20.499271 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f9729-3660-4674-84cf-b01d02e42000 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:20.499761 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f9729-3660-4674-84cf-b01d02e42000 None admin] PATH_INFO: `/v3/projects/45c69e3e973c449895457bb610103a43/users/f890ff4e7807477db7f17c2f6434dce8/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:20.503243 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f9729-3660-4674-84cf-b01d02e42000 None admin] RBAC: Authorizing `identity:create_grant(project_id=45c69e3e973c449895457bb610103a43, user_id=f890ff4e7807477db7f17c2f6434dce8, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:20.505959 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f9729-3660-4674-84cf-b01d02e42000 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:20.521870 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedc9a0-a7fa-4e17-99cc-406fc6245069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:20.522505 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedc9a0-a7fa-4e17-99cc-406fc6245069 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:20.522793 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedc9a0-a7fa-4e17-99cc-406fc6245069 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:20.523053 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedc9a0-a7fa-4e17-99cc-406fc6245069 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:20.528061 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 391/769] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Aug 28 00:42:20 2022] PUT /identity/v3/projects/45c69e3e973c449895457bb610103a43/users/f890ff4e7807477db7f17c2f6434dce8/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:42:20.529484 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f9729-3660-4674-84cf-b01d02e42000 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:20.550888 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedc9a0-a7fa-4e17-99cc-406fc6245069 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:20.552440 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedc9a0-a7fa-4e17-99cc-406fc6245069 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:20.572574 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-ccedc9a0-a7fa-4e17-99cc-406fc6245069 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:20.572574 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:20.572574 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:20.572574 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:20.572574 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:20.572574 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:20.572574 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:20.572574 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:20.572574 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:20.572574 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:20.572574 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:20.572574 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:20.572574 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:42:20.572574 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:42:20.572574 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:42:20.573544 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:42:20.573544 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:20.573544 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:20.573544 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:20.573544 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:20.573544 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:20.573544 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:20.573544 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:20.573544 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:20.573544 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:20.573544 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:20.573544 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:20.573544 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:20.573544 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:20.573544 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:20.573544 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:20.573544 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:20.574498 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:42:20.574498 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:42:20.574498 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:42:20.574498 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:42:20.574498 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:42:20.574498 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:42:20.574498 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:20.574498 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:20.577045 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 379/770] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:42:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:20.578715 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f11dd4-c92d-4f39-8007-590b83e7c4cc None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:20.579222 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f11dd4-c92d-4f39-8007-590b83e7c4cc None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:20.579694 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f11dd4-c92d-4f39-8007-590b83e7c4cc None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:20.585812 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 380/771] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:20.587598 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3a47b-ba07-441a-9075-bb986cbb5e6f None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:20.588137 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3a47b-ba07-441a-9075-bb986cbb5e6f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:20.588617 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3a47b-ba07-441a-9075-bb986cbb5e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:20.612061 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-67e3a47b-ba07-441a-9075-bb986cbb5e6f None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:20.613586 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-67e3a47b-ba07-441a-9075-bb986cbb5e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:20.676648 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f9729-3660-4674-84cf-b01d02e42000 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:20.677261 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:20.710198 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 381/772] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:42:20.711477 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3a47b-ba07-441a-9075-bb986cbb5e6f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:20.723030 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd8722-0b30-404e-b7f9-d735325362e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:20.724544 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd8722-0b30-404e-b7f9-d735325362e9 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:20.724975 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd8722-0b30-404e-b7f9-d735325362e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:20.725388 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd8722-0b30-404e-b7f9-d735325362e9 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:20.726179 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd8722-0b30-404e-b7f9-d735325362e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:20.727772 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd8722-0b30-404e-b7f9-d735325362e9 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:20.737382 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 392/773] 10.222.0.52 () {56 vars in 1087 bytes} [Sun Aug 28 00:42:20 2022] GET /identity/v3/services => generated 772 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:20.855116 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3a47b-ba07-441a-9075-bb986cbb5e6f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:20.918740 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61149e47-c2d0-45a8-b120-f2dc850e9246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:20.919641 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61149e47-c2d0-45a8-b120-f2dc850e9246 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:20.920222 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61149e47-c2d0-45a8-b120-f2dc850e9246 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:20.920661 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61149e47-c2d0-45a8-b120-f2dc850e9246 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:20.921528 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61149e47-c2d0-45a8-b120-f2dc850e9246 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:20.922000 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61149e47-c2d0-45a8-b120-f2dc850e9246 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:20.923614 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61149e47-c2d0-45a8-b120-f2dc850e9246 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:20.936447 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 382/774] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:42:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:20.942999 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd8722-0b30-404e-b7f9-d735325362e9 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:20.962292 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:21.005913 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61149e47-c2d0-45a8-b120-f2dc850e9246 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:21.062357 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd8722-0b30-404e-b7f9-d735325362e9 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:21.068831 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:21.104760 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d6634-6c7c-4816-aa0a-7e12236b6bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:21.105586 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d6634-6c7c-4816-aa0a-7e12236b6bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:21.105924 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d6634-6c7c-4816-aa0a-7e12236b6bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:21.106296 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d6634-6c7c-4816-aa0a-7e12236b6bf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:21.107119 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d6634-6c7c-4816-aa0a-7e12236b6bf3 None admin] RBAC: Adding query filter params (role.id=ce8c7035b6004d2f84c02ebc4a05f17b, scope.project.id=45c69e3e973c449895457bb610103a43, user.id=3302fdf33b5b4583a10e7c760c577cda) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:21.107704 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d6634-6c7c-4816-aa0a-7e12236b6bf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:21.109294 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d6634-6c7c-4816-aa0a-7e12236b6bf3 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:21.116032 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 393/775] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:42:20 2022] GET /identity/v3/role_assignments?user.id=3302fdf33b5b4583a10e7c760c577cda&scope.project.id=45c69e3e973c449895457bb610103a43&role.id=ce8c7035b6004d2f84c02ebc4a05f17b => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:21.139508 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61149e47-c2d0-45a8-b120-f2dc850e9246 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:21.176543 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98286308-07f5-4f7a-84d3-de73499857d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:21.177198 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98286308-07f5-4f7a-84d3-de73499857d6 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:21.177475 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98286308-07f5-4f7a-84d3-de73499857d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:21.177744 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98286308-07f5-4f7a-84d3-de73499857d6 None admin] PATH_INFO: `/v3/services/network` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:21.178673 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98286308-07f5-4f7a-84d3-de73499857d6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:21.180104 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98286308-07f5-4f7a-84d3-de73499857d6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:21.190244 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-98286308-07f5-4f7a-84d3-de73499857d6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:42:21.190244 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:21.190244 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:42:21.190244 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:42:21.190244 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:42:21.190244 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:42:21.190244 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:42:21.190244 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:21.190244 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:42:21.190244 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:21.190244 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:42:21.190244 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:21.190244 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:21.190244 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:21.190244 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:21.190244 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:21.190244 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:21.191510 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:21.191510 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:21.191510 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:21.191510 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:21.191510 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:21.191510 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:21.191510 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:42:21.191510 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:42:21.191510 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:42:21.191510 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:42:21.191510 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:21.191510 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:21.191510 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:21.191510 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:21.191510 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:21.191510 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:21.192711 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:21.192711 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:21.192711 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:21.192711 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:21.192711 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:21.192711 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:21.192711 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:21.192711 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:21.192711 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:21.192711 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:21.192711 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:42:21.192711 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:21.192711 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:42:21.192711 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:21.192711 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 383/776] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:42:21 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:21.197615 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98286308-07f5-4f7a-84d3-de73499857d6 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:21.197788 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad9409-4fed-4558-8a20-f7fb2ca192b9 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:21.198127 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad9409-4fed-4558-8a20-f7fb2ca192b9 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:21.198591 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad9409-4fed-4558-8a20-f7fb2ca192b9 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:21.200829 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 394/777] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:21.207591 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28ced0-5e28-4c8c-8887-bd4a5081035c None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:21.207893 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28ced0-5e28-4c8c-8887-bd4a5081035c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:21.208122 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28ced0-5e28-4c8c-8887-bd4a5081035c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:21.238465 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-9d28ced0-5e28-4c8c-8887-bd4a5081035c None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:21.240919 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9d28ced0-5e28-4c8c-8887-bd4a5081035c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:21.354707 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 395/778] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:42:21.364436 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98286308-07f5-4f7a-84d3-de73499857d6 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:21.374177 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:21.421186 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ad810-9249-43de-b381-e2222771d10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:21.422109 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ad810-9249-43de-b381-e2222771d10b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:21.422577 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ad810-9249-43de-b381-e2222771d10b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:21.423041 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ad810-9249-43de-b381-e2222771d10b None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:21.423829 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ad810-9249-43de-b381-e2222771d10b None admin] RBAC: Adding query filter params (name=network) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:21.424271 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ad810-9249-43de-b381-e2222771d10b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:21.425795 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ad810-9249-43de-b381-e2222771d10b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:21.430883 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 384/779] 10.222.0.52 () {56 vars in 1112 bytes} [Sun Aug 28 00:42:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:21.437033 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28ced0-5e28-4c8c-8887-bd4a5081035c None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:21.458202 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:21.571950 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28ced0-5e28-4c8c-8887-bd4a5081035c None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:21.616850 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d08d26-a05d-4928-a9a4-06c2e1957c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:21.617751 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d08d26-a05d-4928-a9a4-06c2e1957c6b None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:21.618208 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d08d26-a05d-4928-a9a4-06c2e1957c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:21.618696 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d08d26-a05d-4928-a9a4-06c2e1957c6b None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:21.619529 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d08d26-a05d-4928-a9a4-06c2e1957c6b None admin] RBAC: Adding query filter params (type=network) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:21.620033 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d08d26-a05d-4928-a9a4-06c2e1957c6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:21.621606 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d08d26-a05d-4928-a9a4-06c2e1957c6b None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:21.627260 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 396/780] 10.222.0.52 () {56 vars in 1112 bytes} [Sun Aug 28 00:42:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:21.632672 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ad810-9249-43de-b381-e2222771d10b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:21.785940 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ad810-9249-43de-b381-e2222771d10b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:21.838153 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d08d26-a05d-4928-a9a4-06c2e1957c6b None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:21.838632 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7586b-cb25-4cb3-aad6-a4487f6157cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:21.839538 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7586b-cb25-4cb3-aad6-a4487f6157cd None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:21.839538 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7586b-cb25-4cb3-aad6-a4487f6157cd None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:21.839813 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7586b-cb25-4cb3-aad6-a4487f6157cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:21.840473 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7586b-cb25-4cb3-aad6-a4487f6157cd None admin] RBAC: Adding query filter params (interface=public, service_id=6f0b8eed352a49c0bb0b15946f89e5cc, region_id=RegionOne) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:21.840792 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7586b-cb25-4cb3-aad6-a4487f6157cd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:21.842257 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7586b-cb25-4cb3-aad6-a4487f6157cd None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:21.849802 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 385/781] 10.222.0.52 () {56 vars in 1251 bytes} [Sun Aug 28 00:42:21 2022] GET /identity/v3/endpoints?service_id=6f0b8eed352a49c0bb0b15946f89e5cc&interface=public®ion_id=RegionOne => generated 194 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:21.854227 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7586b-cb25-4cb3-aad6-a4487f6157cd None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:21.906337 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:21.940503 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:21.971091 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d08d26-a05d-4928-a9a4-06c2e1957c6b None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:22.009752 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d2724-99bd-4718-bc38-599128945ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:22.010437 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d2724-99bd-4718-bc38-599128945ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:22.010717 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d2724-99bd-4718-bc38-599128945ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:22.010988 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d2724-99bd-4718-bc38-599128945ed9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:22.024541 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d2724-99bd-4718-bc38-599128945ed9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:42:22.029923 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-055d2724-99bd-4718-bc38-599128945ed9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:42:22.029923 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:22.029923 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:22.029923 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:22.029923 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:22.029923 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:22.029923 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:22.029923 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:22.029923 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:22.029923 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:22.029923 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:22.029923 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:22.029923 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:42:22.029923 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:42:22.029923 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:42:22.029923 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:42:22.030827 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:42:22.030827 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:42:22.030827 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:42:22.030827 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:42:22.030827 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:22.030827 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:22.030827 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:22.030827 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:22.030827 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:22.030827 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:22.030827 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:22.030827 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:22.030827 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:22.030827 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:22.030827 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:22.030827 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:22.031675 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:22.031675 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:22.031675 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:22.031675 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:22.031675 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:42:22.031675 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:42:22.031675 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:42:22.031675 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:42:22.031675 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:42:22.031675 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:42:22.031675 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:42:22.031675 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:22.031675 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 397/782] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:42:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:22.037564 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d2724-99bd-4718-bc38-599128945ed9 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:22.115961 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7586b-cb25-4cb3-aad6-a4487f6157cd None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:22.151876 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d2724-99bd-4718-bc38-599128945ed9 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:22.192599 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bca80-0b23-4306-bada-bdaf9e28c7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:22.193327 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bca80-0b23-4306-bada-bdaf9e28c7a4 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:22.193746 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bca80-0b23-4306-bada-bdaf9e28c7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:22.194276 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bca80-0b23-4306-bada-bdaf9e28c7a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:22.195045 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0bca80-0b23-4306-bada-bdaf9e28c7a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:22.195464 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0bca80-0b23-4306-bada-bdaf9e28c7a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:22.196997 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0bca80-0b23-4306-bada-bdaf9e28c7a4 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:22.198577 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:22.208293 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 398/783] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:42:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:22.210568 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21bf829-eaf1-4400-813b-9cc4f69c7369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:22.211198 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21bf829-eaf1-4400-813b-9cc4f69c7369 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:22.211472 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21bf829-eaf1-4400-813b-9cc4f69c7369 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:22.211738 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21bf829-eaf1-4400-813b-9cc4f69c7369 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:22.212348 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21bf829-eaf1-4400-813b-9cc4f69c7369 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:22.213722 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21bf829-eaf1-4400-813b-9cc4f69c7369 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:22.214487 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bca80-0b23-4306-bada-bdaf9e28c7a4 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:22.228966 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 386/784] 10.222.0.52 () {56 vars in 1087 bytes} [Sun Aug 28 00:42:21 2022] GET /identity/v3/services => generated 772 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:22.374820 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bca80-0b23-4306-bada-bdaf9e28c7a4 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:22.417349 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadab54-3e45-4350-a50b-8f8c0052ba30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:22.418409 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadab54-3e45-4350-a50b-8f8c0052ba30 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:22.418903 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadab54-3e45-4350-a50b-8f8c0052ba30 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:22.419367 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadab54-3e45-4350-a50b-8f8c0052ba30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:22.432294 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cadab54-3e45-4350-a50b-8f8c0052ba30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:22.434138 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cadab54-3e45-4350-a50b-8f8c0052ba30 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:22.452739 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-9cadab54-3e45-4350-a50b-8f8c0052ba30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:22.452739 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:22.452739 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:22.452739 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:22.452739 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:22.452739 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:22.452739 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:22.452739 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:22.452739 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:22.452739 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:22.452739 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:22.452739 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:22.452739 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:22.452739 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:22.452739 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:22.452739 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:22.453728 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:22.453728 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:22.453728 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:22.453728 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:22.453728 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:22.453728 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:22.453728 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:22.453728 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:22.453728 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:22.453728 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:22.453728 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:22.453728 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:22.453728 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:22.453728 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:22.453728 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:22.453728 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:22.453728 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:22.454684 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:22.454684 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:22.454684 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:22.456829 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 399/785] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:22.462593 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21bf829-eaf1-4400-813b-9cc4f69c7369 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:22.618800 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:22.626873 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21bf829-eaf1-4400-813b-9cc4f69c7369 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:22.682604 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad4cf7-9c56-4bbc-9e5c-3039742eaf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:22.683229 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad4cf7-9c56-4bbc-9e5c-3039742eaf7e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:22.683512 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad4cf7-9c56-4bbc-9e5c-3039742eaf7e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:22.683786 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad4cf7-9c56-4bbc-9e5c-3039742eaf7e None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:22.684439 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad4cf7-9c56-4bbc-9e5c-3039742eaf7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:22.684742 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad4cf7-9c56-4bbc-9e5c-3039742eaf7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:22.686344 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad4cf7-9c56-4bbc-9e5c-3039742eaf7e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:22.703412 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 387/786] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:42:22.709520 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadab54-3e45-4350-a50b-8f8c0052ba30 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:22.794247 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:22.840819 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadab54-3e45-4350-a50b-8f8c0052ba30 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:22.896827 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11d533-c66f-470b-b7c2-3a9c0f073933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:22.897647 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11d533-c66f-470b-b7c2-3a9c0f073933 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:22.897953 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11d533-c66f-470b-b7c2-3a9c0f073933 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:22.898229 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11d533-c66f-470b-b7c2-3a9c0f073933 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:22.915178 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb11d533-c66f-470b-b7c2-3a9c0f073933 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:22.917217 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb11d533-c66f-470b-b7c2-3a9c0f073933 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:22.935377 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-bb11d533-c66f-470b-b7c2-3a9c0f073933 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:42:22.935377 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:22.935377 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:22.935377 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:22.935377 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:22.935377 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:22.935377 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:22.935377 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:22.935377 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:22.935377 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:22.935377 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:22.935377 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:22.935377 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:42:22.935377 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:42:22.935377 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:42:22.935377 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:42:22.937048 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:22.937048 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:22.937048 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:42:22.937048 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:22.937048 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:42:22.937048 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:22.937048 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:22.937048 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:22.937048 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:22.937048 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:22.937048 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:22.937048 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:22.937048 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:22.937048 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:22.937048 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:22.937048 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:22.937048 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:22.937048 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:22.938450 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:22.938450 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:22.938450 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:42:22.938450 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:42:22.938450 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:42:22.938450 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:42:22.938450 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:42:22.938450 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:42:22.938450 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:42:22.938450 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:22.938450 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 400/787] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:42:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:22.942578 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad4cf7-9c56-4bbc-9e5c-3039742eaf7e None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:23.036890 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464843ec-4560-4cb8-ad07-e61174e71005 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:23.037407 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464843ec-4560-4cb8-ad07-e61174e71005 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:23.037600 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464843ec-4560-4cb8-ad07-e61174e71005 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:23.040844 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 401/788] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:23.046491 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda45b38-220e-4fc5-a44e-24429b43bd4b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:23.047056 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda45b38-220e-4fc5-a44e-24429b43bd4b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:23.047523 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda45b38-220e-4fc5-a44e-24429b43bd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:23.078506 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-cda45b38-220e-4fc5-a44e-24429b43bd4b None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:23.079699 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-cda45b38-220e-4fc5-a44e-24429b43bd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:23.110990 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad4cf7-9c56-4bbc-9e5c-3039742eaf7e None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:23.176939 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7e525-3450-47ed-b3cf-14e92f9edbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:23.177552 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7e525-3450-47ed-b3cf-14e92f9edbbe None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:23.177826 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7e525-3450-47ed-b3cf-14e92f9edbbe None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:23.178114 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7e525-3450-47ed-b3cf-14e92f9edbbe None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:23.178852 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7e525-3450-47ed-b3cf-14e92f9edbbe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:23.179152 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7e525-3450-47ed-b3cf-14e92f9edbbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:23.180595 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7e525-3450-47ed-b3cf-14e92f9edbbe None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:23.216820 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 402/789] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:42:23.218896 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 388/790] 10.222.0.52 () {56 vars in 1135 bytes} [Sun Aug 28 00:42:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:23.227263 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda45b38-220e-4fc5-a44e-24429b43bd4b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:23.285923 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:23.361730 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda45b38-220e-4fc5-a44e-24429b43bd4b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:23.414541 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7249a-c7ea-4f58-8c6f-190c60f04abf None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:23.414888 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7249a-c7ea-4f58-8c6f-190c60f04abf None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:23.415097 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7249a-c7ea-4f58-8c6f-190c60f04abf None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:23.416657 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 389/791] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:23.422713 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc9b7e-f9d2-413c-b9ba-775e1f2ddc19 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:23.423323 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc9b7e-f9d2-413c-b9ba-775e1f2ddc19 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:23.423815 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc9b7e-f9d2-413c-b9ba-775e1f2ddc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:23.460332 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-2dfc9b7e-f9d2-413c-b9ba-775e1f2ddc19 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:23.461918 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2dfc9b7e-f9d2-413c-b9ba-775e1f2ddc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:23.477995 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:23.536626 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819878c2-a9bc-4fff-94db-c8bd2f9d0d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:23.537908 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819878c2-a9bc-4fff-94db-c8bd2f9d0d30 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:23.538475 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819878c2-a9bc-4fff-94db-c8bd2f9d0d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:23.538862 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819878c2-a9bc-4fff-94db-c8bd2f9d0d30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:23.551279 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819878c2-a9bc-4fff-94db-c8bd2f9d0d30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:23.552857 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819878c2-a9bc-4fff-94db-c8bd2f9d0d30 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:23.569376 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-819878c2-a9bc-4fff-94db-c8bd2f9d0d30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:23.569376 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:23.569376 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:23.569376 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:23.569376 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:23.569376 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:23.569376 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:23.569376 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:23.569376 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:23.569376 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:23.569376 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:23.569376 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:23.569376 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:23.569376 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:23.569376 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:23.569376 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:23.570597 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:23.570597 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:23.570597 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:23.570597 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:23.570597 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:23.570597 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:23.570597 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:23.570597 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:23.570597 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:23.570597 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:23.570597 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:23.570597 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:23.570597 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:23.570597 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:23.570597 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:23.570597 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:23.570597 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:23.571679 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:23.571679 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:23.571679 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:23.573099 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 403/792] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:42:23.574623 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b8d2d-c0fa-4546-83b6-acbb5cbff503 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:23.575060 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b8d2d-c0fa-4546-83b6-acbb5cbff503 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:23.575336 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b8d2d-c0fa-4546-83b6-acbb5cbff503 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:23.580816 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 404/793] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:23.580816 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b8d2d-c0fa-4546-83b6-acbb5cbff503 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:23.587475 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 390/794] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:42:23.588444 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc9b7e-f9d2-413c-b9ba-775e1f2ddc19 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:23.700522 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:23.705680 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc9b7e-f9d2-413c-b9ba-775e1f2ddc19 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:23.720332 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b8d2d-c0fa-4546-83b6-acbb5cbff503 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:23.753382 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1442dd1-2a9c-46da-9c39-f502fdf6dba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:23.754662 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1442dd1-2a9c-46da-9c39-f502fdf6dba5 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:23.755499 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1442dd1-2a9c-46da-9c39-f502fdf6dba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:23.756213 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1442dd1-2a9c-46da-9c39-f502fdf6dba5 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:23.757341 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1442dd1-2a9c-46da-9c39-f502fdf6dba5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:23.758232 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1442dd1-2a9c-46da-9c39-f502fdf6dba5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:23.760372 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1442dd1-2a9c-46da-9c39-f502fdf6dba5 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:23.762935 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7e035-6edf-4c09-be2a-a53661b3976d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:23.764057 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7e035-6edf-4c09-be2a-a53661b3976d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:23.764392 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7e035-6edf-4c09-be2a-a53661b3976d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:23.764707 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7e035-6edf-4c09-be2a-a53661b3976d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:23.775037 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 391/795] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:23.776340 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6631e-f36a-4c6f-a859-cc1285df1fcb None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:23.776631 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6631e-f36a-4c6f-a859-cc1285df1fcb None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:23.776907 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6631e-f36a-4c6f-a859-cc1285df1fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:23.778711 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7e035-6edf-4c09-be2a-a53661b3976d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:42:23.784415 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:23.785739 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-30c7e035-6edf-4c09-be2a-a53661b3976d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:42:23.785739 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:23.785739 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:23.785739 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:23.785739 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:23.785739 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:23.785739 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:23.785739 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:23.785739 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:23.785739 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:23.785739 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:23.785739 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:23.785739 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:42:23.785739 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:42:23.785739 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:42:23.785739 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:42:23.786711 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:42:23.786711 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:42:23.786711 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:42:23.786711 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:42:23.786711 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:23.786711 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:23.786711 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:23.786711 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:23.786711 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:23.786711 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:23.786711 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:23.786711 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:23.786711 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:23.786711 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:23.786711 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:23.786711 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:23.787568 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:23.787568 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:23.787568 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:23.787568 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:23.787568 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:42:23.787568 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:42:23.787568 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:42:23.787568 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:42:23.787568 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:42:23.787568 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:42:23.787568 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:42:23.787568 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:23.790986 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 405/796] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:42:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:23.791906 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7e035-6edf-4c09-be2a-a53661b3976d None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:23.806759 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-85a6631e-f36a-4c6f-a859-cc1285df1fcb None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:23.808094 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-85a6631e-f36a-4c6f-a859-cc1285df1fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:23.890257 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 392/797] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:42:23.890257 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6631e-f36a-4c6f-a859-cc1285df1fcb None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:23.920410 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7e035-6edf-4c09-be2a-a53661b3976d None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:23.963565 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5602032-e916-466d-acf7-748cecfd1317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:23.964556 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5602032-e916-466d-acf7-748cecfd1317 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:23.964836 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5602032-e916-466d-acf7-748cecfd1317 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:23.965110 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5602032-e916-466d-acf7-748cecfd1317 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:23.975014 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5602032-e916-466d-acf7-748cecfd1317 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:23.977131 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5602032-e916-466d-acf7-748cecfd1317 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:23.992054 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-a5602032-e916-466d-acf7-748cecfd1317 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:23.992054 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:23.992054 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:23.992054 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:23.992054 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:23.992054 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:23.992054 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:23.992054 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:23.992054 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:23.992054 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:23.992054 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:23.992054 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:23.992054 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:42:23.992054 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:42:23.992054 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:42:23.992996 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:42:23.992996 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:23.992996 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:23.992996 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:23.992996 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:23.992996 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:23.992996 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:23.992996 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:23.992996 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:23.992996 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:23.992996 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:23.992996 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:23.992996 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:23.992996 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:23.992996 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:23.992996 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:23.992996 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:23.993971 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:42:23.993971 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:42:23.993971 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:42:23.993971 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:42:23.993971 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:42:23.993971 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:42:23.993971 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:23.993971 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:23.998011 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 406/798] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:42:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:23.999384 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5602032-e916-466d-acf7-748cecfd1317 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:24.015696 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:24.030962 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6631e-f36a-4c6f-a859-cc1285df1fcb None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:24.075666 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:24.084431 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e40f1-4c33-4c0a-9d74-12cb186846a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:24.085870 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e40f1-4c33-4c0a-9d74-12cb186846a9 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:24.086444 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e40f1-4c33-4c0a-9d74-12cb186846a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:24.086896 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e40f1-4c33-4c0a-9d74-12cb186846a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:24.087746 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e40f1-4c33-4c0a-9d74-12cb186846a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:24.088242 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e40f1-4c33-4c0a-9d74-12cb186846a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:24.090708 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e40f1-4c33-4c0a-9d74-12cb186846a9 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:24.102426 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 393/799] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:42:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:24.103505 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e40f1-4c33-4c0a-9d74-12cb186846a9 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:24.136708 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5602032-e916-466d-acf7-748cecfd1317 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:24.175790 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380e6a9-6ab9-4d6e-8cf4-4a343186a124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:24.176429 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380e6a9-6ab9-4d6e-8cf4-4a343186a124 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:24.176724 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380e6a9-6ab9-4d6e-8cf4-4a343186a124 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:24.176978 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380e6a9-6ab9-4d6e-8cf4-4a343186a124 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:24.177560 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380e6a9-6ab9-4d6e-8cf4-4a343186a124 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:24.178971 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380e6a9-6ab9-4d6e-8cf4-4a343186a124 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:24.188657 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-4380e6a9-6ab9-4d6e-8cf4-4a343186a124 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:42:24.188657 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:24.188657 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:42:24.188657 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:42:24.188657 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:42:24.188657 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:42:24.188657 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:42:24.188657 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:24.188657 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:42:24.188657 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:24.188657 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:42:24.188657 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:24.188657 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:24.188657 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:24.188657 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:24.188657 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:24.188657 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:24.189748 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:24.189748 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:24.189748 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:24.189748 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:24.189748 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:24.189748 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:24.189748 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:42:24.189748 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:42:24.189748 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:42:24.189748 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:42:24.189748 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:24.189748 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:24.189748 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:24.189748 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:24.189748 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:24.189748 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:24.190609 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:24.190609 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:24.190609 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:24.190609 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:24.190609 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:24.190609 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:24.190609 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:24.190609 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:24.190609 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:24.190609 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:24.190609 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:42:24.190609 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:24.190609 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:42:24.190609 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:24.190609 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 407/800] 10.222.0.52 () {56 vars in 1129 bytes} [Sun Aug 28 00:42:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:24.191423 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380e6a9-6ab9-4d6e-8cf4-4a343186a124 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:24.222864 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e40f1-4c33-4c0a-9d74-12cb186846a9 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:24.260498 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24647112-b758-4dac-8334-404153f140a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:24.261210 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24647112-b758-4dac-8334-404153f140a5 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:24.261552 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24647112-b758-4dac-8334-404153f140a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:24.261906 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24647112-b758-4dac-8334-404153f140a5 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:24.262775 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24647112-b758-4dac-8334-404153f140a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:24.263248 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24647112-b758-4dac-8334-404153f140a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:24.265359 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24647112-b758-4dac-8334-404153f140a5 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:24.268751 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:24.285903 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 394/801] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:42:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:24.285903 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24647112-b758-4dac-8334-404153f140a5 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:24.294702 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380e6a9-6ab9-4d6e-8cf4-4a343186a124 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:24.329775 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7353232-3d08-415a-876a-185ee95264f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:24.330528 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7353232-3d08-415a-876a-185ee95264f0 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:24.330870 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7353232-3d08-415a-876a-185ee95264f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:24.331209 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7353232-3d08-415a-876a-185ee95264f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:24.343613 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7353232-3d08-415a-876a-185ee95264f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:24.345656 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7353232-3d08-415a-876a-185ee95264f0 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:24.346859 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:24.361831 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-f7353232-3d08-415a-876a-185ee95264f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:24.361831 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:24.361831 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:24.361831 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:24.361831 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:24.361831 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:24.361831 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:24.361831 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:24.361831 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:24.361831 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:24.361831 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:24.361831 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:24.361831 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:24.361831 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:24.361831 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:24.361831 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:24.363012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:24.363012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:24.363012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:24.363012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:24.363012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:24.363012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:24.363012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:24.363012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:24.363012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:24.363012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:24.363012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:24.363012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:24.363012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:24.363012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:24.363012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:24.363012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:24.363012 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:24.363915 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:24.363915 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:24.363915 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:24.363915 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 408/802] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:24.364235 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7353232-3d08-415a-876a-185ee95264f0 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:24.398306 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24647112-b758-4dac-8334-404153f140a5 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:24.432582 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104f97b-6cd2-47cf-a2eb-cc99746cf575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:24.433213 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104f97b-6cd2-47cf-a2eb-cc99746cf575 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:24.433490 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104f97b-6cd2-47cf-a2eb-cc99746cf575 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:24.433749 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104f97b-6cd2-47cf-a2eb-cc99746cf575 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:24.444259 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104f97b-6cd2-47cf-a2eb-cc99746cf575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:42:24.449161 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-5104f97b-6cd2-47cf-a2eb-cc99746cf575 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:42:24.449161 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:24.449161 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:24.449161 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:24.449161 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:24.449161 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:24.449161 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:24.449161 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:24.449161 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:24.449161 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:24.449161 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:24.449161 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:24.449161 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:42:24.449161 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:42:24.449161 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:42:24.449161 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:42:24.450299 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:42:24.450299 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:42:24.450299 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:42:24.450299 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:42:24.450299 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:24.450299 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:24.450299 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:24.450299 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:24.450299 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:24.450299 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:24.450299 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:24.450299 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:24.450299 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:24.450299 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:24.450299 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:24.450299 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:24.451627 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:24.451627 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:24.451627 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:24.451627 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:24.451627 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:42:24.451627 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:42:24.451627 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:42:24.451627 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:42:24.451627 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:42:24.451627 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:42:24.451627 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:42:24.451627 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:24.451627 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 395/803] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Aug 28 00:42:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:24.451627 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104f97b-6cd2-47cf-a2eb-cc99746cf575 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:24.468162 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7353232-3d08-415a-876a-185ee95264f0 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:24.494398 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:24.503267 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0b4f4-f512-4aa2-8466-0c2f9560f353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:24.503868 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0b4f4-f512-4aa2-8466-0c2f9560f353 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:24.504195 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0b4f4-f512-4aa2-8466-0c2f9560f353 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:24.504453 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0b4f4-f512-4aa2-8466-0c2f9560f353 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:24.505120 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0b4f4-f512-4aa2-8466-0c2f9560f353 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:24.505412 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0b4f4-f512-4aa2-8466-0c2f9560f353 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:24.506795 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0b4f4-f512-4aa2-8466-0c2f9560f353 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:24.511104 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 409/804] 10.222.0.52 () {56 vars in 1124 bytes} [Sun Aug 28 00:42:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:24.511860 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0b4f4-f512-4aa2-8466-0c2f9560f353 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:24.556058 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104f97b-6cd2-47cf-a2eb-cc99746cf575 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:24.570035 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:24.590669 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e253a-4614-4ce6-bfd3-f1975db8b525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:24.591327 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e253a-4614-4ce6-bfd3-f1975db8b525 None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:24.591606 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e253a-4614-4ce6-bfd3-f1975db8b525 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:24.591903 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e253a-4614-4ce6-bfd3-f1975db8b525 None admin] PATH_INFO: `/v3/projects/45c69e3e973c449895457bb610103a43/users/a80a6019cf424c16a1d461a632cf8568/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:24.593796 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e253a-4614-4ce6-bfd3-f1975db8b525 None admin] RBAC: Authorizing `identity:create_grant(project_id=45c69e3e973c449895457bb610103a43, user_id=a80a6019cf424c16a1d461a632cf8568, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:24.595613 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e253a-4614-4ce6-bfd3-f1975db8b525 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:24.609044 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 396/805] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Aug 28 00:42:24 2022] PUT /identity/v3/projects/45c69e3e973c449895457bb610103a43/users/a80a6019cf424c16a1d461a632cf8568/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:42:24.610078 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a5cad-e0e6-4363-b9e5-cde5ed0badb7 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:24.610362 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a5cad-e0e6-4363-b9e5-cde5ed0badb7 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:24.610628 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a5cad-e0e6-4363-b9e5-cde5ed0badb7 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:24.613888 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 397/806] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:24.613888 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a5cad-e0e6-4363-b9e5-cde5ed0badb7 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:24.622264 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0b4f4-f512-4aa2-8466-0c2f9560f353 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:24.662357 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4af41b-8b66-4cc4-8eac-b1c766796272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:24.663098 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4af41b-8b66-4cc4-8eac-b1c766796272 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:24.663476 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4af41b-8b66-4cc4-8eac-b1c766796272 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:24.663759 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4af41b-8b66-4cc4-8eac-b1c766796272 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:24.664530 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4af41b-8b66-4cc4-8eac-b1c766796272 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:24.664895 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4af41b-8b66-4cc4-8eac-b1c766796272 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:24.666655 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4af41b-8b66-4cc4-8eac-b1c766796272 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:24.686414 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 410/807] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:24.686414 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4af41b-8b66-4cc4-8eac-b1c766796272 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:24.744178 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a5cad-e0e6-4363-b9e5-cde5ed0badb7 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:24.745297 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:24.783982 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22dbd15-5297-4684-9963-d85d60bd9a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:24.784619 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dbd15-5297-4684-9963-d85d60bd9a89 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:24.784899 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dbd15-5297-4684-9963-d85d60bd9a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:24.785166 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dbd15-5297-4684-9963-d85d60bd9a89 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:24.785977 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22dbd15-5297-4684-9963-d85d60bd9a89 None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:24.786280 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22dbd15-5297-4684-9963-d85d60bd9a89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:24.787847 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22dbd15-5297-4684-9963-d85d60bd9a89 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:24.798094 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 398/808] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Aug 28 00:42:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:24.798568 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9020b5-bb06-44be-a120-4ca1e52f77f9 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:24.798852 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9020b5-bb06-44be-a120-4ca1e52f77f9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:24.799124 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9020b5-bb06-44be-a120-4ca1e52f77f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:24.805241 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4af41b-8b66-4cc4-8eac-b1c766796272 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:24.817822 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-5e9020b5-bb06-44be-a120-4ca1e52f77f9 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:24.819043 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5e9020b5-bb06-44be-a120-4ca1e52f77f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:24.843181 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd52b4-be5d-45c4-a268-2079404d1c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:24.843782 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd52b4-be5d-45c4-a268-2079404d1c49 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:24.844059 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd52b4-be5d-45c4-a268-2079404d1c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:24.844328 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd52b4-be5d-45c4-a268-2079404d1c49 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:24.845262 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd52b4-be5d-45c4-a268-2079404d1c49 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:24.845561 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd52b4-be5d-45c4-a268-2079404d1c49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:24.846982 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd52b4-be5d-45c4-a268-2079404d1c49 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:24.850528 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:24.852356 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 411/809] 10.222.0.52 () {56 vars in 1124 bytes} [Sun Aug 28 00:42:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:24.853404 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd52b4-be5d-45c4-a268-2079404d1c49 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:24.905869 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 399/810] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:42:24.905869 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9020b5-bb06-44be-a120-4ca1e52f77f9 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:24.992570 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd52b4-be5d-45c4-a268-2079404d1c49 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:25.007357 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:25.014837 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9020b5-bb06-44be-a120-4ca1e52f77f9 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:25.030074 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e70f93-1fc5-46d7-8faf-3d813feb7d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:25.031039 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e70f93-1fc5-46d7-8faf-3d813feb7d50 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:25.031509 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e70f93-1fc5-46d7-8faf-3d813feb7d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:25.031966 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e70f93-1fc5-46d7-8faf-3d813feb7d50 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:25.039874 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e70f93-1fc5-46d7-8faf-3d813feb7d50 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:25.041716 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e70f93-1fc5-46d7-8faf-3d813feb7d50 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:25.051271 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4431025-ea65-4952-a1f7-72e161f4dc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:25.052137 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4431025-ea65-4952-a1f7-72e161f4dc31 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:25.052467 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4431025-ea65-4952-a1f7-72e161f4dc31 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:25.052745 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4431025-ea65-4952-a1f7-72e161f4dc31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:25.056743 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-43e70f93-1fc5-46d7-8faf-3d813feb7d50 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:42:25.056743 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:25.056743 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:25.056743 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:25.056743 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:25.056743 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:25.056743 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:25.056743 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:25.056743 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:25.056743 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:25.056743 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:25.056743 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:25.056743 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:42:25.056743 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:42:25.056743 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:42:25.056743 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:42:25.057691 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:25.057691 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:25.057691 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:42:25.057691 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:25.057691 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:42:25.057691 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:25.057691 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:25.057691 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:25.057691 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:25.057691 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:25.057691 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:25.057691 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:25.057691 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:25.057691 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:25.057691 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:25.057691 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:25.057691 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:25.057691 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:25.058671 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:25.058671 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:25.058671 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:42:25.058671 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:42:25.058671 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:42:25.058671 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:42:25.058671 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:42:25.058671 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:42:25.058671 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:42:25.058671 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:25.059945 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 412/811] 10.222.0.52 () {56 vars in 1093 bytes} [Sun Aug 28 00:42:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:25.060719 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e70f93-1fc5-46d7-8faf-3d813feb7d50 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:25.065871 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4431025-ea65-4952-a1f7-72e161f4dc31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:25.067042 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4431025-ea65-4952-a1f7-72e161f4dc31 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:25.083573 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-e4431025-ea65-4952-a1f7-72e161f4dc31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:25.083573 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:25.083573 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:25.083573 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:25.083573 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:25.083573 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:25.083573 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:25.083573 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:25.083573 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:25.083573 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:25.083573 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:25.083573 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:25.083573 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:25.083573 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:25.083573 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:25.083573 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:25.084567 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:25.084567 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:25.084567 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:25.084567 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:25.084567 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:25.084567 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:25.084567 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:25.084567 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:25.084567 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:25.084567 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:25.084567 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:25.084567 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:25.084567 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:25.084567 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:25.084567 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:25.084567 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:25.084567 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:25.085469 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:25.085469 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:25.085469 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:25.085469 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 400/812] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:25.086180 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4431025-ea65-4952-a1f7-72e161f4dc31 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:25.107614 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:25.163838 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e70f93-1fc5-46d7-8faf-3d813feb7d50 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:25.195336 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4431025-ea65-4952-a1f7-72e161f4dc31 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:25.198946 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ace5c5-4d2d-411a-9c88-c77b12ad1928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:25.199560 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ace5c5-4d2d-411a-9c88-c77b12ad1928 None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:25.199839 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ace5c5-4d2d-411a-9c88-c77b12ad1928 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:25.200112 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ace5c5-4d2d-411a-9c88-c77b12ad1928 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:25.200779 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ace5c5-4d2d-411a-9c88-c77b12ad1928 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:25.202424 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ace5c5-4d2d-411a-9c88-c77b12ad1928 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:25.225877 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 413/813] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:42:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:42:25.235505 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ace5c5-4d2d-411a-9c88-c77b12ad1928 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:25.236557 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a90f4-c09f-49f2-9e49-5cb5cba79652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:25.237191 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a90f4-c09f-49f2-9e49-5cb5cba79652 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:25.237465 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a90f4-c09f-49f2-9e49-5cb5cba79652 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:25.237732 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a90f4-c09f-49f2-9e49-5cb5cba79652 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:25.238585 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a90f4-c09f-49f2-9e49-5cb5cba79652 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:25.238885 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a90f4-c09f-49f2-9e49-5cb5cba79652 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:25.240552 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a90f4-c09f-49f2-9e49-5cb5cba79652 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:25.268311 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 401/814] 10.222.0.52 () {56 vars in 1133 bytes} [Sun Aug 28 00:42:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:25.268311 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a90f4-c09f-49f2-9e49-5cb5cba79652 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:25.290399 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:25.363883 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:25.371160 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ace5c5-4d2d-411a-9c88-c77b12ad1928 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:25.399276 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a90f4-c09f-49f2-9e49-5cb5cba79652 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:25.409280 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c146807-b251-496c-914c-d980edd4e21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:25.410038 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c146807-b251-496c-914c-d980edd4e21c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:25.410453 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c146807-b251-496c-914c-d980edd4e21c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:25.410726 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c146807-b251-496c-914c-d980edd4e21c None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:25.411374 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c146807-b251-496c-914c-d980edd4e21c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:25.411694 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c146807-b251-496c-914c-d980edd4e21c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:25.413212 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c146807-b251-496c-914c-d980edd4e21c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:25.426732 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 414/815] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:25.427656 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c146807-b251-496c-914c-d980edd4e21c None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:25.439369 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020a4bd-c913-49be-ae2d-c28f5850bf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:25.440315 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020a4bd-c913-49be-ae2d-c28f5850bf85 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:25.440785 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020a4bd-c913-49be-ae2d-c28f5850bf85 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:25.441360 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020a4bd-c913-49be-ae2d-c28f5850bf85 None admin] PATH_INFO: `/v3/services/network` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:25.442157 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a020a4bd-c913-49be-ae2d-c28f5850bf85 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:25.443772 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a020a4bd-c913-49be-ae2d-c28f5850bf85 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:25.453806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-a020a4bd-c913-49be-ae2d-c28f5850bf85 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:42:25.453806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:25.453806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:42:25.453806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:42:25.453806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:42:25.453806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:42:25.453806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:42:25.453806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:25.453806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:42:25.453806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:25.453806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:42:25.453806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:25.453806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:25.453806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:25.453806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:25.453806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:25.453806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:25.454887 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:25.454887 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:25.454887 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:25.454887 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:25.454887 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:25.454887 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:25.454887 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:42:25.454887 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:42:25.454887 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:42:25.454887 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:42:25.454887 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:25.454887 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:25.454887 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:25.454887 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:25.454887 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:25.454887 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:25.455746 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:25.455746 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:25.455746 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:25.455746 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:25.455746 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:25.455746 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:25.455746 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:25.455746 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:25.455746 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:25.455746 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:25.455746 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:42:25.455746 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:25.455746 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:42:25.455746 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:25.458325 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 402/816] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:42:25 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:25.459247 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020a4bd-c913-49be-ae2d-c28f5850bf85 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:25.554507 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:25.568822 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c146807-b251-496c-914c-d980edd4e21c None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:25.575290 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020a4bd-c913-49be-ae2d-c28f5850bf85 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:25.614313 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0d20f-6fde-464c-a877-65226a33f68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:25.615123 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0d20f-6fde-464c-a877-65226a33f68a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:25.615400 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0d20f-6fde-464c-a877-65226a33f68a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:25.615665 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0d20f-6fde-464c-a877-65226a33f68a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:25.616138 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf9acf-604c-4eb7-a16d-576fc267b33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:25.616761 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf9acf-604c-4eb7-a16d-576fc267b33e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:25.617042 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf9acf-604c-4eb7-a16d-576fc267b33e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:25.617313 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf9acf-604c-4eb7-a16d-576fc267b33e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:25.624016 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb0d20f-6fde-464c-a877-65226a33f68a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:25.625112 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb0d20f-6fde-464c-a877-65226a33f68a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:25.627163 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:25.637869 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-0eb0d20f-6fde-464c-a877-65226a33f68a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:42:25.637869 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:25.637869 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:25.637869 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:25.637869 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:25.637869 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:25.637869 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:25.637869 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:25.637869 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:25.637869 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:25.637869 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:25.637869 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:25.637869 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:42:25.637869 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:42:25.637869 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:42:25.637869 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:42:25.639060 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:25.639060 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:25.639060 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:42:25.639060 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:25.639060 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:42:25.639060 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:25.639060 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:25.639060 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:25.639060 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:25.639060 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:25.639060 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:25.639060 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:25.639060 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:25.639060 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:25.639060 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:25.639060 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:25.639060 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:25.639060 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:25.640533 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:25.640533 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:25.640533 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:42:25.640533 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:42:25.640533 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:42:25.640533 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:42:25.640533 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:42:25.640533 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:42:25.640533 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:42:25.640533 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:25.640533 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 403/817] 10.222.0.52 () {56 vars in 1117 bytes} [Sun Aug 28 00:42:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:25.640533 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0d20f-6fde-464c-a877-65226a33f68a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:25.694981 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf9acf-604c-4eb7-a16d-576fc267b33e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:25.696708 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf9acf-604c-4eb7-a16d-576fc267b33e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:25.760624 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0d20f-6fde-464c-a877-65226a33f68a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:25.795165 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:25.798113 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de3662-d26e-4172-96c5-dde72062513e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:25.798918 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de3662-d26e-4172-96c5-dde72062513e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:25.799343 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de3662-d26e-4172-96c5-dde72062513e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:25.800462 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de3662-d26e-4172-96c5-dde72062513e None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:25.801244 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de3662-d26e-4172-96c5-dde72062513e None admin] RBAC: Adding query filter params (name=network) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:25.801575 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de3662-d26e-4172-96c5-dde72062513e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:25.803074 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de3662-d26e-4172-96c5-dde72062513e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:25.808296 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 404/819] 10.222.0.52 () {56 vars in 1112 bytes} [Sun Aug 28 00:42:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:25.808555 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 415/819] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:42:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:42:25.809026 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de3662-d26e-4172-96c5-dde72062513e None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:25.818869 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf9acf-604c-4eb7-a16d-576fc267b33e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:25.874892 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:25.918495 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de3662-d26e-4172-96c5-dde72062513e None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:25.937249 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf9acf-604c-4eb7-a16d-576fc267b33e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:25.954616 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba3976-3f02-4efb-af1f-c0ce9d985135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:25.955291 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba3976-3f02-4efb-af1f-c0ce9d985135 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:25.955607 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba3976-3f02-4efb-af1f-c0ce9d985135 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:25.955903 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba3976-3f02-4efb-af1f-c0ce9d985135 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:25.956760 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba3976-3f02-4efb-af1f-c0ce9d985135 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:25.957267 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba3976-3f02-4efb-af1f-c0ce9d985135 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:25.958759 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba3976-3f02-4efb-af1f-c0ce9d985135 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:25.981992 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 405/820] 10.222.0.52 () {56 vars in 1149 bytes} [Sun Aug 28 00:42:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:25.983389 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba3976-3f02-4efb-af1f-c0ce9d985135 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:25.988490 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa4cb0-4658-457a-9bd9-22102ca141b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:25.989115 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa4cb0-4658-457a-9bd9-22102ca141b9 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:25.989392 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa4cb0-4658-457a-9bd9-22102ca141b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:25.989664 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa4cb0-4658-457a-9bd9-22102ca141b9 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:25.990332 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa4cb0-4658-457a-9bd9-22102ca141b9 None admin] RBAC: Adding query filter params (type=network) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:25.990634 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa4cb0-4658-457a-9bd9-22102ca141b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:25.992130 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa4cb0-4658-457a-9bd9-22102ca141b9 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:25.999739 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 416/821] 10.222.0.52 () {56 vars in 1112 bytes} [Sun Aug 28 00:42:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:26.000641 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa4cb0-4658-457a-9bd9-22102ca141b9 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:26.062119 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:26.112512 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa4cb0-4658-457a-9bd9-22102ca141b9 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:26.149558 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a696ffc-4b5b-4bcd-ba35-b75cbb90b1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:26.150325 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a696ffc-4b5b-4bcd-ba35-b75cbb90b1b0 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:26.150669 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a696ffc-4b5b-4bcd-ba35-b75cbb90b1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:26.151013 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a696ffc-4b5b-4bcd-ba35-b75cbb90b1b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:26.162112 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a696ffc-4b5b-4bcd-ba35-b75cbb90b1b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:26.163774 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a696ffc-4b5b-4bcd-ba35-b75cbb90b1b0 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:26.179522 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-0a696ffc-4b5b-4bcd-ba35-b75cbb90b1b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:26.179522 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:26.179522 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:26.179522 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:26.179522 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:26.179522 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:26.179522 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:26.179522 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:26.179522 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:26.179522 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:26.179522 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:26.179522 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:26.179522 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:26.179522 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:26.179522 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:26.179522 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:26.181128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:26.181128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:26.181128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:26.181128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:26.181128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:26.181128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:26.181128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:26.181128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:26.181128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:26.181128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:26.181128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:26.181128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:26.181128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:26.181128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:26.181128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:26.181128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:26.181128 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:26.182516 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:26.182516 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:26.182516 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:26.186793 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 417/822] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:42:26.187728 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a696ffc-4b5b-4bcd-ba35-b75cbb90b1b0 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:26.221939 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba3976-3f02-4efb-af1f-c0ce9d985135 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:26.241090 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:26.260613 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907819ad-77dc-4b44-8b62-9425cc148910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:26.261249 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907819ad-77dc-4b44-8b62-9425cc148910 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:26.261526 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907819ad-77dc-4b44-8b62-9425cc148910 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:26.261796 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907819ad-77dc-4b44-8b62-9425cc148910 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:26.275598 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907819ad-77dc-4b44-8b62-9425cc148910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:26.277875 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907819ad-77dc-4b44-8b62-9425cc148910 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:26.296789 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a696ffc-4b5b-4bcd-ba35-b75cbb90b1b0 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:26.297636 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-907819ad-77dc-4b44-8b62-9425cc148910 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:26.297636 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:26.297636 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:26.297636 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:26.297636 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:26.297636 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:26.297636 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:26.297636 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:26.297636 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:26.297636 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:26.297636 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:26.297636 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:26.297636 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:26.297636 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:26.297636 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:26.297636 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:26.298806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:26.298806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:26.298806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:26.298806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:26.298806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:26.298806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:26.298806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:26.298806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:26.298806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:26.298806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:26.298806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:26.298806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:26.298806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:26.298806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:26.298806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:26.298806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:26.298806 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:26.300158 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:26.300158 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:26.300158 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:26.300158 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 406/823] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:26.300158 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907819ad-77dc-4b44-8b62-9425cc148910 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:26.309088 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:26.339335 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4e290-b1b1-44bd-9d8d-9142aa6b6e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:26.340298 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4e290-b1b1-44bd-9d8d-9142aa6b6e78 None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:26.340871 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4e290-b1b1-44bd-9d8d-9142aa6b6e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:26.341340 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4e290-b1b1-44bd-9d8d-9142aa6b6e78 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:26.342631 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4e290-b1b1-44bd-9d8d-9142aa6b6e78 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:26.344439 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4e290-b1b1-44bd-9d8d-9142aa6b6e78 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:26.367850 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 418/824] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:42:26 2022] POST /identity/v3/endpoints => generated 337 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:42:26.369229 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4e290-b1b1-44bd-9d8d-9142aa6b6e78 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:26.423957 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907819ad-77dc-4b44-8b62-9425cc148910 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:26.473856 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9db90-4dda-4915-9023-f73c6b6f386d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:26.474479 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9db90-4dda-4915-9023-f73c6b6f386d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:26.474833 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9db90-4dda-4915-9023-f73c6b6f386d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:26.475101 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9db90-4dda-4915-9023-f73c6b6f386d None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:26.475748 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9db90-4dda-4915-9023-f73c6b6f386d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:26.476044 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9db90-4dda-4915-9023-f73c6b6f386d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:26.477789 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9db90-4dda-4915-9023-f73c6b6f386d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:26.491585 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4e290-b1b1-44bd-9d8d-9142aa6b6e78 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:26.503874 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 407/825] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:26.505784 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9db90-4dda-4915-9023-f73c6b6f386d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:26.542718 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecac31-2ab1-4fc9-a89d-f47739297700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:26.544372 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecac31-2ab1-4fc9-a89d-f47739297700 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:26.544881 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecac31-2ab1-4fc9-a89d-f47739297700 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:26.545447 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecac31-2ab1-4fc9-a89d-f47739297700 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:26.546399 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ecac31-2ab1-4fc9-a89d-f47739297700 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:26.546926 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ecac31-2ab1-4fc9-a89d-f47739297700 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:26.548523 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ecac31-2ab1-4fc9-a89d-f47739297700 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:26.562475 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:26.565255 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 419/826] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:26.571053 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecac31-2ab1-4fc9-a89d-f47739297700 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:26.600767 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:26.651380 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9db90-4dda-4915-9023-f73c6b6f386d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:26.691884 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecac31-2ab1-4fc9-a89d-f47739297700 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:26.703573 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e36741-1413-4cfd-bd7d-a29a460c1556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:26.704213 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e36741-1413-4cfd-bd7d-a29a460c1556 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:26.704488 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e36741-1413-4cfd-bd7d-a29a460c1556 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:26.704756 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e36741-1413-4cfd-bd7d-a29a460c1556 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:26.711992 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e36741-1413-4cfd-bd7d-a29a460c1556 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:26.713454 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e36741-1413-4cfd-bd7d-a29a460c1556 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:26.725081 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-51e36741-1413-4cfd-bd7d-a29a460c1556 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:26.725081 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:26.725081 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:26.725081 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:26.725081 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:26.725081 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:26.725081 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:26.725081 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:26.725081 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:26.725081 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:26.725081 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:26.725081 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:26.725081 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:42:26.725081 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:42:26.725081 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:42:26.726063 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:42:26.726063 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:26.726063 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:26.726063 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:26.726063 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:26.726063 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:26.726063 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:26.726063 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:26.726063 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:26.726063 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:26.726063 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:26.726063 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:26.726063 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:26.726063 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:26.726063 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:26.726063 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:26.726063 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:26.726958 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:42:26.726958 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:42:26.726958 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:42:26.726958 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:42:26.726958 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:42:26.726958 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:42:26.726958 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:26.726958 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:26.726958 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 408/827] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:42:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:26.727481 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e07e73-bc87-4baf-a926-47fce08765cb None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:26.728155 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e07e73-bc87-4baf-a926-47fce08765cb None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:26.728155 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e07e73-bc87-4baf-a926-47fce08765cb None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:26.729296 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 409/828] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:26.734352 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e07e73-bc87-4baf-a926-47fce08765cb None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:26.736433 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9bb6b-1097-4bb8-9b0d-5ec3715451ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:26.737280 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9bb6b-1097-4bb8-9b0d-5ec3715451ad None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:26.737562 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9bb6b-1097-4bb8-9b0d-5ec3715451ad None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:26.737857 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9bb6b-1097-4bb8-9b0d-5ec3715451ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:26.746493 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9bb6b-1097-4bb8-9b0d-5ec3715451ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:26.748357 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9bb6b-1097-4bb8-9b0d-5ec3715451ad None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:26.759713 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-4cd9bb6b-1097-4bb8-9b0d-5ec3715451ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:26.759713 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:26.759713 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:26.759713 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:26.759713 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:26.759713 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:26.759713 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:26.759713 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:26.759713 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:26.759713 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:26.759713 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:26.759713 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:26.759713 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:42:26.759713 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:42:26.759713 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:42:26.760659 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:42:26.760659 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:26.760659 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:26.760659 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:26.760659 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:26.760659 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:26.760659 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:26.760659 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:26.760659 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:26.760659 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:26.760659 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:26.760659 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:26.760659 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:26.760659 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:26.760659 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:26.760659 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:26.760659 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:26.761567 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:42:26.761567 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:42:26.761567 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:42:26.761567 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:42:26.761567 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:42:26.761567 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:42:26.761567 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:26.761567 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:26.761567 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 420/829] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:42:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:26.762111 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f03776-9feb-4aea-b620-3978ca5ca2aa None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:26.762697 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f03776-9feb-4aea-b620-3978ca5ca2aa None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:26.762697 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f03776-9feb-4aea-b620-3978ca5ca2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:26.784366 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-12f03776-9feb-4aea-b620-3978ca5ca2aa None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:26.785558 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-12f03776-9feb-4aea-b620-3978ca5ca2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:26.835833 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:26.851382 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e07e73-bc87-4baf-a926-47fce08765cb None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:26.859156 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 421/830] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:42:26.860275 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f03776-9feb-4aea-b620-3978ca5ca2aa None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:26.879342 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:26.893133 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e77816-5649-4aab-bb17-947e79a5daf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:26.893714 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e77816-5649-4aab-bb17-947e79a5daf7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:26.894023 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e77816-5649-4aab-bb17-947e79a5daf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:26.894294 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e77816-5649-4aab-bb17-947e79a5daf7 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:26.895061 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e77816-5649-4aab-bb17-947e79a5daf7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:26.895373 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e77816-5649-4aab-bb17-947e79a5daf7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:26.896881 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e77816-5649-4aab-bb17-947e79a5daf7 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:26.913804 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 410/831] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:42:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:26.914852 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e77816-5649-4aab-bb17-947e79a5daf7 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:26.984654 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f03776-9feb-4aea-b620-3978ca5ca2aa None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:27.020721 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b9b9c-3c01-4ca4-8952-750c700abede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:27.021331 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b9b9c-3c01-4ca4-8952-750c700abede None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:27.021611 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b9b9c-3c01-4ca4-8952-750c700abede None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:27.021902 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b9b9c-3c01-4ca4-8952-750c700abede None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:27.022603 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b9b9c-3c01-4ca4-8952-750c700abede None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:27.022917 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b9b9c-3c01-4ca4-8952-750c700abede None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:27.024522 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b9b9c-3c01-4ca4-8952-750c700abede None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:27.048485 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 422/832] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:42:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:27.050418 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b9b9c-3c01-4ca4-8952-750c700abede None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:27.065048 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e77816-5649-4aab-bb17-947e79a5daf7 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:27.111931 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab156b9a-0270-4f42-9731-0a155bd6aaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:27.113144 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab156b9a-0270-4f42-9731-0a155bd6aaf5 None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:27.113877 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab156b9a-0270-4f42-9731-0a155bd6aaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:27.114770 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab156b9a-0270-4f42-9731-0a155bd6aaf5 None admin] PATH_INFO: `/v3/projects/45c69e3e973c449895457bb610103a43/users/3302fdf33b5b4583a10e7c760c577cda/roles/ce8c7035b6004d2f84c02ebc4a05f17b` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:27.126757 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:27.136329 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab156b9a-0270-4f42-9731-0a155bd6aaf5 None admin] RBAC: Authorizing `identity:create_grant(project_id=45c69e3e973c449895457bb610103a43, user_id=3302fdf33b5b4583a10e7c760c577cda, role_id=ce8c7035b6004d2f84c02ebc4a05f17b)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:27.138776 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab156b9a-0270-4f42-9731-0a155bd6aaf5 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:27.143433 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:27.161931 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 411/833] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Aug 28 00:42:26 2022] PUT /identity/v3/projects/45c69e3e973c449895457bb610103a43/users/3302fdf33b5b4583a10e7c760c577cda/roles/ce8c7035b6004d2f84c02ebc4a05f17b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:42:27.161931 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab156b9a-0270-4f42-9731-0a155bd6aaf5 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:27.162193 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b9b9c-3c01-4ca4-8952-750c700abede None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:27.199123 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcaa2b9-3926-436f-bcb7-2df411db59e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:27.200543 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaa2b9-3926-436f-bcb7-2df411db59e3 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:27.201008 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaa2b9-3926-436f-bcb7-2df411db59e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:27.201487 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaa2b9-3926-436f-bcb7-2df411db59e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:27.202475 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcaa2b9-3926-436f-bcb7-2df411db59e3 None admin] RBAC: Adding query filter params (role.id=cc013581bb07418d9ec6a3a1d282ea53, scope.project.id=45c69e3e973c449895457bb610103a43, user.id=f890ff4e7807477db7f17c2f6434dce8) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:27.203002 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcaa2b9-3926-436f-bcb7-2df411db59e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:27.204784 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcaa2b9-3926-436f-bcb7-2df411db59e3 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:27.212293 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 423/834] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:42:27 2022] GET /identity/v3/role_assignments?user.id=f890ff4e7807477db7f17c2f6434dce8&scope.project.id=45c69e3e973c449895457bb610103a43&role.id=cc013581bb07418d9ec6a3a1d282ea53 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:27.298108 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab156b9a-0270-4f42-9731-0a155bd6aaf5 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:27.344400 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf29a1f-cb6c-4bc5-b24b-96e7dacbbafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:27.345366 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf29a1f-cb6c-4bc5-b24b-96e7dacbbafa None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:27.345642 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf29a1f-cb6c-4bc5-b24b-96e7dacbbafa None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:27.345932 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf29a1f-cb6c-4bc5-b24b-96e7dacbbafa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:27.358713 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf29a1f-cb6c-4bc5-b24b-96e7dacbbafa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:42:27.363884 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-4bf29a1f-cb6c-4bc5-b24b-96e7dacbbafa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:42:27.363884 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:27.363884 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:27.363884 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:27.363884 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:27.363884 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:27.363884 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:27.363884 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:27.363884 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:27.363884 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:27.363884 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:27.363884 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:27.363884 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:42:27.363884 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:42:27.363884 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:42:27.363884 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:42:27.364864 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:42:27.364864 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:42:27.364864 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:42:27.364864 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:42:27.364864 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:27.364864 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:27.364864 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:27.364864 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:27.364864 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:27.364864 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:27.364864 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:27.364864 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:27.364864 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:27.364864 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:27.364864 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:27.364864 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:27.366249 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:27.366249 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:27.366249 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:27.366249 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:27.366249 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:42:27.366249 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:42:27.366249 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:42:27.366249 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:42:27.366249 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:42:27.366249 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:42:27.366249 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:42:27.366249 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:27.366249 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 412/835] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:42:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:27.370965 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcaa2b9-3926-436f-bcb7-2df411db59e3 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:27.438976 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a61c5c-6a32-4156-8d57-7a88036785f1 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:27.439259 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a61c5c-6a32-4156-8d57-7a88036785f1 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:27.439517 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a61c5c-6a32-4156-8d57-7a88036785f1 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:27.441670 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 413/836] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:27.446647 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7525e-f169-4b46-83d3-9015adc23665 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:27.446921 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7525e-f169-4b46-83d3-9015adc23665 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:27.447191 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7525e-f169-4b46-83d3-9015adc23665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:27.466672 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-23e7525e-f169-4b46-83d3-9015adc23665 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:27.468022 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-23e7525e-f169-4b46-83d3-9015adc23665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:27.480588 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcaa2b9-3926-436f-bcb7-2df411db59e3 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:27.516783 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dedc14-3f83-42a5-9a7c-9588ea1dee21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:27.517388 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dedc14-3f83-42a5-9a7c-9588ea1dee21 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:27.517665 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dedc14-3f83-42a5-9a7c-9588ea1dee21 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:27.517961 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dedc14-3f83-42a5-9a7c-9588ea1dee21 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:27.518632 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dedc14-3f83-42a5-9a7c-9588ea1dee21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:27.518933 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dedc14-3f83-42a5-9a7c-9588ea1dee21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:27.520316 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dedc14-3f83-42a5-9a7c-9588ea1dee21 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:27.522746 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:27.526876 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:27.531584 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 424/837] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:42:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:27.537357 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dedc14-3f83-42a5-9a7c-9588ea1dee21 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:27.563062 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 414/838] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:42:27.651178 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dedc14-3f83-42a5-9a7c-9588ea1dee21 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:27.687767 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0b130-f890-44cb-bc81-57dd84e8b0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:27.688754 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0b130-f890-44cb-bc81-57dd84e8b0b7 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:27.689283 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0b130-f890-44cb-bc81-57dd84e8b0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:27.689754 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0b130-f890-44cb-bc81-57dd84e8b0b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:27.700543 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0b130-f890-44cb-bc81-57dd84e8b0b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:27.702377 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0b130-f890-44cb-bc81-57dd84e8b0b7 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:27.718030 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-0ea0b130-f890-44cb-bc81-57dd84e8b0b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:27.718030 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:27.718030 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:27.718030 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:27.718030 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:27.718030 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:27.718030 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:27.718030 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:27.718030 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:27.718030 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:27.718030 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:27.718030 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:27.718030 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:27.718030 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:27.718030 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:27.718030 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:27.719038 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:27.719038 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:27.719038 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:27.719038 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:27.719038 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:27.719038 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:27.719038 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:27.719038 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:27.719038 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:27.719038 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:27.719038 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:27.719038 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:27.719038 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:27.719038 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:27.719038 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:27.719038 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:27.719038 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:27.720339 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:27.720339 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:27.720339 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:27.722512 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 425/839] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:27.730573 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7525e-f169-4b46-83d3-9015adc23665 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:27.834642 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0b130-f890-44cb-bc81-57dd84e8b0b7 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:27.836439 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7525e-f169-4b46-83d3-9015adc23665 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:27.873098 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3cfa39-d47e-48b8-8ff5-bb2ff2a80247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:27.873926 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cfa39-d47e-48b8-8ff5-bb2ff2a80247 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:27.874045 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cfa39-d47e-48b8-8ff5-bb2ff2a80247 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:27.874263 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cfa39-d47e-48b8-8ff5-bb2ff2a80247 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:27.874913 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3cfa39-d47e-48b8-8ff5-bb2ff2a80247 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:27.875211 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3cfa39-d47e-48b8-8ff5-bb2ff2a80247 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:27.876638 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3cfa39-d47e-48b8-8ff5-bb2ff2a80247 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:27.892976 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 415/840] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:27.894344 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3cfa39-d47e-48b8-8ff5-bb2ff2a80247 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:27.900281 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:27.950266 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:27.973328 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0b130-f890-44cb-bc81-57dd84e8b0b7 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:28.009462 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3cfa39-d47e-48b8-8ff5-bb2ff2a80247 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:28.018736 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87129f-9aed-47be-895f-4cbd041c2796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:28.020063 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87129f-9aed-47be-895f-4cbd041c2796 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:28.020521 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87129f-9aed-47be-895f-4cbd041c2796 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:28.021385 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87129f-9aed-47be-895f-4cbd041c2796 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:28.022555 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87129f-9aed-47be-895f-4cbd041c2796 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:28.024363 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87129f-9aed-47be-895f-4cbd041c2796 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:28.037069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-ea87129f-9aed-47be-895f-4cbd041c2796 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:42:28.037069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:28.037069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:42:28.037069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:42:28.037069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:42:28.037069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:42:28.037069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:42:28.037069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:28.037069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:42:28.037069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:28.037069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:42:28.037069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:28.037069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:28.037069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:28.037069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:28.037069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:28.037069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:28.038140 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:28.038140 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:28.038140 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:28.038140 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:28.038140 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:28.038140 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:28.038140 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:42:28.038140 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:42:28.038140 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:42:28.038140 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:42:28.038140 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:28.038140 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:28.038140 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:28.038140 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:28.038140 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:28.038140 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:28.039003 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:28.039003 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:28.039003 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:28.039003 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:28.039003 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:28.039003 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:28.039003 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:28.039003 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:28.039003 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:28.039003 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:28.039003 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:42:28.039003 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:28.039003 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:42:28.039003 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:28.039777 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 426/841] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Aug 28 00:42:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:28.044794 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87129f-9aed-47be-895f-4cbd041c2796 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:28.053528 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fde17-52c7-4847-8bd5-51f540d4bf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:28.054315 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fde17-52c7-4847-8bd5-51f540d4bf23 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:28.054644 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fde17-52c7-4847-8bd5-51f540d4bf23 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:28.054919 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fde17-52c7-4847-8bd5-51f540d4bf23 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:28.064445 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3fde17-52c7-4847-8bd5-51f540d4bf23 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:28.065942 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3fde17-52c7-4847-8bd5-51f540d4bf23 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:28.078141 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-4a3fde17-52c7-4847-8bd5-51f540d4bf23 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:42:28.078141 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:28.078141 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:28.078141 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:28.078141 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:28.078141 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:28.078141 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:28.078141 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:28.078141 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:28.078141 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:28.078141 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:28.078141 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:28.078141 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:42:28.078141 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:42:28.078141 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:42:28.078141 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:42:28.079116 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:28.079116 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:28.079116 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:42:28.079116 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:28.079116 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:42:28.079116 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:28.079116 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:28.079116 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:28.079116 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:28.079116 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:28.079116 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:28.079116 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:28.079116 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:28.079116 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:28.079116 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:28.079116 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:28.079116 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:28.079116 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:28.080071 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:28.080071 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:28.080071 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:42:28.080071 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:42:28.080071 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:42:28.080071 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:42:28.080071 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:42:28.080071 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:42:28.080071 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:42:28.080071 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:28.084075 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 416/842] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:42:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:28.085318 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fde17-52c7-4847-8bd5-51f540d4bf23 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:28.165743 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87129f-9aed-47be-895f-4cbd041c2796 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:28.180413 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:28.205626 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfb255-83c6-42f5-84f2-15e3163c912e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:28.206258 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfb255-83c6-42f5-84f2-15e3163c912e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:28.206468 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfb255-83c6-42f5-84f2-15e3163c912e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:28.206731 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfb255-83c6-42f5-84f2-15e3163c912e None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:28.207749 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfb255-83c6-42f5-84f2-15e3163c912e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:28.208072 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfb255-83c6-42f5-84f2-15e3163c912e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:28.209793 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfb255-83c6-42f5-84f2-15e3163c912e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:28.211350 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fde17-52c7-4847-8bd5-51f540d4bf23 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:28.220719 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 427/843] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Aug 28 00:42:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:42:28.221944 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfb255-83c6-42f5-84f2-15e3163c912e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:28.224016 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:28.258884 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11090c-dffa-4de7-9403-3a5741cca044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:28.260125 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11090c-dffa-4de7-9403-3a5741cca044 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:28.261008 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11090c-dffa-4de7-9403-3a5741cca044 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:28.261750 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11090c-dffa-4de7-9403-3a5741cca044 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:28.262949 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11090c-dffa-4de7-9403-3a5741cca044 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:28.263928 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11090c-dffa-4de7-9403-3a5741cca044 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:28.266007 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11090c-dffa-4de7-9403-3a5741cca044 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:28.289920 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 417/844] 10.222.0.52 () {56 vars in 1135 bytes} [Sun Aug 28 00:42:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:28.298814 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11090c-dffa-4de7-9403-3a5741cca044 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:28.345916 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfb255-83c6-42f5-84f2-15e3163c912e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:28.382483 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6934ac2-03d7-43a4-a1ad-c988713a5723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:28.383507 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6934ac2-03d7-43a4-a1ad-c988713a5723 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:28.384039 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6934ac2-03d7-43a4-a1ad-c988713a5723 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:28.384591 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6934ac2-03d7-43a4-a1ad-c988713a5723 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:28.385442 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6934ac2-03d7-43a4-a1ad-c988713a5723 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:28.385972 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6934ac2-03d7-43a4-a1ad-c988713a5723 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:28.387669 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6934ac2-03d7-43a4-a1ad-c988713a5723 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:28.393576 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 428/845] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Aug 28 00:42:28 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:28.403321 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11090c-dffa-4de7-9403-3a5741cca044 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:28.443230 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8c100-75d8-4f2b-b248-abe9918f5c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:28.443864 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8c100-75d8-4f2b-b248-abe9918f5c52 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:28.444141 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8c100-75d8-4f2b-b248-abe9918f5c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:28.444411 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8c100-75d8-4f2b-b248-abe9918f5c52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:28.482235 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:28.523547 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8c100-75d8-4f2b-b248-abe9918f5c52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:28.525026 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8c100-75d8-4f2b-b248-abe9918f5c52 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:28.629411 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 418/846] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:42:28 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:42:28.634983 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6934ac2-03d7-43a4-a1ad-c988713a5723 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:28.682891 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:28.740952 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6934ac2-03d7-43a4-a1ad-c988713a5723 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:28.775223 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0baa76-ad1f-4b49-9d87-ea9e70901baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:28.775854 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0baa76-ad1f-4b49-9d87-ea9e70901baf None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:28.776130 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0baa76-ad1f-4b49-9d87-ea9e70901baf None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:28.776402 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0baa76-ad1f-4b49-9d87-ea9e70901baf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:28.787526 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0baa76-ad1f-4b49-9d87-ea9e70901baf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:28.788988 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0baa76-ad1f-4b49-9d87-ea9e70901baf None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:28.803616 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-3d0baa76-ad1f-4b49-9d87-ea9e70901baf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:28.803616 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:28.803616 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:28.803616 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:28.803616 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:28.803616 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:28.803616 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:28.803616 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:28.803616 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:28.803616 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:28.803616 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:28.803616 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:28.803616 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:28.803616 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:28.803616 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:28.803616 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:28.804590 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:28.804590 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:28.804590 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:28.804590 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:28.804590 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:28.804590 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:28.804590 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:28.804590 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:28.804590 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:28.804590 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:28.804590 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:28.804590 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:28.804590 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:28.804590 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:28.804590 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:28.804590 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:28.804590 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:28.805464 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:28.805464 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:28.805464 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:28.805464 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 429/847] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:28.810765 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8c100-75d8-4f2b-b248-abe9918f5c52 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:28.876076 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:28.916222 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8c100-75d8-4f2b-b248-abe9918f5c52 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:28.951946 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b09bab-16c8-4bc4-a308-81a9209d9db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:28.952772 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b09bab-16c8-4bc4-a308-81a9209d9db3 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:28.953206 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b09bab-16c8-4bc4-a308-81a9209d9db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:28.953537 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b09bab-16c8-4bc4-a308-81a9209d9db3 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:28.954231 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b09bab-16c8-4bc4-a308-81a9209d9db3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:28.954539 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b09bab-16c8-4bc4-a308-81a9209d9db3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:28.956619 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b09bab-16c8-4bc4-a308-81a9209d9db3 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:28.975821 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 419/848] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:28.978916 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0baa76-ad1f-4b49-9d87-ea9e70901baf None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:29.077029 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:29.084875 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0baa76-ad1f-4b49-9d87-ea9e70901baf None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:29.123910 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af8b7c-7401-45ab-8b51-95feaa44ee4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:29.124547 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af8b7c-7401-45ab-8b51-95feaa44ee4e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:29.124826 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af8b7c-7401-45ab-8b51-95feaa44ee4e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:29.125102 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af8b7c-7401-45ab-8b51-95feaa44ee4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:29.132010 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af8b7c-7401-45ab-8b51-95feaa44ee4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:29.133466 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af8b7c-7401-45ab-8b51-95feaa44ee4e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:29.144986 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-f1af8b7c-7401-45ab-8b51-95feaa44ee4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:29.144986 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:29.144986 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:29.144986 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:29.144986 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:29.144986 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:29.144986 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:29.144986 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:29.144986 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:29.144986 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:29.144986 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:29.144986 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:29.144986 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:42:29.144986 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:42:29.144986 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:42:29.145871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:42:29.145871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:29.145871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:29.145871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:29.145871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:29.145871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:29.145871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:29.145871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:29.145871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:29.145871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:29.145871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:29.145871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:29.145871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:29.145871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:29.145871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:29.145871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:29.145871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:29.146851 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:42:29.146851 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:42:29.146851 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:42:29.146851 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:42:29.146851 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:42:29.146851 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:42:29.146851 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:29.146851 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:29.146851 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 430/849] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:42:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:29.152102 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b09bab-16c8-4bc4-a308-81a9209d9db3 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:29.243225 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c49c0-ae08-4e17-9dd8-083ca58c200a None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:29.243757 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c49c0-ae08-4e17-9dd8-083ca58c200a None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:29.243757 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c49c0-ae08-4e17-9dd8-083ca58c200a None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:29.249888 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 431/850] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:29.252334 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b4ed8-33a7-49ad-b849-74c108b85af3 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:29.252713 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b4ed8-33a7-49ad-b849-74c108b85af3 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:29.253083 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b4ed8-33a7-49ad-b849-74c108b85af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:29.271410 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b09bab-16c8-4bc4-a308-81a9209d9db3 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:29.276551 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-9f6b4ed8-33a7-49ad-b849-74c108b85af3 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:29.278018 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9f6b4ed8-33a7-49ad-b849-74c108b85af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:29.297405 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:29.310084 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f8da1-4500-4790-8271-c2923c4684ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:29.310573 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f8da1-4500-4790-8271-c2923c4684ad None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:29.310930 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f8da1-4500-4790-8271-c2923c4684ad None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:29.311454 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f8da1-4500-4790-8271-c2923c4684ad None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:29.311918 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f8da1-4500-4790-8271-c2923c4684ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:29.312220 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f8da1-4500-4790-8271-c2923c4684ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:29.313664 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f8da1-4500-4790-8271-c2923c4684ad None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:29.332449 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 420/851] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:42:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:29.333695 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f8da1-4500-4790-8271-c2923c4684ad None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:29.373866 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 432/852] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:42:29.373866 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a20231-c41a-4453-9dcb-7625194a8c47 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:29.373866 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a20231-c41a-4453-9dcb-7625194a8c47 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:29.373866 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a20231-c41a-4453-9dcb-7625194a8c47 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:29.373866 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 433/853] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:29.375313 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef680c6-def4-4f4b-a93a-f8533f0d9504 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:29.375595 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef680c6-def4-4f4b-a93a-f8533f0d9504 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:29.375865 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef680c6-def4-4f4b-a93a-f8533f0d9504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:29.394437 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-bef680c6-def4-4f4b-a93a-f8533f0d9504 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:29.395652 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-bef680c6-def4-4f4b-a93a-f8533f0d9504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:29.457007 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f8da1-4500-4790-8271-c2923c4684ad None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:29.478860 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 434/854] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:42:29.497142 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9615c-188a-4ed9-a39e-ed9c231a1663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:29.498240 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9615c-188a-4ed9-a39e-ed9c231a1663 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:29.498760 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9615c-188a-4ed9-a39e-ed9c231a1663 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:29.499344 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9615c-188a-4ed9-a39e-ed9c231a1663 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:29.500255 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c9615c-188a-4ed9-a39e-ed9c231a1663 None admin] RBAC: Adding query filter params (role.id=cc013581bb07418d9ec6a3a1d282ea53, scope.project.id=45c69e3e973c449895457bb610103a43, user.id=a80a6019cf424c16a1d461a632cf8568) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:29.500713 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c9615c-188a-4ed9-a39e-ed9c231a1663 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:29.502379 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c9615c-188a-4ed9-a39e-ed9c231a1663 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:29.509690 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 421/855] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:42:29 2022] GET /identity/v3/role_assignments?user.id=a80a6019cf424c16a1d461a632cf8568&scope.project.id=45c69e3e973c449895457bb610103a43&role.id=cc013581bb07418d9ec6a3a1d282ea53 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:29.657113 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef680c6-def4-4f4b-a93a-f8533f0d9504 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:29.673539 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:29.768009 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef680c6-def4-4f4b-a93a-f8533f0d9504 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:29.778630 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9615c-188a-4ed9-a39e-ed9c231a1663 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:29.805425 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f627d-3c3b-4470-9fd1-471b512c59a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:29.806715 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f627d-3c3b-4470-9fd1-471b512c59a3 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:29.807391 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f627d-3c3b-4470-9fd1-471b512c59a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:29.807828 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f627d-3c3b-4470-9fd1-471b512c59a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:29.819713 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f627d-3c3b-4470-9fd1-471b512c59a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:42:29.824519 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-a81f627d-3c3b-4470-9fd1-471b512c59a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:42:29.824519 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:29.824519 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:29.824519 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:29.824519 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:29.824519 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:29.824519 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:29.824519 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:29.824519 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:29.824519 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:29.824519 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:29.824519 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:29.824519 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:42:29.824519 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:42:29.824519 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:42:29.824519 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:42:29.825446 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:42:29.825446 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:42:29.825446 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:42:29.825446 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:42:29.825446 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:29.825446 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:29.825446 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:29.825446 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:29.825446 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:29.825446 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:29.825446 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:29.825446 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:29.825446 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:29.825446 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:29.825446 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:29.825446 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:29.827375 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:29.827375 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:29.827375 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:29.827375 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:29.827375 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:42:29.827375 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:42:29.827375 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:42:29.827375 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:42:29.827375 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:42:29.827375 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:42:29.827375 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:42:29.827375 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:29.827375 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 435/856] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Aug 28 00:42:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:29.838484 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:29.838985 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f627d-3c3b-4470-9fd1-471b512c59a3 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:29.898201 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9615c-188a-4ed9-a39e-ed9c231a1663 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:29.922513 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:29.934270 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f150bd9-3507-4727-840b-1158b95dda41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:29.935142 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f150bd9-3507-4727-840b-1158b95dda41 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:29.935874 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f150bd9-3507-4727-840b-1158b95dda41 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:29.936414 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f150bd9-3507-4727-840b-1158b95dda41 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:29.937348 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f150bd9-3507-4727-840b-1158b95dda41 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:29.939022 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f150bd9-3507-4727-840b-1158b95dda41 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:29.948606 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-8f150bd9-3507-4727-840b-1158b95dda41 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:42:29.948606 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:29.948606 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:42:29.948606 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:42:29.948606 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:42:29.948606 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:42:29.948606 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:42:29.948606 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:29.948606 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:42:29.948606 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:29.948606 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:42:29.948606 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:29.948606 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:29.948606 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:29.948606 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:29.948606 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:29.949574 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:29.949574 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:29.949574 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:29.949574 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:29.949574 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:29.949574 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:29.949574 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:29.949574 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:42:29.949574 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:42:29.949574 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:42:29.949574 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:42:29.949574 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:29.949574 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:29.949574 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:29.949574 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:29.949574 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:29.949574 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:29.950511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:29.950511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:29.950511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:29.950511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:29.950511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:29.950511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:29.950511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:29.950511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:29.950511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:29.950511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:29.950511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:42:29.950511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:29.950511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:42:29.950511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:29.951351 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f627d-3c3b-4470-9fd1-471b512c59a3 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:29.953646 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 422/857] 10.222.0.52 () {56 vars in 1132 bytes} [Sun Aug 28 00:42:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:42:29.959013 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f150bd9-3507-4727-840b-1158b95dda41 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:29.988873 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c96c5a-a2a2-4ce8-bf89-e538187ded14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:29.989492 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c96c5a-a2a2-4ce8-bf89-e538187ded14 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:29.989772 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c96c5a-a2a2-4ce8-bf89-e538187ded14 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:29.990112 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c96c5a-a2a2-4ce8-bf89-e538187ded14 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:29.990741 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c96c5a-a2a2-4ce8-bf89-e538187ded14 None admin] RBAC: Adding query filter params (name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:29.991044 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c96c5a-a2a2-4ce8-bf89-e538187ded14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:29.992537 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c96c5a-a2a2-4ce8-bf89-e538187ded14 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:30.008615 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 436/858] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Aug 28 00:42:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:30.009654 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c96c5a-a2a2-4ce8-bf89-e538187ded14 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:30.065366 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f150bd9-3507-4727-840b-1158b95dda41 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:30.088934 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:30.102237 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c88295-d82c-4275-a75a-36387f3715a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:30.103190 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c88295-d82c-4275-a75a-36387f3715a4 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:30.103732 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c88295-d82c-4275-a75a-36387f3715a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:30.104191 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c88295-d82c-4275-a75a-36387f3715a4 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:30.105013 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c88295-d82c-4275-a75a-36387f3715a4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:30.105527 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c88295-d82c-4275-a75a-36387f3715a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:30.107188 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c88295-d82c-4275-a75a-36387f3715a4 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:30.114510 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 423/859] 10.222.0.52 () {56 vars in 1126 bytes} [Sun Aug 28 00:42:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:30.120874 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c88295-d82c-4275-a75a-36387f3715a4 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:30.128621 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c96c5a-a2a2-4ce8-bf89-e538187ded14 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:30.171992 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc9da4-4efa-4c10-a04d-93a2a8825363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:30.173048 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc9da4-4efa-4c10-a04d-93a2a8825363 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:30.173519 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc9da4-4efa-4c10-a04d-93a2a8825363 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:30.174032 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc9da4-4efa-4c10-a04d-93a2a8825363 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:30.177322 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:30.187310 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc9da4-4efa-4c10-a04d-93a2a8825363 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:30.189100 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc9da4-4efa-4c10-a04d-93a2a8825363 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:30.204187 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-18fc9da4-4efa-4c10-a04d-93a2a8825363 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:30.204187 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:30.204187 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:30.204187 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:30.204187 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:30.204187 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:30.204187 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:30.204187 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:30.204187 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:30.204187 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:30.204187 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:30.204187 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:30.204187 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:30.204187 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:30.204187 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:30.204187 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:30.205183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:30.205183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:30.205183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:30.205183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:30.205183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:30.205183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:30.205183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:30.205183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:30.205183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:30.205183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:30.205183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:30.205183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:30.205183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:30.205183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:30.205183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:30.205183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:30.205183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:30.206489 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:30.206489 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:30.206489 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:30.208293 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 437/860] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:30.213961 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc9da4-4efa-4c10-a04d-93a2a8825363 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:30.253532 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c88295-d82c-4275-a75a-36387f3715a4 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:30.296541 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a439e6-b636-47e2-95ac-2368f7289640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:30.297520 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a439e6-b636-47e2-95ac-2368f7289640 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:30.298051 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a439e6-b636-47e2-95ac-2368f7289640 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:30.298510 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a439e6-b636-47e2-95ac-2368f7289640 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:30.299379 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a439e6-b636-47e2-95ac-2368f7289640 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:30.299915 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a439e6-b636-47e2-95ac-2368f7289640 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:30.301537 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a439e6-b636-47e2-95ac-2368f7289640 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:30.306965 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 424/861] 10.222.0.52 () {56 vars in 1126 bytes} [Sun Aug 28 00:42:30 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:42:30.336647 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc9da4-4efa-4c10-a04d-93a2a8825363 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:30.339986 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f4123-db68-4224-b98b-4176f6eac7df None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:30.340276 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f4123-db68-4224-b98b-4176f6eac7df None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:30.340548 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f4123-db68-4224-b98b-4176f6eac7df None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:30.346182 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 425/862] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:42:30.353532 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75a8d9-b764-492b-826d-9fb705cc9bae None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:30.353831 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75a8d9-b764-492b-826d-9fb705cc9bae None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:30.354117 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75a8d9-b764-492b-826d-9fb705cc9bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:30.381215 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-6b75a8d9-b764-492b-826d-9fb705cc9bae None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:30.382807 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cc541-deae-4b3e-8a5d-3373021e0374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:30.383247 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6b75a8d9-b764-492b-826d-9fb705cc9bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:30.383427 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cc541-deae-4b3e-8a5d-3373021e0374 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:30.383706 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cc541-deae-4b3e-8a5d-3373021e0374 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:30.384024 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cc541-deae-4b3e-8a5d-3373021e0374 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:30.384685 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6cc541-deae-4b3e-8a5d-3373021e0374 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:30.384994 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6cc541-deae-4b3e-8a5d-3373021e0374 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:30.386493 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6cc541-deae-4b3e-8a5d-3373021e0374 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:30.406643 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 438/863] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:30.410929 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cc541-deae-4b3e-8a5d-3373021e0374 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:30.432458 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:30.481868 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 426/864] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:42:30.484088 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:30.545004 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cc541-deae-4b3e-8a5d-3373021e0374 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:30.582410 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b16137-0550-44d9-9dec-cac8a3bc42c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:30.583094 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b16137-0550-44d9-9dec-cac8a3bc42c3 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:30.583369 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b16137-0550-44d9-9dec-cac8a3bc42c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:30.583641 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b16137-0550-44d9-9dec-cac8a3bc42c3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:30.591152 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b16137-0550-44d9-9dec-cac8a3bc42c3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:30.593312 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b16137-0550-44d9-9dec-cac8a3bc42c3 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:30.605922 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-22b16137-0550-44d9-9dec-cac8a3bc42c3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:42:30.605922 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:30.605922 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:30.605922 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:30.605922 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:30.605922 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:30.605922 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:30.605922 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:30.605922 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:30.605922 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:30.605922 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:30.605922 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:30.605922 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:42:30.605922 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:42:30.605922 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:42:30.605922 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:42:30.606892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:30.606892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:30.606892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:42:30.606892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:30.606892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:42:30.606892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:30.606892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:30.606892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:30.606892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:30.606892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:30.606892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:30.606892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:30.606892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:30.606892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:30.606892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:30.606892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:30.606892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:30.606892 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:30.608018 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:30.608018 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:30.608018 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:42:30.608018 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:42:30.608018 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:42:30.608018 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:42:30.608018 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:42:30.608018 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:42:30.608018 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:42:30.608018 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:30.608018 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 439/865] 10.222.0.52 () {56 vars in 1117 bytes} [Sun Aug 28 00:42:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:42:30.613220 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75a8d9-b764-492b-826d-9fb705cc9bae None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:30.721089 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75a8d9-b764-492b-826d-9fb705cc9bae None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:30.759219 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95157295-1330-4387-b795-a9e4d84752e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:30.759583 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b16137-0550-44d9-9dec-cac8a3bc42c3 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:30.759927 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95157295-1330-4387-b795-a9e4d84752e1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:30.760145 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95157295-1330-4387-b795-a9e4d84752e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:30.760414 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95157295-1330-4387-b795-a9e4d84752e1 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:30.761147 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95157295-1330-4387-b795-a9e4d84752e1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:30.761452 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95157295-1330-4387-b795-a9e4d84752e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:30.762914 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95157295-1330-4387-b795-a9e4d84752e1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:30.787262 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 427/866] 10.222.0.52 () {56 vars in 1149 bytes} [Sun Aug 28 00:42:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:30.792462 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95157295-1330-4387-b795-a9e4d84752e1 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:30.822554 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:30.887552 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b16137-0550-44d9-9dec-cac8a3bc42c3 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:30.899789 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:30.901537 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95157295-1330-4387-b795-a9e4d84752e1 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:30.931360 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2346e3-39e8-4d75-9183-75483c3dae4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:30.932124 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2346e3-39e8-4d75-9183-75483c3dae4e None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:30.932407 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2346e3-39e8-4d75-9183-75483c3dae4e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:30.932685 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2346e3-39e8-4d75-9183-75483c3dae4e None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:30.933661 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2346e3-39e8-4d75-9183-75483c3dae4e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:30.935331 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2346e3-39e8-4d75-9183-75483c3dae4e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:30.942078 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9a728-9f73-47c0-93f2-a0901e8ec16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:30.942829 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9a728-9f73-47c0-93f2-a0901e8ec16f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:30.943179 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9a728-9f73-47c0-93f2-a0901e8ec16f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:30.943522 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9a728-9f73-47c0-93f2-a0901e8ec16f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:30.954911 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 440/867] 10.222.0.52 () {60 vars in 1141 bytes} [Sun Aug 28 00:42:30 2022] POST /identity/v3/services => generated 251 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:42:31.032505 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9a728-9f73-47c0-93f2-a0901e8ec16f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:31.034362 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9a728-9f73-47c0-93f2-a0901e8ec16f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:31.068729 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:31.153999 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 428/868] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:42:30 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 28 00:42:31.160100 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2346e3-39e8-4d75-9183-75483c3dae4e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:31.279086 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2346e3-39e8-4d75-9183-75483c3dae4e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:31.315788 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a28a3-e04e-4450-812b-0b25fc21677d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:31.316733 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a28a3-e04e-4450-812b-0b25fc21677d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:31.317187 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a28a3-e04e-4450-812b-0b25fc21677d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:31.317626 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a28a3-e04e-4450-812b-0b25fc21677d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:31.330516 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a28a3-e04e-4450-812b-0b25fc21677d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:31.332260 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a28a3-e04e-4450-812b-0b25fc21677d None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:31.348306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-453a28a3-e04e-4450-812b-0b25fc21677d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:31.348306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:31.348306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:31.348306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:31.348306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:31.348306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:31.348306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:31.348306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:31.348306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:31.348306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:31.348306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:31.348306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:31.348306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:31.348306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:31.348306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:31.348306 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:31.349718 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:31.349718 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:31.349718 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:31.349718 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:31.349718 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:31.349718 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:31.349718 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:31.349718 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:31.349718 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:31.349718 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:31.349718 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:31.349718 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:31.349718 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:31.349718 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:31.349718 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:31.349718 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:31.349718 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:31.350699 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:31.350699 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:31.350699 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:31.352513 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 441/869] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:42:31.359192 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9a728-9f73-47c0-93f2-a0901e8ec16f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:31.469580 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9a728-9f73-47c0-93f2-a0901e8ec16f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:31.499175 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:31.508594 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b10931-de9b-4f35-80d5-4696502e1885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:31.509487 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b10931-de9b-4f35-80d5-4696502e1885 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:31.510000 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b10931-de9b-4f35-80d5-4696502e1885 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:31.510491 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b10931-de9b-4f35-80d5-4696502e1885 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:31.511352 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b10931-de9b-4f35-80d5-4696502e1885 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:31.511844 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b10931-de9b-4f35-80d5-4696502e1885 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:31.513607 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b10931-de9b-4f35-80d5-4696502e1885 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:31.529866 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 429/870] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:31.534461 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a28a3-e04e-4450-812b-0b25fc21677d None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:31.559936 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:31.581552 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4477d86-2eac-41bf-8055-ca397bcd8780 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:31.582203 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4477d86-2eac-41bf-8055-ca397bcd8780 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:31.582672 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4477d86-2eac-41bf-8055-ca397bcd8780 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:31.584499 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 430/871] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:42:31.589361 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36953a4-4b76-481e-87bd-2cdd1425a4a9 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:31.589891 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36953a4-4b76-481e-87bd-2cdd1425a4a9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:31.590361 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36953a4-4b76-481e-87bd-2cdd1425a4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:31.610405 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e36953a4-4b76-481e-87bd-2cdd1425a4a9 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:31.611904 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e36953a4-4b76-481e-87bd-2cdd1425a4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:31.645614 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a28a3-e04e-4450-812b-0b25fc21677d None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:31.679654 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c878a-6138-4f43-b27a-2f94e05d8493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:31.680273 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c878a-6138-4f43-b27a-2f94e05d8493 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:31.680545 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c878a-6138-4f43-b27a-2f94e05d8493 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:31.680811 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c878a-6138-4f43-b27a-2f94e05d8493 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:31.681422 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 431/872] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:31 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:42:31.695258 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c878a-6138-4f43-b27a-2f94e05d8493 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:31.697091 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c878a-6138-4f43-b27a-2f94e05d8493 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:31.708795 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-754c878a-6138-4f43-b27a-2f94e05d8493 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:31.708795 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:31.708795 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:31.708795 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:31.708795 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:31.708795 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:31.708795 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:31.708795 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:31.708795 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:31.708795 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:31.708795 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:31.708795 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:31.708795 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:42:31.708795 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:42:31.708795 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:42:31.709735 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:42:31.709735 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:31.709735 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:31.709735 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:31.709735 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:31.709735 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:31.709735 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:31.709735 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:31.709735 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:31.709735 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:31.709735 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:31.709735 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:31.709735 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:31.709735 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:31.709735 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:31.709735 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:31.709735 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:31.710764 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:42:31.710764 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:42:31.710764 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:42:31.710764 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:42:31.710764 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:42:31.710764 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:42:31.710764 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:31.710764 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:31.711651 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 442/873] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:42:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:42:31.719055 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36953a4-4b76-481e-87bd-2cdd1425a4a9 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:31.820432 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36953a4-4b76-481e-87bd-2cdd1425a4a9 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:31.838782 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:31.856448 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340feea-2ec4-45dd-aec6-1cdd70c4ff8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:31.857059 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340feea-2ec4-45dd-aec6-1cdd70c4ff8b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:31.857507 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340feea-2ec4-45dd-aec6-1cdd70c4ff8b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:31.857780 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340feea-2ec4-45dd-aec6-1cdd70c4ff8b None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:31.858687 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a340feea-2ec4-45dd-aec6-1cdd70c4ff8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:31.859048 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a340feea-2ec4-45dd-aec6-1cdd70c4ff8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:31.860580 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a340feea-2ec4-45dd-aec6-1cdd70c4ff8b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:31.873111 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 432/874] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:42:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:31.882918 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c878a-6138-4f43-b27a-2f94e05d8493 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:31.961891 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:31.981921 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340feea-2ec4-45dd-aec6-1cdd70c4ff8b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:31.988777 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c878a-6138-4f43-b27a-2f94e05d8493 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:32.025779 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1b3a0-49c3-48a8-b433-4222da9eb2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:32.026410 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1b3a0-49c3-48a8-b433-4222da9eb2e1 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:32.026695 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1b3a0-49c3-48a8-b433-4222da9eb2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:32.027280 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1b3a0-49c3-48a8-b433-4222da9eb2e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:32.027778 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd1b3a0-49c3-48a8-b433-4222da9eb2e1 None admin] RBAC: Adding query filter params (role.id=ce8c7035b6004d2f84c02ebc4a05f17b, scope.project.id=45c69e3e973c449895457bb610103a43, user.id=3302fdf33b5b4583a10e7c760c577cda) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:32.028083 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd1b3a0-49c3-48a8-b433-4222da9eb2e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:32.029860 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd1b3a0-49c3-48a8-b433-4222da9eb2e1 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:32.037874 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 443/875] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:42:31 2022] GET /identity/v3/role_assignments?user.id=3302fdf33b5b4583a10e7c760c577cda&scope.project.id=45c69e3e973c449895457bb610103a43&role.id=ce8c7035b6004d2f84c02ebc4a05f17b => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:32.103283 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340feea-2ec4-45dd-aec6-1cdd70c4ff8b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:32.142483 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025a8a5-4fd7-44d0-8b36-521834bcea2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:32.143131 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025a8a5-4fd7-44d0-8b36-521834bcea2c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:32.143408 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025a8a5-4fd7-44d0-8b36-521834bcea2c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:32.143677 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025a8a5-4fd7-44d0-8b36-521834bcea2c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:32.144268 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025a8a5-4fd7-44d0-8b36-521834bcea2c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:32.145658 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025a8a5-4fd7-44d0-8b36-521834bcea2c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:32.156024 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-4025a8a5-4fd7-44d0-8b36-521834bcea2c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:42:32.156024 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:32.156024 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:42:32.156024 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:42:32.156024 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:42:32.156024 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:42:32.156024 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:42:32.156024 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:32.156024 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:42:32.156024 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:32.156024 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:42:32.156024 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:32.156024 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:32.156024 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:32.156024 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:32.156024 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:32.156024 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:32.157090 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:32.157090 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:32.157090 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:32.157090 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:32.157090 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:32.157090 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:32.157090 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:42:32.157090 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:42:32.157090 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:42:32.157090 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:42:32.157090 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:32.157090 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:32.157090 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:32.157090 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:32.157090 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:32.157090 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:32.158414 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:32.158414 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:32.158414 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:32.158414 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:32.158414 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:32.158414 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:32.158414 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:32.158414 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:32.158414 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:32.158414 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:32.158414 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:42:32.158414 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:32.158414 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:42:32.158414 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:32.158414 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 433/876] 10.222.0.52 () {56 vars in 1126 bytes} [Sun Aug 28 00:42:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:32.164131 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1b3a0-49c3-48a8-b433-4222da9eb2e1 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:32.268691 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1b3a0-49c3-48a8-b433-4222da9eb2e1 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:32.303005 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e375fdf-4943-4be7-85a8-b74e031781bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:32.303601 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e375fdf-4943-4be7-85a8-b74e031781bb None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:32.303929 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e375fdf-4943-4be7-85a8-b74e031781bb None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:32.304204 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e375fdf-4943-4be7-85a8-b74e031781bb None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:32.304829 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e375fdf-4943-4be7-85a8-b74e031781bb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:32.305130 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e375fdf-4943-4be7-85a8-b74e031781bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:32.306546 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e375fdf-4943-4be7-85a8-b74e031781bb None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:32.311743 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 444/877] 10.222.0.52 () {56 vars in 1122 bytes} [Sun Aug 28 00:42:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:32.317551 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025a8a5-4fd7-44d0-8b36-521834bcea2c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:32.319548 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2eae8a-ab23-4631-a16a-052838694dbe None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:32.319830 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2eae8a-ab23-4631-a16a-052838694dbe None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:32.320101 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2eae8a-ab23-4631-a16a-052838694dbe None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:32.321636 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 445/878] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:42:32.326659 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55504d4-2a6e-4ab2-a7d9-a379d30006c8 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:32.326945 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55504d4-2a6e-4ab2-a7d9-a379d30006c8 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:32.327219 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55504d4-2a6e-4ab2-a7d9-a379d30006c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:32.339050 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:32.351779 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-c55504d4-2a6e-4ab2-a7d9-a379d30006c8 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:32.353111 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c55504d4-2a6e-4ab2-a7d9-a379d30006c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:32.374897 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:32.433890 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 446/879] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:32 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:42:32.454071 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025a8a5-4fd7-44d0-8b36-521834bcea2c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:32.489802 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162754c-aff9-40a2-8110-1efd93182584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:32.490438 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162754c-aff9-40a2-8110-1efd93182584 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:32.490719 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162754c-aff9-40a2-8110-1efd93182584 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:32.490989 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162754c-aff9-40a2-8110-1efd93182584 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:32.491618 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162754c-aff9-40a2-8110-1efd93182584 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:32.491916 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162754c-aff9-40a2-8110-1efd93182584 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:32.493296 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162754c-aff9-40a2-8110-1efd93182584 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:32.499967 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 434/880] 10.222.0.52 () {56 vars in 1122 bytes} [Sun Aug 28 00:42:32 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:32.718242 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55504d4-2a6e-4ab2-a7d9-a379d30006c8 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:32.819791 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55504d4-2a6e-4ab2-a7d9-a379d30006c8 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:32.858693 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3f10d-de34-4314-a73a-05ec925e335c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:32.859129 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3f10d-de34-4314-a73a-05ec925e335c None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:32.859407 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3f10d-de34-4314-a73a-05ec925e335c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:32.859683 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3f10d-de34-4314-a73a-05ec925e335c None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:32.860349 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3f10d-de34-4314-a73a-05ec925e335c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:32.861742 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3f10d-de34-4314-a73a-05ec925e335c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:32.867755 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:32.882172 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 447/881] 10.222.0.52 () {60 vars in 1141 bytes} [Sun Aug 28 00:42:32 2022] POST /identity/v3/services => generated 269 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:42:33.091454 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a1ce2-0944-4cb2-9b3a-d9478b3a8a51 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:33.092036 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a1ce2-0944-4cb2-9b3a-d9478b3a8a51 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:33.092036 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a1ce2-0944-4cb2-9b3a-d9478b3a8a51 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:33.093648 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 435/882] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:33.099308 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de43f6-7e10-4e46-953c-838fbe3f7e1e None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:33.099600 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de43f6-7e10-4e46-953c-838fbe3f7e1e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:33.099870 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de43f6-7e10-4e46-953c-838fbe3f7e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:33.117830 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-e6de43f6-7e10-4e46-953c-838fbe3f7e1e None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:33.119036 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e6de43f6-7e10-4e46-953c-838fbe3f7e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:33.191408 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 448/883] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:33 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:42:33.455992 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a1ce2-0944-4cb2-9b3a-d9478b3a8a51 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:33.558115 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a1ce2-0944-4cb2-9b3a-d9478b3a8a51 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:33.566000 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:33.594590 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5fc1b-0546-4385-a81c-40f299cb804b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:33.595541 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5fc1b-0546-4385-a81c-40f299cb804b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:33.595820 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5fc1b-0546-4385-a81c-40f299cb804b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:33.596093 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5fc1b-0546-4385-a81c-40f299cb804b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:33.596679 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5fc1b-0546-4385-a81c-40f299cb804b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:33.598091 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5fc1b-0546-4385-a81c-40f299cb804b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:33.607056 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-8ad5fc1b-0546-4385-a81c-40f299cb804b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:42:33.607056 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:33.607056 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:42:33.607056 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:42:33.607056 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:42:33.607056 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:42:33.607056 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:42:33.607056 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:33.607056 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:42:33.607056 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:33.607056 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:42:33.607056 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:33.607056 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:33.607056 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:33.607056 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:33.607056 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:33.607056 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:33.608181 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:33.608181 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:33.608181 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:33.608181 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:33.608181 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:33.608181 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:33.608181 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:42:33.608181 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:42:33.608181 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:42:33.608181 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:42:33.608181 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:33.608181 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:33.608181 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:33.608181 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:33.608181 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:33.608181 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:33.609479 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:33.609479 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:33.609479 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:33.609479 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:33.609479 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:33.609479 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:33.609479 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:33.609479 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:33.609479 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:33.609479 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:33.609479 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:42:33.609479 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:33.609479 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:42:33.609479 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:33.609479 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 436/884] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Aug 28 00:42:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:33.614955 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de43f6-7e10-4e46-953c-838fbe3f7e1e None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:33.719640 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de43f6-7e10-4e46-953c-838fbe3f7e1e None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:33.742372 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:33.762908 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67abb9-389e-4a45-8b62-e02e432fd7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:33.763553 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67abb9-389e-4a45-8b62-e02e432fd7e5 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:33.764110 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67abb9-389e-4a45-8b62-e02e432fd7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:33.764443 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67abb9-389e-4a45-8b62-e02e432fd7e5 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:33.765089 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67abb9-389e-4a45-8b62-e02e432fd7e5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:33.765388 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67abb9-389e-4a45-8b62-e02e432fd7e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:33.766805 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67abb9-389e-4a45-8b62-e02e432fd7e5 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:33.771950 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 449/885] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Aug 28 00:42:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:42:33.777626 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5fc1b-0546-4385-a81c-40f299cb804b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:33.881425 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5fc1b-0546-4385-a81c-40f299cb804b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:33.915929 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9eac4-5dc3-4dda-85af-7516ead05bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:33.916537 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9eac4-5dc3-4dda-85af-7516ead05bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:33.916814 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9eac4-5dc3-4dda-85af-7516ead05bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:33.917084 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9eac4-5dc3-4dda-85af-7516ead05bc6 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:33.917714 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e9eac4-5dc3-4dda-85af-7516ead05bc6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:33.918040 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e9eac4-5dc3-4dda-85af-7516ead05bc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:33.919435 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e9eac4-5dc3-4dda-85af-7516ead05bc6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:33.924749 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 437/886] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Aug 28 00:42:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:33.930728 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67abb9-389e-4a45-8b62-e02e432fd7e5 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:34.039190 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67abb9-389e-4a45-8b62-e02e432fd7e5 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:34.075102 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc312ec9-58f3-4363-b837-b434a03b429f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:34.075713 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc312ec9-58f3-4363-b837-b434a03b429f None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:34.075991 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc312ec9-58f3-4363-b837-b434a03b429f None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:34.076482 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc312ec9-58f3-4363-b837-b434a03b429f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:34.077327 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc312ec9-58f3-4363-b837-b434a03b429f None admin] RBAC: Adding query filter params (interface=public, service_id=0914c2e785174bb7a0df700b66be5bbe, region_id=RegionOne) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:34.077638 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc312ec9-58f3-4363-b837-b434a03b429f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:34.079074 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc312ec9-58f3-4363-b837-b434a03b429f None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:34.086969 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 450/887] 10.222.0.52 () {56 vars in 1251 bytes} [Sun Aug 28 00:42:33 2022] GET /identity/v3/endpoints?service_id=0914c2e785174bb7a0df700b66be5bbe&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:34.098988 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9eac4-5dc3-4dda-85af-7516ead05bc6 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:34.133820 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:34.155993 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058d93e-598c-4a37-9048-af8becafe0ce None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:34.155993 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058d93e-598c-4a37-9048-af8becafe0ce None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:34.155993 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058d93e-598c-4a37-9048-af8becafe0ce None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:34.156810 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 451/888] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:42:34.162173 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6de0f-caa5-43bb-a36b-53eeae302fcb None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:34.162718 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6de0f-caa5-43bb-a36b-53eeae302fcb None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:34.163182 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6de0f-caa5-43bb-a36b-53eeae302fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:34.186549 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-5cd6de0f-caa5-43bb-a36b-53eeae302fcb None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:34.187756 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-5cd6de0f-caa5-43bb-a36b-53eeae302fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:34.204874 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9eac4-5dc3-4dda-85af-7516ead05bc6 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:34.243988 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc7e19-a75e-421c-8e0b-3746f3e0773b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:34.244199 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:34.244601 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc7e19-a75e-421c-8e0b-3746f3e0773b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:34.244879 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc7e19-a75e-421c-8e0b-3746f3e0773b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:34.245507 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc7e19-a75e-421c-8e0b-3746f3e0773b None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:34.246331 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc7e19-a75e-421c-8e0b-3746f3e0773b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:34.247838 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc7e19-a75e-421c-8e0b-3746f3e0773b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:34.262065 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 438/889] 10.222.0.52 () {56 vars in 1087 bytes} [Sun Aug 28 00:42:34 2022] GET /identity/v3/services => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:42:34.281053 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 452/890] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:42:34.556088 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc7e19-a75e-421c-8e0b-3746f3e0773b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:34.630398 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b70ac-33db-4b8d-9163-7a5e437280dc None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:34.630923 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b70ac-33db-4b8d-9163-7a5e437280dc None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:34.630923 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b70ac-33db-4b8d-9163-7a5e437280dc None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:34.632525 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 453/891] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:42:34.637714 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430978f-5d0d-43de-8572-3009f222cee7 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:34.638030 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430978f-5d0d-43de-8572-3009f222cee7 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:34.638310 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430978f-5d0d-43de-8572-3009f222cee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:34.658540 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-e430978f-5d0d-43de-8572-3009f222cee7 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:34.659724 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e430978f-5d0d-43de-8572-3009f222cee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:34.675433 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:34.680683 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc7e19-a75e-421c-8e0b-3746f3e0773b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:34.728300 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bfb60-e3a5-42c9-9fc9-0a381ce7b18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:34.729325 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bfb60-e3a5-42c9-9fc9-0a381ce7b18b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:34.729770 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bfb60-e3a5-42c9-9fc9-0a381ce7b18b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:34.730235 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bfb60-e3a5-42c9-9fc9-0a381ce7b18b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:34.738212 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 454/892] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:42:34.741694 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2bfb60-e3a5-42c9-9fc9-0a381ce7b18b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:42:34.747155 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-5c2bfb60-e3a5-42c9-9fc9-0a381ce7b18b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:42:34.747155 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:34.747155 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:34.747155 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:34.747155 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:34.747155 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:34.747155 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:34.747155 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:34.747155 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:34.747155 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:34.747155 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:34.747155 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:34.747155 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:42:34.747155 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:42:34.747155 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:42:34.747155 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:42:34.748365 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:42:34.748365 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:42:34.748365 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:42:34.748365 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:42:34.748365 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:34.748365 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:34.748365 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:34.748365 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:34.748365 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:34.748365 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:34.748365 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:34.748365 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:34.748365 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:34.748365 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:34.748365 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:34.748365 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:34.749208 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:34.749208 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:34.749208 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:34.749208 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:34.749208 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:42:34.749208 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:42:34.749208 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:42:34.749208 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:42:34.749208 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:42:34.749208 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:42:34.749208 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:42:34.749208 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:34.755987 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 439/893] 10.222.0.52 () {56 vars in 1120 bytes} [Sun Aug 28 00:42:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:34.758937 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430978f-5d0d-43de-8572-3009f222cee7 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:34.832585 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71baef9-9c1b-4dcb-8448-f97695d02c11 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:34.832772 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71baef9-9c1b-4dcb-8448-f97695d02c11 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:34.833033 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71baef9-9c1b-4dcb-8448-f97695d02c11 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:34.834651 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 440/894] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:42:34.839412 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a2e00-c1a2-4681-a9c6-9c89e370caeb None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:34.839801 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a2e00-c1a2-4681-a9c6-9c89e370caeb None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:34.839943 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a2e00-c1a2-4681-a9c6-9c89e370caeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:34.861280 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-968a2e00-c1a2-4681-a9c6-9c89e370caeb None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:34.862858 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-968a2e00-c1a2-4681-a9c6-9c89e370caeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:34.863981 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430978f-5d0d-43de-8572-3009f222cee7 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:34.875820 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:34.911663 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20f511-dc88-4d47-ad1d-e5ee69ec66c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:34.912530 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20f511-dc88-4d47-ad1d-e5ee69ec66c7 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:34.913376 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20f511-dc88-4d47-ad1d-e5ee69ec66c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:34.913817 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20f511-dc88-4d47-ad1d-e5ee69ec66c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:34.915074 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20f511-dc88-4d47-ad1d-e5ee69ec66c7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:34.915816 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20f511-dc88-4d47-ad1d-e5ee69ec66c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:34.917616 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20f511-dc88-4d47-ad1d-e5ee69ec66c7 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:34.932594 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 455/895] 10.222.0.52 () {56 vars in 1115 bytes} [Sun Aug 28 00:42:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:34.934309 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20f511-dc88-4d47-ad1d-e5ee69ec66c7 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:34.949924 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 441/896] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:42:35.005453 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a2e00-c1a2-4681-a9c6-9c89e370caeb None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:35.054164 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20f511-dc88-4d47-ad1d-e5ee69ec66c7 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:35.089858 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576c795-e023-4bc9-8c7e-51dd9eda8579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:35.090870 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576c795-e023-4bc9-8c7e-51dd9eda8579 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:35.091344 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576c795-e023-4bc9-8c7e-51dd9eda8579 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:35.091832 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576c795-e023-4bc9-8c7e-51dd9eda8579 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:35.107058 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576c795-e023-4bc9-8c7e-51dd9eda8579 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:35.109710 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576c795-e023-4bc9-8c7e-51dd9eda8579 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:35.116230 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:35.130609 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a2e00-c1a2-4681-a9c6-9c89e370caeb None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:35.130927 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-0576c795-e023-4bc9-8c7e-51dd9eda8579 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:35.130927 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:35.130927 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:35.130927 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:35.130927 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:35.130927 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:35.130927 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:35.130927 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:35.130927 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:35.130927 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:35.130927 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:35.130927 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:35.130927 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:35.130927 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:35.130927 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:35.130927 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:35.131866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:35.131866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:35.131866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:35.131866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:35.131866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:35.131866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:35.131866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:35.131866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:35.131866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:35.131866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:35.131866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:35.131866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:35.131866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:35.131866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:35.131866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:35.131866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:35.131866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:35.132798 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:35.132798 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:35.132798 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:35.141206 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 456/897] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:42:35.142639 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576c795-e023-4bc9-8c7e-51dd9eda8579 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:35.170064 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:35.173165 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287d43e-faff-4162-a7d0-b5d830cec869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:35.173968 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287d43e-faff-4162-a7d0-b5d830cec869 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:35.174381 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287d43e-faff-4162-a7d0-b5d830cec869 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:35.174889 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287d43e-faff-4162-a7d0-b5d830cec869 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:35.175723 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287d43e-faff-4162-a7d0-b5d830cec869 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:35.178262 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287d43e-faff-4162-a7d0-b5d830cec869 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:35.196604 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 442/898] 10.222.0.52 () {60 vars in 1141 bytes} [Sun Aug 28 00:42:35 2022] POST /identity/v3/services => generated 241 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:42:35.221765 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287d43e-faff-4162-a7d0-b5d830cec869 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:35.272234 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576c795-e023-4bc9-8c7e-51dd9eda8579 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:35.337920 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a9ec8-069d-44c3-bcac-b590f972e961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:35.338636 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a9ec8-069d-44c3-bcac-b590f972e961 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:35.339145 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a9ec8-069d-44c3-bcac-b590f972e961 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:35.339433 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a9ec8-069d-44c3-bcac-b590f972e961 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:35.340161 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a9ec8-069d-44c3-bcac-b590f972e961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:35.340401 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a9ec8-069d-44c3-bcac-b590f972e961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:35.342333 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a9ec8-069d-44c3-bcac-b590f972e961 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:35.363220 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 457/899] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:42:35.364464 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a9ec8-069d-44c3-bcac-b590f972e961 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:35.368092 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287d43e-faff-4162-a7d0-b5d830cec869 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:35.403909 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d331c-8463-44d4-b6dc-17b4e953e47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:35.405022 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d331c-8463-44d4-b6dc-17b4e953e47a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:35.405502 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d331c-8463-44d4-b6dc-17b4e953e47a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:35.405976 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d331c-8463-44d4-b6dc-17b4e953e47a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:35.406764 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d331c-8463-44d4-b6dc-17b4e953e47a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:35.408477 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d331c-8463-44d4-b6dc-17b4e953e47a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:35.418548 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-206d331c-8463-44d4-b6dc-17b4e953e47a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:42:35.418548 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:35.418548 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:42:35.418548 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:42:35.418548 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:42:35.418548 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:42:35.418548 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:42:35.418548 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:35.418548 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:42:35.418548 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:35.418548 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:42:35.418548 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:35.418548 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:35.418548 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:35.418548 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:35.418548 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:35.419619 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:35.419619 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:35.419619 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:35.419619 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:35.419619 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:35.419619 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:35.419619 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:35.419619 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:42:35.419619 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:42:35.419619 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:42:35.419619 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:42:35.419619 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:35.419619 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:35.419619 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:35.419619 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:35.419619 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:35.419619 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:35.420771 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:35.420771 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:35.420771 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:35.420771 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:35.420771 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:35.420771 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:35.420771 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:35.420771 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:35.420771 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:35.420771 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:35.420771 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:42:35.420771 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:35.420771 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:42:35.420771 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:35.420771 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 443/900] 10.222.0.52 () {56 vars in 1132 bytes} [Sun Aug 28 00:42:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:42:35.425816 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d331c-8463-44d4-b6dc-17b4e953e47a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:35.443497 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:35.459745 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:35.488876 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a9ec8-069d-44c3-bcac-b590f972e961 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:35.526569 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42762e81-c44a-4adb-8d9a-d3583731a35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:35.527528 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42762e81-c44a-4adb-8d9a-d3583731a35d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:35.528398 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42762e81-c44a-4adb-8d9a-d3583731a35d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:35.528840 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42762e81-c44a-4adb-8d9a-d3583731a35d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:35.540375 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42762e81-c44a-4adb-8d9a-d3583731a35d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:35.542932 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42762e81-c44a-4adb-8d9a-d3583731a35d None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:35.560256 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-42762e81-c44a-4adb-8d9a-d3583731a35d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:42:35.560256 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:35.560256 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:35.560256 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:35.560256 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:35.560256 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:35.560256 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:35.560256 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:35.560256 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:35.560256 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:35.560256 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:35.560256 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:35.560256 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:42:35.560256 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:42:35.560256 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:42:35.560256 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:42:35.561343 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:35.561343 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:35.561343 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:42:35.561343 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:35.561343 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:42:35.561343 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:35.561343 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:35.561343 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:35.561343 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:35.561343 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:35.561343 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:35.561343 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:35.561343 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:35.561343 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:35.561343 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:35.561343 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:35.561343 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:35.561343 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:35.562350 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:35.562350 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:35.562350 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:42:35.562350 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:42:35.562350 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:42:35.562350 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:42:35.562350 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:42:35.562350 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:42:35.562350 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:42:35.562350 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:35.562889 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d331c-8463-44d4-b6dc-17b4e953e47a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:35.570206 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 458/901] 10.222.0.52 () {56 vars in 1117 bytes} [Sun Aug 28 00:42:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:35.571642 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42762e81-c44a-4adb-8d9a-d3583731a35d None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:35.608061 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860cb17c-99e2-4aff-96c4-513ea41ad213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:35.608373 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cb17c-99e2-4aff-96c4-513ea41ad213 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:35.608626 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cb17c-99e2-4aff-96c4-513ea41ad213 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:35.608897 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cb17c-99e2-4aff-96c4-513ea41ad213 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:35.609657 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860cb17c-99e2-4aff-96c4-513ea41ad213 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:35.610058 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860cb17c-99e2-4aff-96c4-513ea41ad213 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:35.611465 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860cb17c-99e2-4aff-96c4-513ea41ad213 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:35.616964 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 444/902] 10.222.0.52 () {56 vars in 1126 bytes} [Sun Aug 28 00:42:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:42:35.622148 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860cb17c-99e2-4aff-96c4-513ea41ad213 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:35.694256 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42762e81-c44a-4adb-8d9a-d3583731a35d None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:35.703859 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:35.729743 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860cb17c-99e2-4aff-96c4-513ea41ad213 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:35.731555 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d1a83-e0ad-421a-b1fd-a2eee46ae660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:35.732451 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d1a83-e0ad-421a-b1fd-a2eee46ae660 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:35.732958 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d1a83-e0ad-421a-b1fd-a2eee46ae660 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:35.733382 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d1a83-e0ad-421a-b1fd-a2eee46ae660 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:35.734283 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d1a83-e0ad-421a-b1fd-a2eee46ae660 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:35.734722 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d1a83-e0ad-421a-b1fd-a2eee46ae660 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:35.736299 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d1a83-e0ad-421a-b1fd-a2eee46ae660 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:35.745362 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:35.760859 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 459/903] 10.222.0.52 () {56 vars in 1149 bytes} [Sun Aug 28 00:42:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:42:35.762355 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d1a83-e0ad-421a-b1fd-a2eee46ae660 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:35.769367 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59690a76-6714-4e8e-87c2-f5f2aa6847a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:35.770101 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59690a76-6714-4e8e-87c2-f5f2aa6847a7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:35.770384 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59690a76-6714-4e8e-87c2-f5f2aa6847a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:35.770652 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59690a76-6714-4e8e-87c2-f5f2aa6847a7 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:35.771282 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59690a76-6714-4e8e-87c2-f5f2aa6847a7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:35.771586 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59690a76-6714-4e8e-87c2-f5f2aa6847a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:35.773107 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59690a76-6714-4e8e-87c2-f5f2aa6847a7 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:35.783436 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 445/904] 10.222.0.52 () {56 vars in 1126 bytes} [Sun Aug 28 00:42:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:35.784305 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59690a76-6714-4e8e-87c2-f5f2aa6847a7 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:35.871879 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d1a83-e0ad-421a-b1fd-a2eee46ae660 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:35.889214 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59690a76-6714-4e8e-87c2-f5f2aa6847a7 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:35.909789 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf2492-bb1a-4af9-9905-86e9afced76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:35.910670 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf2492-bb1a-4af9-9905-86e9afced76b None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:35.911087 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf2492-bb1a-4af9-9905-86e9afced76b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:35.911502 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf2492-bb1a-4af9-9905-86e9afced76b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:35.926132 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beead8a7-eb34-467b-a8b9-ce03e9c0116a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:35.926796 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beead8a7-eb34-467b-a8b9-ce03e9c0116a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:35.927083 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beead8a7-eb34-467b-a8b9-ce03e9c0116a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:35.927354 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beead8a7-eb34-467b-a8b9-ce03e9c0116a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:35.928058 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beead8a7-eb34-467b-a8b9-ce03e9c0116a None admin] RBAC: Adding query filter params (interface=public, service_id=0d51be05b9c84594a48a75520cf75133, region_id=RegionOne) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:35.928397 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beead8a7-eb34-467b-a8b9-ce03e9c0116a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:35.929740 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beead8a7-eb34-467b-a8b9-ce03e9c0116a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:35.935462 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 446/905] 10.222.0.52 () {56 vars in 1251 bytes} [Sun Aug 28 00:42:35 2022] GET /identity/v3/endpoints?service_id=0d51be05b9c84594a48a75520cf75133&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:42:35.940936 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beead8a7-eb34-467b-a8b9-ce03e9c0116a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:35.944614 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:35.977772 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:35.986267 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf2492-bb1a-4af9-9905-86e9afced76b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:35.988034 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf2492-bb1a-4af9-9905-86e9afced76b None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:36.047534 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beead8a7-eb34-467b-a8b9-ce03e9c0116a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:36.083721 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bbb3e9-9e0b-4581-afaa-204dd52edb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:36.084297 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbb3e9-9e0b-4581-afaa-204dd52edb60 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:36.084575 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbb3e9-9e0b-4581-afaa-204dd52edb60 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:36.084844 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbb3e9-9e0b-4581-afaa-204dd52edb60 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:36.085450 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bbb3e9-9e0b-4581-afaa-204dd52edb60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:36.086908 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bbb3e9-9e0b-4581-afaa-204dd52edb60 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:36.098318 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 447/906] 10.222.0.52 () {56 vars in 1087 bytes} [Sun Aug 28 00:42:35 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:42:36.098801 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 460/907] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:42:35 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 28 00:42:36.100585 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bbb3e9-9e0b-4581-afaa-204dd52edb60 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:36.177878 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:36.202410 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbe6ba-f443-4278-9955-c808f2660fec None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:36.202737 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbe6ba-f443-4278-9955-c808f2660fec None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:36.202972 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbe6ba-f443-4278-9955-c808f2660fec None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:36.204632 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 461/908] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:36.210272 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c0251-808f-41a7-85cd-eace5cf423eb None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:36.210581 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c0251-808f-41a7-85cd-eace5cf423eb None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:36.210822 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c0251-808f-41a7-85cd-eace5cf423eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:36.215910 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bbb3e9-9e0b-4581-afaa-204dd52edb60 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:36.230952 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-516c0251-808f-41a7-85cd-eace5cf423eb None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:36.232166 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-516c0251-808f-41a7-85cd-eace5cf423eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:36.260497 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df201d7-146a-4bcc-aaf3-19a4c5d0706c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:36.261589 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df201d7-146a-4bcc-aaf3-19a4c5d0706c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:36.261589 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df201d7-146a-4bcc-aaf3-19a4c5d0706c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:36.261760 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df201d7-146a-4bcc-aaf3-19a4c5d0706c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:36.273329 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df201d7-146a-4bcc-aaf3-19a4c5d0706c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:36.274857 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df201d7-146a-4bcc-aaf3-19a4c5d0706c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:36.294750 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-5df201d7-146a-4bcc-aaf3-19a4c5d0706c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:36.294750 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:36.294750 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:36.294750 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:36.294750 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:36.294750 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:36.294750 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:36.294750 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:36.294750 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:36.294750 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:36.294750 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:36.294750 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:36.294750 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:36.294750 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:36.294750 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:36.294750 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:36.297121 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:36.297121 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:36.297121 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:36.297121 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:36.297121 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:36.297121 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:36.297121 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:36.297121 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:36.297121 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:36.297121 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:36.297121 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:36.297121 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:36.297121 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:36.297121 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:36.297121 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:36.297121 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:36.297121 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:36.299298 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:36.299298 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:36.299298 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:36.300798 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 448/909] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:36.302685 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df201d7-146a-4bcc-aaf3-19a4c5d0706c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:36.325874 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 462/910] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:42:36.414789 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df201d7-146a-4bcc-aaf3-19a4c5d0706c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:36.434417 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:36.448353 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2a223-5efb-4120-b895-d93c2bed5830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:36.449083 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2a223-5efb-4120-b895-d93c2bed5830 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:36.449357 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2a223-5efb-4120-b895-d93c2bed5830 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:36.449625 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2a223-5efb-4120-b895-d93c2bed5830 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:36.450301 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb2a223-5efb-4120-b895-d93c2bed5830 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:36.450597 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb2a223-5efb-4120-b895-d93c2bed5830 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:36.452157 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb2a223-5efb-4120-b895-d93c2bed5830 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:36.469001 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 449/911] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:42:36.470756 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c0251-808f-41a7-85cd-eace5cf423eb None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:36.498950 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:36.582133 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c0251-808f-41a7-85cd-eace5cf423eb None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:36.615100 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2a223-5efb-4120-b895-d93c2bed5830 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:36.621293 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b92b59-7285-4dff-8ac9-b5d36ebc8880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:36.622207 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b92b59-7285-4dff-8ac9-b5d36ebc8880 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:36.622700 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b92b59-7285-4dff-8ac9-b5d36ebc8880 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:36.623317 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b92b59-7285-4dff-8ac9-b5d36ebc8880 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:36.631019 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b92b59-7285-4dff-8ac9-b5d36ebc8880 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:36.632751 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b92b59-7285-4dff-8ac9-b5d36ebc8880 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:36.644975 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-91b92b59-7285-4dff-8ac9-b5d36ebc8880 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:36.644975 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:36.644975 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:36.644975 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:36.644975 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:36.644975 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:36.644975 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:36.644975 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:36.644975 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:36.644975 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:36.644975 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:36.644975 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:36.644975 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:42:36.644975 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:42:36.644975 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:42:36.645954 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:42:36.645954 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:36.645954 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:36.645954 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:36.645954 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:36.645954 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:36.645954 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:36.645954 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:36.645954 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:36.645954 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:36.645954 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:36.645954 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:36.645954 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:36.645954 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:36.645954 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:36.645954 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:36.645954 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:36.646845 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:42:36.646845 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:42:36.646845 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:42:36.646845 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:42:36.646845 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:42:36.646845 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:42:36.646845 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:36.646845 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:36.648696 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 463/912] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:42:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:36.655942 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b92b59-7285-4dff-8ac9-b5d36ebc8880 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:36.726139 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2a223-5efb-4120-b895-d93c2bed5830 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:36.756472 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:36.762339 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d2da2-1d3c-4334-a7c7-b1c975c6ee35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:36.762975 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d2da2-1d3c-4334-a7c7-b1c975c6ee35 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:36.763253 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d2da2-1d3c-4334-a7c7-b1c975c6ee35 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:36.763560 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d2da2-1d3c-4334-a7c7-b1c975c6ee35 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:36.764159 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d2da2-1d3c-4334-a7c7-b1c975c6ee35 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:36.765533 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d2da2-1d3c-4334-a7c7-b1c975c6ee35 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:36.777578 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-6b6d2da2-1d3c-4334-a7c7-b1c975c6ee35 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:42:36.777578 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:36.777578 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:42:36.777578 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:42:36.777578 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:42:36.777578 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:42:36.777578 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:42:36.777578 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:36.777578 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:42:36.777578 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:36.777578 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:42:36.777578 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:36.777578 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:36.777578 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:36.777578 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:36.777578 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:36.777578 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:36.778640 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:36.778640 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:36.778640 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:36.778640 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:36.778640 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:36.778640 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:36.778640 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:42:36.778640 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:42:36.778640 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:42:36.778640 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:42:36.778640 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:36.778640 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:36.778640 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:36.778640 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:36.778640 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:36.778640 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:36.779609 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:36.779609 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:36.779609 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:36.779609 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:36.779609 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:36.779609 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:36.779609 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:36.779609 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:36.779609 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:36.779609 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:36.779609 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:42:36.779609 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:36.779609 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:42:36.779609 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:36.779609 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 450/913] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Aug 28 00:42:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:42:36.784801 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d2da2-1d3c-4334-a7c7-b1c975c6ee35 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:36.785383 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b92b59-7285-4dff-8ac9-b5d36ebc8880 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:36.820865 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33415f-8909-4f36-bbc6-657c7dc236c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:36.821551 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33415f-8909-4f36-bbc6-657c7dc236c8 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:36.821935 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33415f-8909-4f36-bbc6-657c7dc236c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:36.822297 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33415f-8909-4f36-bbc6-657c7dc236c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:36.823017 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33415f-8909-4f36-bbc6-657c7dc236c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:36.823382 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33415f-8909-4f36-bbc6-657c7dc236c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:36.825074 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33415f-8909-4f36-bbc6-657c7dc236c8 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:36.838474 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 464/914] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:42:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:42:36.844207 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33415f-8909-4f36-bbc6-657c7dc236c8 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:36.845344 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:36.904325 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d2da2-1d3c-4334-a7c7-b1c975c6ee35 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:36.940829 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3f86a-f845-4285-be6a-ff7e41d72b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:36.941874 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3f86a-f845-4285-be6a-ff7e41d72b3b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:36.942433 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3f86a-f845-4285-be6a-ff7e41d72b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:36.942910 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3f86a-f845-4285-be6a-ff7e41d72b3b None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:36.943739 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe3f86a-f845-4285-be6a-ff7e41d72b3b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:36.944246 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe3f86a-f845-4285-be6a-ff7e41d72b3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:36.945969 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe3f86a-f845-4285-be6a-ff7e41d72b3b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:36.952234 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 451/915] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Aug 28 00:42:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:36.960668 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3f86a-f845-4285-be6a-ff7e41d72b3b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:36.969015 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33415f-8909-4f36-bbc6-657c7dc236c8 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:37.005083 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d0370-a2d4-4428-9bcd-67e7588ca59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:37.005604 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d0370-a2d4-4428-9bcd-67e7588ca59f None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:37.005899 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d0370-a2d4-4428-9bcd-67e7588ca59f None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:37.006170 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d0370-a2d4-4428-9bcd-67e7588ca59f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:37.006890 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d0370-a2d4-4428-9bcd-67e7588ca59f None admin] RBAC: Adding query filter params (role.id=40e39507eac04ff6b770e29fce3b7e81, scope.project.id=45c69e3e973c449895457bb610103a43, user.id=3302fdf33b5b4583a10e7c760c577cda) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:37.007191 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d0370-a2d4-4428-9bcd-67e7588ca59f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:37.008616 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d0370-a2d4-4428-9bcd-67e7588ca59f None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:37.014433 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 465/916] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:42:36 2022] GET /identity/v3/role_assignments?user.id=3302fdf33b5b4583a10e7c760c577cda&scope.project.id=45c69e3e973c449895457bb610103a43&role.id=40e39507eac04ff6b770e29fce3b7e81 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:37.074032 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3f86a-f845-4285-be6a-ff7e41d72b3b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:37.102603 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:37.112065 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81b91a-cc8a-4493-88ee-76adcd95042f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:37.112698 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81b91a-cc8a-4493-88ee-76adcd95042f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:37.112980 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81b91a-cc8a-4493-88ee-76adcd95042f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:37.113255 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81b91a-cc8a-4493-88ee-76adcd95042f None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:37.113939 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea81b91a-cc8a-4493-88ee-76adcd95042f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:37.114336 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea81b91a-cc8a-4493-88ee-76adcd95042f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:37.116030 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea81b91a-cc8a-4493-88ee-76adcd95042f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:37.122126 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 452/917] 10.222.0.52 () {56 vars in 1114 bytes} [Sun Aug 28 00:42:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:37.131032 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d0370-a2d4-4428-9bcd-67e7588ca59f None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:37.145881 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:37.221064 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f1fa3-c9cf-4778-9afb-c39a80f97ae5 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:37.221711 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f1fa3-c9cf-4778-9afb-c39a80f97ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:37.221711 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f1fa3-c9cf-4778-9afb-c39a80f97ae5 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:37.223215 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 453/918] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:37.228259 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c52a93-7c0a-41e6-b897-1fc7f6fe142a None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:37.228542 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c52a93-7c0a-41e6-b897-1fc7f6fe142a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:37.228818 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c52a93-7c0a-41e6-b897-1fc7f6fe142a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:37.243396 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d0370-a2d4-4428-9bcd-67e7588ca59f None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:37.247660 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-47c52a93-7c0a-41e6-b897-1fc7f6fe142a None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:37.249557 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-47c52a93-7c0a-41e6-b897-1fc7f6fe142a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:37.285997 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b354cdb-ffc3-4894-ae1d-fde703d5fdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:37.287441 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b354cdb-ffc3-4894-ae1d-fde703d5fdf4 None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:37.287716 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b354cdb-ffc3-4894-ae1d-fde703d5fdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:37.287983 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b354cdb-ffc3-4894-ae1d-fde703d5fdf4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:37.288655 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b354cdb-ffc3-4894-ae1d-fde703d5fdf4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:37.290070 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b354cdb-ffc3-4894-ae1d-fde703d5fdf4 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:37.319225 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 466/919] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:42:37 2022] POST /identity/v3/endpoints => generated 346 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:42:37.348960 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 454/920] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:42:37.632885 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b354cdb-ffc3-4894-ae1d-fde703d5fdf4 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:37.704584 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:37.741527 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b354cdb-ffc3-4894-ae1d-fde703d5fdf4 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:37.775727 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4830a5-83cb-43b3-991d-da65b283aed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:37.776402 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4830a5-83cb-43b3-991d-da65b283aed7 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:37.776660 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4830a5-83cb-43b3-991d-da65b283aed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:37.776874 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4830a5-83cb-43b3-991d-da65b283aed7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:37.777461 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4830a5-83cb-43b3-991d-da65b283aed7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:37.778862 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4830a5-83cb-43b3-991d-da65b283aed7 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:37.788087 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-ac4830a5-83cb-43b3-991d-da65b283aed7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:42:37.788087 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:37.788087 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:42:37.788087 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:42:37.788087 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:42:37.788087 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:42:37.788087 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:42:37.788087 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:37.788087 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:42:37.788087 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:37.788087 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:42:37.788087 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:37.788087 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:37.788087 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:37.788087 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:37.788087 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:37.788087 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:37.789067 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:37.789067 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:37.789067 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:37.789067 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:37.789067 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:37.789067 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:37.789067 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:42:37.789067 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:42:37.789067 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:42:37.789067 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:42:37.789067 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:37.789067 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:37.789067 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:37.789067 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:37.789067 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:37.789067 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:37.789962 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:37.789962 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:37.789962 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:37.789962 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:37.789962 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:37.789962 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:37.789962 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:37.789962 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:37.789962 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:37.789962 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:37.789962 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:42:37.789962 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:37.789962 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:42:37.789962 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:37.789962 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 467/921] 10.222.0.52 () {56 vars in 1126 bytes} [Sun Aug 28 00:42:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:37.795471 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c52a93-7c0a-41e6-b897-1fc7f6fe142a None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:37.894300 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:37.898328 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c52a93-7c0a-41e6-b897-1fc7f6fe142a None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:37.934120 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673225a-9aca-44d5-bba7-f15b506e8cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:37.934726 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673225a-9aca-44d5-bba7-f15b506e8cec None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:37.934997 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673225a-9aca-44d5-bba7-f15b506e8cec None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:37.935258 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673225a-9aca-44d5-bba7-f15b506e8cec None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:37.935900 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673225a-9aca-44d5-bba7-f15b506e8cec None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:37.936192 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673225a-9aca-44d5-bba7-f15b506e8cec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:37.937652 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673225a-9aca-44d5-bba7-f15b506e8cec None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:37.942714 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 455/922] 10.222.0.52 () {56 vars in 1122 bytes} [Sun Aug 28 00:42:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:37.948360 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4830a5-83cb-43b3-991d-da65b283aed7 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:38.049529 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4830a5-83cb-43b3-991d-da65b283aed7 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:38.079603 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:38.085713 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa05ef-8ed0-419b-bedc-39a08a115b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:38.086390 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa05ef-8ed0-419b-bedc-39a08a115b9a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:38.086699 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa05ef-8ed0-419b-bedc-39a08a115b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:38.086968 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa05ef-8ed0-419b-bedc-39a08a115b9a None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:38.087638 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa05ef-8ed0-419b-bedc-39a08a115b9a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:38.088489 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa05ef-8ed0-419b-bedc-39a08a115b9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:38.089982 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa05ef-8ed0-419b-bedc-39a08a115b9a None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:38.096112 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 468/923] 10.222.0.52 () {56 vars in 1122 bytes} [Sun Aug 28 00:42:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:38.101933 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673225a-9aca-44d5-bba7-f15b506e8cec None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:38.156875 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2267a-1287-4707-9615-d457a5299689 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:38.157207 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2267a-1287-4707-9615-d457a5299689 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:38.158962 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2267a-1287-4707-9615-d457a5299689 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:38.159109 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 469/924] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:42:38.168034 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cc8ad-6b51-4c31-8e5b-b3644398a90a None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:38.168414 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cc8ad-6b51-4c31-8e5b-b3644398a90a None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:38.168774 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cc8ad-6b51-4c31-8e5b-b3644398a90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:38.191977 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-ea7cc8ad-6b51-4c31-8e5b-b3644398a90a None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:38.193468 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ea7cc8ad-6b51-4c31-8e5b-b3644398a90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:38.220754 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673225a-9aca-44d5-bba7-f15b506e8cec None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:38.262513 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69867890-b214-464e-94e3-e9b3fbe9000f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:38.263334 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69867890-b214-464e-94e3-e9b3fbe9000f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:38.263821 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69867890-b214-464e-94e3-e9b3fbe9000f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:38.264356 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69867890-b214-464e-94e3-e9b3fbe9000f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:38.265450 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 470/925] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:42:38.270874 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69867890-b214-464e-94e3-e9b3fbe9000f None admin] RBAC: Adding query filter params (interface=public, service_id=38842d59e9c24692beecfe51535d9e67, region_id=RegionOne) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:38.271387 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69867890-b214-464e-94e3-e9b3fbe9000f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:38.272962 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69867890-b214-464e-94e3-e9b3fbe9000f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:38.278991 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 456/926] 10.222.0.52 () {56 vars in 1251 bytes} [Sun Aug 28 00:42:38 2022] GET /identity/v3/endpoints?service_id=38842d59e9c24692beecfe51535d9e67&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:38.286904 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7cc8ad-6b51-4c31-8e5b-b3644398a90a None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:38.386569 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7cc8ad-6b51-4c31-8e5b-b3644398a90a None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:38.411034 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:38.423097 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcdb58f-4bfe-44ca-b3fa-234bcca50e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:38.424117 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcdb58f-4bfe-44ca-b3fa-234bcca50e82 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:38.424586 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcdb58f-4bfe-44ca-b3fa-234bcca50e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:38.425047 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcdb58f-4bfe-44ca-b3fa-234bcca50e82 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:38.425893 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcdb58f-4bfe-44ca-b3fa-234bcca50e82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:38.427536 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcdb58f-4bfe-44ca-b3fa-234bcca50e82 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:38.434834 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 471/927] 10.222.0.52 () {56 vars in 1087 bytes} [Sun Aug 28 00:42:38 2022] GET /identity/v3/services => generated 1497 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:42:38.550033 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69867890-b214-464e-94e3-e9b3fbe9000f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:38.581008 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:38.658953 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69867890-b214-464e-94e3-e9b3fbe9000f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:38.694177 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995a1f8-9999-42c7-88c3-83c4cef7bd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:38.695224 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995a1f8-9999-42c7-88c3-83c4cef7bd9a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:38.695691 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995a1f8-9999-42c7-88c3-83c4cef7bd9a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:38.696174 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995a1f8-9999-42c7-88c3-83c4cef7bd9a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:38.696942 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995a1f8-9999-42c7-88c3-83c4cef7bd9a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:38.698537 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995a1f8-9999-42c7-88c3-83c4cef7bd9a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:38.708061 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-1995a1f8-9999-42c7-88c3-83c4cef7bd9a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:42:38.708061 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:38.708061 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:42:38.708061 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:42:38.708061 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:42:38.708061 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:42:38.708061 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:42:38.708061 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:38.708061 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:42:38.708061 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:38.708061 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:42:38.708061 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:38.708061 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:38.708061 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:38.708061 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:38.708061 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:38.709004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:38.709004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:38.709004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:38.709004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:38.709004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:38.709004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:38.709004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:38.709004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:42:38.709004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:42:38.709004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:42:38.709004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:42:38.709004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:38.709004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:38.709004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:38.709004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:38.709004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:38.709004 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:38.709935 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:38.709935 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:38.709935 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:38.709935 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:38.709935 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:38.709935 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:38.709935 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:38.709935 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:38.709935 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:38.709935 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:38.709935 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:42:38.709935 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:38.709935 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:42:38.709935 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:38.712634 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 457/928] 10.222.0.52 () {56 vars in 1132 bytes} [Sun Aug 28 00:42:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:38.718557 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcdb58f-4bfe-44ca-b3fa-234bcca50e82 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:38.823595 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcdb58f-4bfe-44ca-b3fa-234bcca50e82 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:38.860253 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1312f-f033-4904-9861-c2867042bf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:38.861338 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1312f-f033-4904-9861-c2867042bf62 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:38.861824 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1312f-f033-4904-9861-c2867042bf62 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:38.862337 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1312f-f033-4904-9861-c2867042bf62 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:38.863204 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f1312f-f033-4904-9861-c2867042bf62 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:38.863709 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f1312f-f033-4904-9861-c2867042bf62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:38.865289 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f1312f-f033-4904-9861-c2867042bf62 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:38.870672 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 472/929] 10.222.0.52 () {56 vars in 1126 bytes} [Sun Aug 28 00:42:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:38.879002 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995a1f8-9999-42c7-88c3-83c4cef7bd9a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:38.977538 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:38.987956 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f465b5-bc8d-4681-9b37-7b29e70224b1 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:38.988252 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f465b5-bc8d-4681-9b37-7b29e70224b1 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:38.988504 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995a1f8-9999-42c7-88c3-83c4cef7bd9a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:38.988605 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f465b5-bc8d-4681-9b37-7b29e70224b1 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:38.990205 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 473/930] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:42:38.995580 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ececdb-9fa6-4a8f-94ec-c4b330eb0f23 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:38.995959 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ececdb-9fa6-4a8f-94ec-c4b330eb0f23 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:38.996419 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ececdb-9fa6-4a8f-94ec-c4b330eb0f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:39.016644 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-d3ececdb-9fa6-4a8f-94ec-c4b330eb0f23 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:39.018011 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d3ececdb-9fa6-4a8f-94ec-c4b330eb0f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:39.029417 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed71fa3-cede-4731-bd58-78a8f40e2942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:39.030437 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed71fa3-cede-4731-bd58-78a8f40e2942 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:39.031248 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed71fa3-cede-4731-bd58-78a8f40e2942 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:39.031833 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed71fa3-cede-4731-bd58-78a8f40e2942 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:39.032790 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed71fa3-cede-4731-bd58-78a8f40e2942 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:39.033277 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed71fa3-cede-4731-bd58-78a8f40e2942 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:39.035587 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed71fa3-cede-4731-bd58-78a8f40e2942 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:39.042585 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 458/931] 10.222.0.52 () {56 vars in 1126 bytes} [Sun Aug 28 00:42:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:39.047886 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed71fa3-cede-4731-bd58-78a8f40e2942 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:39.079123 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:39.102533 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 474/932] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:42:39.169473 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed71fa3-cede-4731-bd58-78a8f40e2942 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:39.204380 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2f86c-ffe0-46ad-bf0e-62c35f3651fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:39.205229 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2f86c-ffe0-46ad-bf0e-62c35f3651fb None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:39.205651 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2f86c-ffe0-46ad-bf0e-62c35f3651fb None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:39.206097 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2f86c-ffe0-46ad-bf0e-62c35f3651fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:39.206902 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2f86c-ffe0-46ad-bf0e-62c35f3651fb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:39.208489 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2f86c-ffe0-46ad-bf0e-62c35f3651fb None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:39.235294 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 459/933] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:42:39 2022] POST /identity/v3/endpoints => generated 347 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:42:39.269416 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f5f94-8bb6-4213-8300-01679deeb7da None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:39.269696 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f5f94-8bb6-4213-8300-01679deeb7da None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:39.270009 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f5f94-8bb6-4213-8300-01679deeb7da None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:39.271698 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 475/934] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:39.277515 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132379c8-35d2-4a18-aaaf-5550d9b1c0c0 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:39.278054 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132379c8-35d2-4a18-aaaf-5550d9b1c0c0 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:39.278131 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132379c8-35d2-4a18-aaaf-5550d9b1c0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:39.298216 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-132379c8-35d2-4a18-aaaf-5550d9b1c0c0 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:39.299437 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-132379c8-35d2-4a18-aaaf-5550d9b1c0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:39.302866 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:39.383047 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 460/935] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:42:39.413305 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f5f94-8bb6-4213-8300-01679deeb7da None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:39.521555 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f5f94-8bb6-4213-8300-01679deeb7da None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:39.557585 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89ad8f-aa8e-4138-bc5a-0574594601a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:39.558250 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89ad8f-aa8e-4138-bc5a-0574594601a5 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:39.558528 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89ad8f-aa8e-4138-bc5a-0574594601a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:39.558795 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89ad8f-aa8e-4138-bc5a-0574594601a5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:39.569340 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89ad8f-aa8e-4138-bc5a-0574594601a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:42:39.574346 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-ea89ad8f-aa8e-4138-bc5a-0574594601a5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:42:39.574346 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:39.574346 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:39.574346 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:39.574346 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:39.574346 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:39.574346 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:39.574346 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:39.574346 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:39.574346 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:39.574346 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:39.574346 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:39.574346 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:42:39.574346 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:42:39.574346 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:42:39.574346 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:42:39.575260 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:42:39.575260 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:42:39.575260 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:42:39.575260 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:42:39.575260 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:39.575260 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:39.575260 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:39.575260 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:39.575260 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:39.575260 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:39.575260 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:39.575260 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:39.575260 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:39.575260 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:39.575260 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:39.575260 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:39.576262 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:39.576262 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:39.576262 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:39.576262 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:39.576262 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:42:39.576262 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:42:39.576262 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:42:39.576262 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:42:39.576262 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:42:39.576262 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:42:39.576262 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:42:39.576262 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:39.576262 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 476/936] 10.222.0.52 () {56 vars in 1120 bytes} [Sun Aug 28 00:42:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:39.583627 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132379c8-35d2-4a18-aaaf-5550d9b1c0c0 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:39.668759 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89ad8f-aa8e-4138-bc5a-0574594601a5 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:39.690505 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132379c8-35d2-4a18-aaaf-5550d9b1c0c0 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:39.714687 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:39.727459 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277d9a7-d313-4970-b86d-4dae29b9e3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:39.728353 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277d9a7-d313-4970-b86d-4dae29b9e3ee None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:39.728830 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277d9a7-d313-4970-b86d-4dae29b9e3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:39.729370 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277d9a7-d313-4970-b86d-4dae29b9e3ee None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:39.730396 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277d9a7-d313-4970-b86d-4dae29b9e3ee None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:39.730912 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277d9a7-d313-4970-b86d-4dae29b9e3ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:39.732691 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277d9a7-d313-4970-b86d-4dae29b9e3ee None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:39.741791 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 461/937] 10.222.0.52 () {56 vars in 1115 bytes} [Sun Aug 28 00:42:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:39.742110 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:39.748204 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277d9a7-d313-4970-b86d-4dae29b9e3ee None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:39.781697 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89ad8f-aa8e-4138-bc5a-0574594601a5 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:39.823920 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdacc4fe-8183-41e9-9331-18d6696e3846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:39.824547 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdacc4fe-8183-41e9-9331-18d6696e3846 None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:39.824788 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdacc4fe-8183-41e9-9331-18d6696e3846 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:39.825060 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdacc4fe-8183-41e9-9331-18d6696e3846 None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:39.826244 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdacc4fe-8183-41e9-9331-18d6696e3846 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:39.828063 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdacc4fe-8183-41e9-9331-18d6696e3846 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:39.831341 dv-cinder-master-3-smb devstack@keystone.service[81518]: WARNING keystone.server.flask.common [None req-cdacc4fe-8183-41e9-9331-18d6696e3846 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 28 00:42:39.852649 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277d9a7-d313-4970-b86d-4dae29b9e3ee None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:39.853556 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.sql.core [None req-cdacc4fe-8183-41e9-9331-18d6696e3846 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 28 00:42:39.853556 dv-cinder-master-3-smb devstack@keystone.service[81518]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 28 00:42:39.853556 dv-cinder-master-3-smb devstack@keystone.service[81518]: [parameters: {'id': 'dda63674bf72460bbd5540b07576f114', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 28 00:42:39.853556 dv-cinder-master-3-smb devstack@keystone.service[81518]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81518) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 28 00:42:39.875463 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-cdacc4fe-8183-41e9-9331-18d6696e3846 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dda63674bf72460bbd5540b07576f114.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dda63674bf72460bbd5540b07576f114. Aug 28 00:42:39.875463 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:39.875463 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 00:42:39.875463 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 00:42:39.875463 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 00:42:39.875463 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 00:42:39.875463 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 00:42:39.875463 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 00:42:39.875463 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 00:42:39.875463 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application conn.query(q) Aug 28 00:42:39.875463 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 00:42:39.875463 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 00:42:39.875463 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 00:42:39.876395 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application result.read() Aug 28 00:42:39.876395 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 00:42:39.876395 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 00:42:39.876395 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 00:42:39.876395 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 00:42:39.876395 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 00:42:39.876395 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 00:42:39.876395 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 00:42:39.876395 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 00:42:39.876395 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 28 00:42:39.876395 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:39.876395 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 28 00:42:39.876395 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:39.876395 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:39.876395 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 00:42:39.876395 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 00:42:39.876395 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 28 00:42:39.876395 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 28 00:42:39.877384 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 00:42:39.877384 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application next(self.gen) Aug 28 00:42:39.877384 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 00:42:39.877384 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application yield resource Aug 28 00:42:39.877384 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 00:42:39.877384 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application next(self.gen) Aug 28 00:42:39.877384 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 00:42:39.877384 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 00:42:39.877384 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 00:42:39.877384 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 00:42:39.877384 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 00:42:39.877384 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise self.value Aug 28 00:42:39.877384 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 00:42:39.877384 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 00:42:39.877384 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 00:42:39.877384 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application session.commit() Aug 28 00:42:39.877384 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 00:42:39.879032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 00:42:39.879032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 00:42:39.879032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 00:42:39.879032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 00:42:39.879032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self.session.flush() Aug 28 00:42:39.879032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 00:42:39.879032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 00:42:39.879032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 00:42:39.879032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 00:42:39.879032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 00:42:39.879032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application compat.raise_( Aug 28 00:42:39.879032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 00:42:39.879032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception Aug 28 00:42:39.879032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 00:42:39.879032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 00:42:39.879032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 00:42:39.879032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 00:42:39.880163 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 28 00:42:39.880163 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 28 00:42:39.880163 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 28 00:42:39.880163 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 28 00:42:39.880163 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 28 00:42:39.880163 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 28 00:42:39.880163 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 28 00:42:39.880163 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 28 00:42:39.880163 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 28 00:42:39.880163 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 28 00:42:39.880163 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 28 00:42:39.880163 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 28 00:42:39.880163 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 28 00:42:39.880163 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 28 00:42:39.880163 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 28 00:42:39.881367 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 28 00:42:39.881367 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 00:42:39.881367 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception Aug 28 00:42:39.881367 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 00:42:39.881367 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 00:42:39.881367 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 00:42:39.881367 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 00:42:39.881367 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 00:42:39.881367 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 00:42:39.881367 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 00:42:39.881367 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application conn.query(q) Aug 28 00:42:39.881367 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 00:42:39.881367 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 00:42:39.881367 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 00:42:39.881367 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application result.read() Aug 28 00:42:39.881367 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 00:42:39.881367 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 00:42:39.882970 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 00:42:39.882970 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 00:42:39.882970 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 00:42:39.882970 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 00:42:39.882970 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 00:42:39.882970 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 00:42:39.882970 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 28 00:42:39.882970 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 28 00:42:39.882970 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [parameters: {'id': 'dda63674bf72460bbd5540b07576f114', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 28 00:42:39.882970 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 28 00:42:39.882970 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:39.882970 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:42:39.882970 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:39.882970 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:39.882970 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 28 00:42:39.883977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 28 00:42:39.883977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 28 00:42:39.883977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 28 00:42:39.883977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 28 00:42:39.883977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:39.883977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:42:39.883977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:39.883977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:39.883977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:39.883977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:39.883977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:39.883977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:39.883977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:39.883977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:39.883977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:39.883977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:39.883977 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:39.885069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:39.885069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 28 00:42:39.885069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 28 00:42:39.885069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:39.885069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:39.885069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 28 00:42:39.885069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 28 00:42:39.885069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dda63674bf72460bbd5540b07576f114. Aug 28 00:42:39.885069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:39.885069 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 477/938] 10.222.0.52 () {60 vars in 1140 bytes} [Sun Aug 28 00:42:39 2022] POST /identity/v3/projects => generated 262 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:42:39.885069 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdacc4fe-8183-41e9-9331-18d6696e3846 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:39.897540 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cebc5-8b53-42b9-b9cd-6cdc83ff9102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:39.898213 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cebc5-8b53-42b9-b9cd-6cdc83ff9102 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:39.898646 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cebc5-8b53-42b9-b9cd-6cdc83ff9102 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:39.898924 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cebc5-8b53-42b9-b9cd-6cdc83ff9102 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:39.911412 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0cebc5-8b53-42b9-b9cd-6cdc83ff9102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:39.913042 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0cebc5-8b53-42b9-b9cd-6cdc83ff9102 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:39.932043 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-db0cebc5-8b53-42b9-b9cd-6cdc83ff9102 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:39.932043 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:39.932043 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:39.932043 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:39.932043 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:39.932043 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:39.932043 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:39.932043 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:39.932043 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:39.932043 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:39.932043 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:39.932043 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:39.932043 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:39.932043 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:39.932043 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:39.932043 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:39.934397 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:39.934397 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:39.934397 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:39.934397 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:39.934397 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:39.934397 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:39.934397 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:39.934397 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:39.934397 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:39.934397 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:39.934397 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:39.934397 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:39.934397 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:39.934397 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:39.934397 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:39.934397 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:39.934397 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:39.936648 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:39.936648 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:39.936648 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:39.945867 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 462/939] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:42:39.945867 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cebc5-8b53-42b9-b9cd-6cdc83ff9102 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:39.996084 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:39.997549 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:40.000559 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdacc4fe-8183-41e9-9331-18d6696e3846 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:40.038071 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74187e6-e979-48dd-9f02-52e2376c5900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:40.038601 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74187e6-e979-48dd-9f02-52e2376c5900 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:40.038946 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74187e6-e979-48dd-9f02-52e2376c5900 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:40.039281 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74187e6-e979-48dd-9f02-52e2376c5900 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:40.046560 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74187e6-e979-48dd-9f02-52e2376c5900 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:40.048295 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74187e6-e979-48dd-9f02-52e2376c5900 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:40.054184 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cebc5-8b53-42b9-b9cd-6cdc83ff9102 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:40.060761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-c74187e6-e979-48dd-9f02-52e2376c5900 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:40.060761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:40.060761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:40.060761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:40.060761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:40.060761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:40.060761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:40.060761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:40.060761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:40.060761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:40.060761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:40.060761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:40.060761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:42:40.060761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:42:40.060761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:42:40.062817 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:42:40.062817 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:40.062817 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:40.062817 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:40.062817 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:40.062817 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:40.062817 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:40.062817 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:40.062817 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:40.062817 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:40.062817 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:40.062817 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:40.062817 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:40.062817 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:40.062817 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:40.062817 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:40.062817 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:40.063939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:42:40.063939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:42:40.063939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:42:40.063939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:42:40.063939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:42:40.063939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:42:40.063939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:40.063939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:40.068129 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 478/940] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:42:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:40.069097 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74187e6-e979-48dd-9f02-52e2376c5900 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:40.091851 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc2de2-3b6f-40f1-a467-42094158cb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:40.092463 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc2de2-3b6f-40f1-a467-42094158cb42 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:40.092739 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc2de2-3b6f-40f1-a467-42094158cb42 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:40.093009 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc2de2-3b6f-40f1-a467-42094158cb42 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:40.093673 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc2de2-3b6f-40f1-a467-42094158cb42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:40.094039 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc2de2-3b6f-40f1-a467-42094158cb42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:40.095738 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc2de2-3b6f-40f1-a467-42094158cb42 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:40.113741 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 463/941] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:40.114837 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc2de2-3b6f-40f1-a467-42094158cb42 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:40.174676 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74187e6-e979-48dd-9f02-52e2376c5900 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:40.209515 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91520e-a57b-4f7d-8a24-5df333185f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:40.210254 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91520e-a57b-4f7d-8a24-5df333185f38 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:40.210598 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91520e-a57b-4f7d-8a24-5df333185f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:40.210933 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91520e-a57b-4f7d-8a24-5df333185f38 None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:40.211680 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91520e-a57b-4f7d-8a24-5df333185f38 None admin] RBAC: Adding query filter params (name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:40.212049 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91520e-a57b-4f7d-8a24-5df333185f38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:40.213552 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91520e-a57b-4f7d-8a24-5df333185f38 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:40.222854 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc2de2-3b6f-40f1-a467-42094158cb42 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:40.235042 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:40.240787 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 479/942] 10.222.0.52 () {56 vars in 1112 bytes} [Sun Aug 28 00:42:40 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:40.264073 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e06d17-7a83-4ad5-b109-96658f0c3415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:40.264989 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e06d17-7a83-4ad5-b109-96658f0c3415 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:40.265494 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e06d17-7a83-4ad5-b109-96658f0c3415 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:40.265946 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e06d17-7a83-4ad5-b109-96658f0c3415 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:40.274807 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e06d17-7a83-4ad5-b109-96658f0c3415 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:40.276739 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e06d17-7a83-4ad5-b109-96658f0c3415 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:40.290458 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-c4e06d17-7a83-4ad5-b109-96658f0c3415 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:42:40.290458 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:40.290458 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:40.290458 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:40.290458 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:40.290458 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:40.290458 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:40.290458 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:40.290458 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:40.290458 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:40.290458 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:40.290458 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:40.290458 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:42:40.290458 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:42:40.290458 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:42:40.290458 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:42:40.292172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:40.292172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:40.292172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:42:40.292172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:40.292172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:42:40.292172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:40.292172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:40.292172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:40.292172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:40.292172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:40.292172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:40.292172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:40.292172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:40.292172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:40.292172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:40.292172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:40.292172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:40.292172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:40.293460 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:40.293460 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:40.293460 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:42:40.293460 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:42:40.293460 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:42:40.293460 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:42:40.293460 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:42:40.293460 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:42:40.293460 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:42:40.293460 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:40.296498 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 464/943] 10.222.0.52 () {56 vars in 1117 bytes} [Sun Aug 28 00:42:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:42:40.302705 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91520e-a57b-4f7d-8a24-5df333185f38 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:40.325499 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:40.418308 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91520e-a57b-4f7d-8a24-5df333185f38 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:40.449664 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b90ca7-6a18-4cf5-be15-2e87274541a4 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:40.450051 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b90ca7-6a18-4cf5-be15-2e87274541a4 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:40.450374 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b90ca7-6a18-4cf5-be15-2e87274541a4 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:40.454118 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 465/944] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:42:40.457235 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0f64a-f69e-4133-9b02-72269a369e98 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:40.457517 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0f64a-f69e-4133-9b02-72269a369e98 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:40.458586 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0f64a-f69e-4133-9b02-72269a369e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:40.462287 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3ff5d-bd17-4076-b4a1-15bee9d30a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:40.462911 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3ff5d-bd17-4076-b4a1-15bee9d30a45 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:40.463191 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3ff5d-bd17-4076-b4a1-15bee9d30a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:40.463463 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3ff5d-bd17-4076-b4a1-15bee9d30a45 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:40.464211 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3ff5d-bd17-4076-b4a1-15bee9d30a45 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:40.464513 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3ff5d-bd17-4076-b4a1-15bee9d30a45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:40.466099 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3ff5d-bd17-4076-b4a1-15bee9d30a45 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:40.478041 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-63c0f64a-f69e-4133-9b02-72269a369e98 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:40.479520 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-63c0f64a-f69e-4133-9b02-72269a369e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:40.486291 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 480/945] 10.222.0.52 () {56 vars in 1149 bytes} [Sun Aug 28 00:42:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:40.491966 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3ff5d-bd17-4076-b4a1-15bee9d30a45 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:40.577866 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 466/946] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:42:40.591419 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:40.615500 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3ff5d-bd17-4076-b4a1-15bee9d30a45 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:40.649034 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2608d8-da55-4fce-881a-e1c7cef8ca40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:40.649719 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2608d8-da55-4fce-881a-e1c7cef8ca40 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:40.650052 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2608d8-da55-4fce-881a-e1c7cef8ca40 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:40.650321 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2608d8-da55-4fce-881a-e1c7cef8ca40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:40.664257 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2608d8-da55-4fce-881a-e1c7cef8ca40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:40.665772 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2608d8-da55-4fce-881a-e1c7cef8ca40 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:40.680702 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-3c2608d8-da55-4fce-881a-e1c7cef8ca40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:40.680702 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:40.680702 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:40.680702 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:40.680702 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:40.680702 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:40.680702 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:40.680702 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:40.680702 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:40.680702 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:40.680702 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:40.680702 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:40.680702 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:40.680702 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:40.680702 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:40.680702 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:40.681777 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:40.681777 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:40.681777 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:40.681777 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:40.681777 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:40.681777 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:40.681777 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:40.681777 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:40.681777 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:40.681777 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:40.681777 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:40.681777 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:40.681777 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:40.681777 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:40.681777 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:40.681777 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:40.681777 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:40.682786 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:40.682786 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:40.682786 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:40.686363 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 481/947] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:40.688319 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0f64a-f69e-4133-9b02-72269a369e98 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:40.801100 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:40.806009 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0f64a-f69e-4133-9b02-72269a369e98 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:40.842833 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a9b63-4f86-4a44-83bb-b6db86c6c790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:40.843452 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a9b63-4f86-4a44-83bb-b6db86c6c790 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:40.843725 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a9b63-4f86-4a44-83bb-b6db86c6c790 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:40.844039 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a9b63-4f86-4a44-83bb-b6db86c6c790 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:40.844688 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a9b63-4f86-4a44-83bb-b6db86c6c790 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:40.844985 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a9b63-4f86-4a44-83bb-b6db86c6c790 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:40.846764 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a9b63-4f86-4a44-83bb-b6db86c6c790 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:40.858786 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 467/948] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:40.864427 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2608d8-da55-4fce-881a-e1c7cef8ca40 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:40.877063 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a9b63-4f86-4a44-83bb-b6db86c6c790 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:40.986389 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a9b63-4f86-4a44-83bb-b6db86c6c790 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:41.003388 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2608d8-da55-4fce-881a-e1c7cef8ca40 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:41.032828 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2627d-e80c-4e36-852b-a934f032a789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:41.033382 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2627d-e80c-4e36-852b-a934f032a789 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:41.033657 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2627d-e80c-4e36-852b-a934f032a789 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:41.033963 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2627d-e80c-4e36-852b-a934f032a789 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:41.034585 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2627d-e80c-4e36-852b-a934f032a789 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:41.035920 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2627d-e80c-4e36-852b-a934f032a789 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:41.037439 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:41.046337 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-25e2627d-e80c-4e36-852b-a934f032a789 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:42:41.046337 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:41.046337 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:42:41.046337 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:42:41.046337 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:42:41.046337 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:42:41.046337 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:42:41.046337 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:41.046337 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:42:41.046337 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:41.046337 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:42:41.046337 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:41.046337 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:41.046337 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:41.046337 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:41.046337 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:41.046337 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:41.047440 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:41.047440 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:41.047440 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:41.047440 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:41.047440 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:41.047440 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:41.047440 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:42:41.047440 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:42:41.047440 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:42:41.047440 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:42:41.047440 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:41.047440 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:41.047440 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:41.047440 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:41.047440 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:41.047440 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:41.053442 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:41.053442 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:41.053442 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:41.053442 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:41.053442 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:41.053442 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:41.053442 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:41.053442 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:41.053442 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:41.053442 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:41.053442 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:42:41.053442 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:41.053442 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:42:41.053442 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:41.053442 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 468/949] 10.222.0.52 () {56 vars in 1126 bytes} [Sun Aug 28 00:42:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:42:41.054345 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2627d-e80c-4e36-852b-a934f032a789 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:41.055062 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0720c25-06d5-42e2-946e-9b575f24cc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:41.055558 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0720c25-06d5-42e2-946e-9b575f24cc07 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:41.055832 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0720c25-06d5-42e2-946e-9b575f24cc07 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:41.056567 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0720c25-06d5-42e2-946e-9b575f24cc07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:41.064769 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0720c25-06d5-42e2-946e-9b575f24cc07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:41.066318 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0720c25-06d5-42e2-946e-9b575f24cc07 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:41.078331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-c0720c25-06d5-42e2-946e-9b575f24cc07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:41.078331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:41.078331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:41.078331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:41.078331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:41.078331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:41.078331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:41.078331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:41.078331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:41.078331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:41.078331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:41.078331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:41.078331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:42:41.078331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:42:41.078331 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:42:41.080514 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:42:41.080514 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:41.080514 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:41.080514 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:41.080514 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:41.080514 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:41.080514 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:41.080514 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:41.080514 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:41.080514 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:41.080514 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:41.080514 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:41.080514 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:41.080514 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:41.080514 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:41.080514 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:41.080514 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:41.084958 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:42:41.084958 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:42:41.084958 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:42:41.084958 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:42:41.084958 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:42:41.084958 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:42:41.084958 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:41.084958 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:41.086161 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 482/950] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:42:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:41.088857 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0720c25-06d5-42e2-946e-9b575f24cc07 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:41.096315 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:41.200807 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2627d-e80c-4e36-852b-a934f032a789 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:41.209279 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0720c25-06d5-42e2-946e-9b575f24cc07 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:41.243541 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d8a24-f8c8-4004-a483-39e30d18c39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:41.243796 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd500c7-498d-4eb7-812e-7b666260f88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:41.244270 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd500c7-498d-4eb7-812e-7b666260f88c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:41.244545 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd500c7-498d-4eb7-812e-7b666260f88c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:41.244810 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd500c7-498d-4eb7-812e-7b666260f88c None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:41.245302 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d8a24-f8c8-4004-a483-39e30d18c39c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:41.245501 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd500c7-498d-4eb7-812e-7b666260f88c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:41.245800 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd500c7-498d-4eb7-812e-7b666260f88c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:41.246214 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d8a24-f8c8-4004-a483-39e30d18c39c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:41.246687 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d8a24-f8c8-4004-a483-39e30d18c39c None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:41.247246 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd500c7-498d-4eb7-812e-7b666260f88c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:41.247900 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d8a24-f8c8-4004-a483-39e30d18c39c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:41.248603 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d8a24-f8c8-4004-a483-39e30d18c39c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:41.250380 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d8a24-f8c8-4004-a483-39e30d18c39c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:41.261129 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 469/952] 10.222.0.52 () {56 vars in 1122 bytes} [Sun Aug 28 00:42:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:41.262419 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d8a24-f8c8-4004-a483-39e30d18c39c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:41.264693 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 483/952] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:42:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:41.265739 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd500c7-498d-4eb7-812e-7b666260f88c None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:41.314961 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:41.358892 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:41.370275 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd500c7-498d-4eb7-812e-7b666260f88c None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:41.372788 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d8a24-f8c8-4004-a483-39e30d18c39c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:41.404008 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54d6aa-5a3c-4ce8-9066-cf007dc98ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:41.404725 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54d6aa-5a3c-4ce8-9066-cf007dc98ee5 None admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:41.405005 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54d6aa-5a3c-4ce8-9066-cf007dc98ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:41.405277 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54d6aa-5a3c-4ce8-9066-cf007dc98ee5 None admin] PATH_INFO: `/v3/projects/45c69e3e973c449895457bb610103a43/users/3302fdf33b5b4583a10e7c760c577cda/roles/40e39507eac04ff6b770e29fce3b7e81` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:41.407524 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54d6aa-5a3c-4ce8-9066-cf007dc98ee5 None admin] RBAC: Authorizing `identity:create_grant(project_id=45c69e3e973c449895457bb610103a43, user_id=3302fdf33b5b4583a10e7c760c577cda, role_id=40e39507eac04ff6b770e29fce3b7e81)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:41.408524 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55adb4-9a88-48a6-a35c-08788ba54c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:41.408964 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54d6aa-5a3c-4ce8-9066-cf007dc98ee5 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:41.409139 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55adb4-9a88-48a6-a35c-08788ba54c52 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:41.409406 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55adb4-9a88-48a6-a35c-08788ba54c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:41.409678 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55adb4-9a88-48a6-a35c-08788ba54c52 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:41.410355 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55adb4-9a88-48a6-a35c-08788ba54c52 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:41.410658 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55adb4-9a88-48a6-a35c-08788ba54c52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:41.412338 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55adb4-9a88-48a6-a35c-08788ba54c52 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:41.418115 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 470/953] 10.222.0.52 () {56 vars in 1122 bytes} [Sun Aug 28 00:42:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:41.419394 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fe680-e678-4320-a26e-dbdc8432bc86 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:41.419685 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fe680-e678-4320-a26e-dbdc8432bc86 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:41.420146 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fe680-e678-4320-a26e-dbdc8432bc86 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:41.421706 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 471/954] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:41.426601 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fe680-e678-4320-a26e-dbdc8432bc86 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:41.427374 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 484/955] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Aug 28 00:42:41 2022] PUT /identity/v3/projects/45c69e3e973c449895457bb610103a43/users/3302fdf33b5b4583a10e7c760c577cda/roles/40e39507eac04ff6b770e29fce3b7e81 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:42:41.432510 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa34ce-dc9e-42ba-9b05-e21fd9c5a962 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:41.433185 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa34ce-dc9e-42ba-9b05-e21fd9c5a962 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:41.433710 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa34ce-dc9e-42ba-9b05-e21fd9c5a962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:41.458639 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-d4aa34ce-dc9e-42ba-9b05-e21fd9c5a962 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:41.460264 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d4aa34ce-dc9e-42ba-9b05-e21fd9c5a962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:41.552782 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 485/956] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:42:41.571741 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fe680-e678-4320-a26e-dbdc8432bc86 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:41.612442 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7593318-1684-4e91-9b3c-0f4010bf4b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:41.613423 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7593318-1684-4e91-9b3c-0f4010bf4b68 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:41.614009 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7593318-1684-4e91-9b3c-0f4010bf4b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:41.614489 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7593318-1684-4e91-9b3c-0f4010bf4b68 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:41.615370 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7593318-1684-4e91-9b3c-0f4010bf4b68 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:41.616982 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7593318-1684-4e91-9b3c-0f4010bf4b68 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:41.640655 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 472/957] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:42:41 2022] POST /identity/v3/endpoints => generated 349 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:42:41.829443 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa34ce-dc9e-42ba-9b05-e21fd9c5a962 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:41.872803 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:41.938638 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa34ce-dc9e-42ba-9b05-e21fd9c5a962 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:41.992803 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aad2ae-b678-40f6-a82b-96161c591d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:41.993456 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aad2ae-b678-40f6-a82b-96161c591d47 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:41.993734 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aad2ae-b678-40f6-a82b-96161c591d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:41.994039 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aad2ae-b678-40f6-a82b-96161c591d47 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:41.994628 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aad2ae-b678-40f6-a82b-96161c591d47 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:41.996038 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aad2ae-b678-40f6-a82b-96161c591d47 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:42.006257 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-b5aad2ae-b678-40f6-a82b-96161c591d47 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:42:42.006257 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:42.006257 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:42:42.006257 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:42:42.006257 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:42:42.006257 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:42:42.006257 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:42:42.006257 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:42.006257 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:42:42.006257 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:42.006257 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:42:42.006257 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:42.006257 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:42.006257 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:42.006257 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:42.006257 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:42.006257 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:42.007437 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:42.007437 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:42.007437 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:42.007437 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:42.007437 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:42.007437 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:42.007437 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:42:42.007437 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:42:42.007437 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:42:42.007437 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:42:42.007437 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:42.007437 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:42.007437 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:42.007437 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:42.007437 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:42.007437 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:42.008548 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:42.008548 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:42.008548 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:42.008548 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:42.008548 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:42.008548 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:42.008548 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:42.008548 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:42.008548 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:42.008548 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:42.008548 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:42:42.008548 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:42.008548 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:42:42.008548 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:42.008548 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 486/958] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:42:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:42.016724 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7593318-1684-4e91-9b3c-0f4010bf4b68 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:42.029911 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:42.134525 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7593318-1684-4e91-9b3c-0f4010bf4b68 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:42.173534 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e06b00-af2f-4865-a7e8-5dd45151b1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:42.174733 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e06b00-af2f-4865-a7e8-5dd45151b1a7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:42.175222 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e06b00-af2f-4865-a7e8-5dd45151b1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:42.175681 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e06b00-af2f-4865-a7e8-5dd45151b1a7 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:42.176643 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e06b00-af2f-4865-a7e8-5dd45151b1a7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:42.177467 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e06b00-af2f-4865-a7e8-5dd45151b1a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:42.179387 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e06b00-af2f-4865-a7e8-5dd45151b1a7 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:42.187719 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 473/959] 10.222.0.52 () {56 vars in 1112 bytes} [Sun Aug 28 00:42:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:42.194070 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aad2ae-b678-40f6-a82b-96161c591d47 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:42.296411 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:42.300597 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aad2ae-b678-40f6-a82b-96161c591d47 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:42.336865 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9defc-e843-4bab-8bbe-daf6e932f5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:42.337483 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9defc-e843-4bab-8bbe-daf6e932f5cc None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:42.337762 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9defc-e843-4bab-8bbe-daf6e932f5cc None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:42.338063 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9defc-e843-4bab-8bbe-daf6e932f5cc None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:42.338772 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e9defc-e843-4bab-8bbe-daf6e932f5cc None admin] RBAC: Adding query filter params (type=compute) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:42.339081 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e9defc-e843-4bab-8bbe-daf6e932f5cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:42.340483 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e9defc-e843-4bab-8bbe-daf6e932f5cc None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:42.346812 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4aa6be-1529-4917-8a6e-bb725be1b846 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:42.347004 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 487/960] 10.222.0.52 () {56 vars in 1112 bytes} [Sun Aug 28 00:42:42 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:42.347095 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4aa6be-1529-4917-8a6e-bb725be1b846 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:42.347349 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4aa6be-1529-4917-8a6e-bb725be1b846 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:42.348853 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 474/961] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:42.355885 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6967f-8aef-4229-ae47-c3a31756212d None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:42.356207 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6967f-8aef-4229-ae47-c3a31756212d None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:42.356569 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6967f-8aef-4229-ae47-c3a31756212d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:42.380533 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-04d6967f-8aef-4229-ae47-c3a31756212d None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:42.382240 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-04d6967f-8aef-4229-ae47-c3a31756212d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:42.470646 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 488/962] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:42:42.761067 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4aa6be-1529-4917-8a6e-bb725be1b846 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:42.845065 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:42.879032 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4aa6be-1529-4917-8a6e-bb725be1b846 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:42.918756 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc25b6-992c-4779-868f-b26904776f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:42.919367 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc25b6-992c-4779-868f-b26904776f15 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:42.919644 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc25b6-992c-4779-868f-b26904776f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:42.919966 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc25b6-992c-4779-868f-b26904776f15 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:42.920811 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc25b6-992c-4779-868f-b26904776f15 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:42.922392 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc25b6-992c-4779-868f-b26904776f15 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:42.925021 dv-cinder-master-3-smb devstack@keystone.service[81517]: WARNING keystone.server.flask.common [None req-eadc25b6-992c-4779-868f-b26904776f15 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 28 00:42:42.938399 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.sql.core [None req-eadc25b6-992c-4779-868f-b26904776f15 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 28 00:42:42.938399 dv-cinder-master-3-smb devstack@keystone.service[81517]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 28 00:42:42.938399 dv-cinder-master-3-smb devstack@keystone.service[81517]: [parameters: {'user_id': 'bf8a73fc45264e3ea9f5b7b867c71301', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 28 00:42:42.938399 dv-cinder-master-3-smb devstack@keystone.service[81517]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81517) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 28 00:42:42.945885 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-eadc25b6-992c-4779-868f-b26904776f15 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 28 00:42:42.945885 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:42.945885 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 00:42:42.945885 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 00:42:42.945885 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 00:42:42.945885 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 00:42:42.945885 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 00:42:42.945885 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 00:42:42.945885 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 00:42:42.945885 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application conn.query(q) Aug 28 00:42:42.945885 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 00:42:42.945885 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 00:42:42.945885 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 00:42:42.945885 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application result.read() Aug 28 00:42:42.945885 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 00:42:42.946951 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 00:42:42.946951 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 00:42:42.946951 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 00:42:42.946951 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 00:42:42.946951 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 00:42:42.946951 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 00:42:42.946951 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 00:42:42.946951 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 28 00:42:42.946951 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:42.946951 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 28 00:42:42.946951 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:42.946951 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:42.946951 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 00:42:42.946951 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 00:42:42.946951 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 28 00:42:42.946951 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 28 00:42:42.946951 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 00:42:42.946951 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application next(self.gen) Aug 28 00:42:42.948859 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 00:42:42.948859 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application yield resource Aug 28 00:42:42.948859 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 00:42:42.948859 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application next(self.gen) Aug 28 00:42:42.948859 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 00:42:42.948859 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 00:42:42.948859 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 00:42:42.948859 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 00:42:42.948859 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 00:42:42.948859 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise self.value Aug 28 00:42:42.948859 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 00:42:42.948859 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 00:42:42.948859 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 00:42:42.948859 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application session.commit() Aug 28 00:42:42.948859 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 00:42:42.948859 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 00:42:42.948859 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 00:42:42.950330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 00:42:42.950330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 00:42:42.950330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self.session.flush() Aug 28 00:42:42.950330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 00:42:42.950330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 00:42:42.950330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 00:42:42.950330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 00:42:42.950330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 00:42:42.950330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application compat.raise_( Aug 28 00:42:42.950330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 00:42:42.950330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception Aug 28 00:42:42.950330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 00:42:42.950330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 00:42:42.950330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 00:42:42.950330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 00:42:42.950330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 28 00:42:42.950330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 28 00:42:42.952175 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 28 00:42:42.952175 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 28 00:42:42.952175 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 28 00:42:42.952175 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 28 00:42:42.952175 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 28 00:42:42.952175 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 28 00:42:42.952175 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 28 00:42:42.952175 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 28 00:42:42.952175 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 28 00:42:42.952175 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 28 00:42:42.952175 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 28 00:42:42.952175 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 28 00:42:42.952175 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 28 00:42:42.952175 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 28 00:42:42.952175 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 00:42:42.952175 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception Aug 28 00:42:42.958598 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 00:42:42.958598 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 00:42:42.958598 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 00:42:42.958598 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 00:42:42.958598 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 00:42:42.958598 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 00:42:42.958598 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 00:42:42.958598 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application conn.query(q) Aug 28 00:42:42.958598 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 00:42:42.958598 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 00:42:42.958598 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 00:42:42.958598 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application result.read() Aug 28 00:42:42.958598 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 00:42:42.958598 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 00:42:42.958598 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 00:42:42.958598 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 00:42:42.961049 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 00:42:42.961049 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 00:42:42.961049 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 00:42:42.961049 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 00:42:42.961049 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 28 00:42:42.961049 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 28 00:42:42.961049 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [parameters: {'user_id': 'bf8a73fc45264e3ea9f5b7b867c71301', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 28 00:42:42.961049 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 28 00:42:42.961049 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:42.961049 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:42:42.961049 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:42.961049 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:42.961049 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:42.961049 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:42.961049 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:42.964312 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:42.964312 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:42.964312 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:42.964312 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:42.964312 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:42.964312 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:42.964312 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:42.964312 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 28 00:42:42.964312 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 28 00:42:42.964312 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:42.964312 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:42.964312 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:42:42.964312 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:42.964312 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:42:42.964312 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:42.964312 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 28 00:42:42.964312 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 28 00:42:42.966791 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 28 00:42:42.966791 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 28 00:42:42.966791 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 28 00:42:42.966791 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 28 00:42:42.966791 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 28 00:42:42.966791 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:42.966791 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 475/963] 10.222.0.52 () {60 vars in 1131 bytes} [Sun Aug 28 00:42:42 2022] POST /identity/v3/users => generated 160 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:42.968241 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6967f-8aef-4229-ae47-c3a31756212d None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:43.069371 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:43.081539 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6967f-8aef-4229-ae47-c3a31756212d None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:43.124109 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc34ec7-848b-46dc-84e1-34ab79d233b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:43.125147 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc34ec7-848b-46dc-84e1-34ab79d233b1 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:43.125632 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc34ec7-848b-46dc-84e1-34ab79d233b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:43.126121 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc34ec7-848b-46dc-84e1-34ab79d233b1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:43.134560 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc34ec7-848b-46dc-84e1-34ab79d233b1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:43.136598 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc34ec7-848b-46dc-84e1-34ab79d233b1 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:43.151923 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-fbc34ec7-848b-46dc-84e1-34ab79d233b1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 00:42:43.151923 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:43.151923 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:43.151923 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:43.151923 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:43.151923 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:43.151923 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:43.151923 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:43.151923 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:43.151923 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:43.151923 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:43.151923 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:43.151923 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:42:43.151923 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:42:43.151923 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:42:43.151923 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:42:43.153019 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:43.153019 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:43.153019 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:42:43.153019 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:43.153019 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:42:43.153019 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:43.153019 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:43.153019 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:43.153019 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:43.153019 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:43.153019 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:43.153019 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:43.153019 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:43.153019 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:43.153019 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:43.153019 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:43.153019 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:43.153019 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:43.154332 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:43.154332 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:43.154332 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:42:43.154332 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:42:43.154332 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:42:43.154332 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:42:43.154332 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:42:43.154332 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:42:43.154332 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 00:42:43.154332 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:43.156969 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 489/964] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:42:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:43.163176 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc25b6-992c-4779-868f-b26904776f15 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:43.274076 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc25b6-992c-4779-868f-b26904776f15 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:43.308993 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb8b15-f79c-4f44-ae43-d11cfee30047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:43.309612 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb8b15-f79c-4f44-ae43-d11cfee30047 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:43.309912 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb8b15-f79c-4f44-ae43-d11cfee30047 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:43.310186 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb8b15-f79c-4f44-ae43-d11cfee30047 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:43.310931 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb8b15-f79c-4f44-ae43-d11cfee30047 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:43.311233 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb8b15-f79c-4f44-ae43-d11cfee30047 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:43.312887 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb8b15-f79c-4f44-ae43-d11cfee30047 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:43.325731 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:43.361213 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 476/965] 10.222.0.52 () {56 vars in 1101 bytes} [Sun Aug 28 00:42:43 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:43.615642 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b138c9d-dfbd-4c22-b723-9629de1ed5bc None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:43.615831 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b138c9d-dfbd-4c22-b723-9629de1ed5bc None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:43.616103 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b138c9d-dfbd-4c22-b723-9629de1ed5bc None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:43.617587 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 490/966] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:42:43.622694 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9c6a7-541a-47a0-8797-2109a40ffc57 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:43.623108 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9c6a7-541a-47a0-8797-2109a40ffc57 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:43.623383 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9c6a7-541a-47a0-8797-2109a40ffc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:43.646512 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-22b9c6a7-541a-47a0-8797-2109a40ffc57 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:43.646512 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-22b9c6a7-541a-47a0-8797-2109a40ffc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:43.713544 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 477/967] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:42:43.718806 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18eaf24-548a-4bd3-a448-7f4457cc54d6 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:43.719079 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18eaf24-548a-4bd3-a448-7f4457cc54d6 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:43.719368 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18eaf24-548a-4bd3-a448-7f4457cc54d6 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:43.721152 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 491/968] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:43.726393 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b44d39-3970-4e1c-b29a-1ffa86ba422b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:43.726683 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b44d39-3970-4e1c-b29a-1ffa86ba422b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:43.726953 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b44d39-3970-4e1c-b29a-1ffa86ba422b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:43.745568 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-57b44d39-3970-4e1c-b29a-1ffa86ba422b None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:43.746798 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-57b44d39-3970-4e1c-b29a-1ffa86ba422b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:43.816695 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 478/969] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:42:43.978502 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18eaf24-548a-4bd3-a448-7f4457cc54d6 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:44.080406 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b44d39-3970-4e1c-b29a-1ffa86ba422b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:44.081271 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18eaf24-548a-4bd3-a448-7f4457cc54d6 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:44.115692 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757ac68-ba2e-4e6f-8a32-d1d9caee2ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:44.116659 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757ac68-ba2e-4e6f-8a32-d1d9caee2ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:44.116932 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757ac68-ba2e-4e6f-8a32-d1d9caee2ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:44.117205 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757ac68-ba2e-4e6f-8a32-d1d9caee2ea3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:44.128079 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757ac68-ba2e-4e6f-8a32-d1d9caee2ea3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:42:44.132865 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-5757ac68-ba2e-4e6f-8a32-d1d9caee2ea3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:42:44.132865 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:44.132865 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:44.132865 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:44.132865 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:44.132865 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:44.132865 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:44.132865 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:44.132865 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:44.132865 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:44.132865 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:44.132865 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:44.132865 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:42:44.132865 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:42:44.132865 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:42:44.132865 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:42:44.133894 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:42:44.133894 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:42:44.133894 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:42:44.133894 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:42:44.133894 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:44.133894 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:44.133894 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:44.133894 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:44.133894 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:44.133894 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:44.133894 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:44.133894 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:44.133894 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:44.133894 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:44.133894 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:44.133894 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:44.135320 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:44.135320 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:44.135320 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:44.135320 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:44.135320 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:42:44.135320 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:42:44.135320 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:42:44.135320 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:42:44.135320 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:42:44.135320 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:42:44.135320 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:42:44.135320 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:44.135320 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 492/970] 10.222.0.52 () {56 vars in 1120 bytes} [Sun Aug 28 00:42:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:44.139905 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757ac68-ba2e-4e6f-8a32-d1d9caee2ea3 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:44.141158 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:44.155383 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:44.193234 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b44d39-3970-4e1c-b29a-1ffa86ba422b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:44.229173 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0b197-0b1e-4443-b508-823542c16bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:44.229718 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0b197-0b1e-4443-b508-823542c16bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:44.230027 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0b197-0b1e-4443-b508-823542c16bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:44.230295 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0b197-0b1e-4443-b508-823542c16bf1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:44.230875 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0b197-0b1e-4443-b508-823542c16bf1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:44.232383 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0b197-0b1e-4443-b508-823542c16bf1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:44.241729 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-d5e0b197-0b1e-4443-b508-823542c16bf1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:42:44.241729 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:44.241729 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:42:44.241729 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:42:44.241729 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:42:44.241729 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:42:44.241729 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:42:44.241729 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:44.241729 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:42:44.241729 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:44.241729 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:42:44.241729 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:44.241729 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:44.241729 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:44.241729 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:44.241729 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:44.241729 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:44.242868 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:44.242868 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:44.242868 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:44.242868 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:44.242868 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:44.242868 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:44.242868 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:42:44.242868 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:42:44.242868 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:42:44.242868 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:42:44.242868 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:44.242868 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:44.242868 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:44.242868 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:44.242868 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:44.242868 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:44.243721 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:44.243721 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:44.243721 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:44.243721 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:44.243721 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:44.243721 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:44.243721 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:44.243721 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:44.243721 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:44.243721 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:44.243721 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:42:44.243721 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:44.243721 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:42:44.243721 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:44.244456 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757ac68-ba2e-4e6f-8a32-d1d9caee2ea3 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:44.247949 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 479/971] 10.222.0.52 () {56 vars in 1126 bytes} [Sun Aug 28 00:42:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:42:44.248723 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0b197-0b1e-4443-b508-823542c16bf1 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:44.278473 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e4638-4341-476c-8637-fc1bc2cd7312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:44.279092 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e4638-4341-476c-8637-fc1bc2cd7312 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:44.279438 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e4638-4341-476c-8637-fc1bc2cd7312 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:44.279714 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e4638-4341-476c-8637-fc1bc2cd7312 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:44.280380 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e4638-4341-476c-8637-fc1bc2cd7312 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:44.280693 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e4638-4341-476c-8637-fc1bc2cd7312 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:44.282138 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e4638-4341-476c-8637-fc1bc2cd7312 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:44.290264 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 493/972] 10.222.0.52 () {56 vars in 1115 bytes} [Sun Aug 28 00:42:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:42:44.295849 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e4638-4341-476c-8637-fc1bc2cd7312 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:44.357069 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0b197-0b1e-4443-b508-823542c16bf1 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:44.370892 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:44.373360 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:44.391588 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb8af0-61f6-40b2-ae55-ad605a230070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:44.392184 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb8af0-61f6-40b2-ae55-ad605a230070 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:44.392452 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb8af0-61f6-40b2-ae55-ad605a230070 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:44.392714 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb8af0-61f6-40b2-ae55-ad605a230070 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:44.393332 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb8af0-61f6-40b2-ae55-ad605a230070 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:44.393626 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb8af0-61f6-40b2-ae55-ad605a230070 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:44.395065 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb8af0-61f6-40b2-ae55-ad605a230070 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:44.395514 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e4638-4341-476c-8637-fc1bc2cd7312 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:44.399903 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 480/973] 10.222.0.52 () {56 vars in 1122 bytes} [Sun Aug 28 00:42:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:42:44.401113 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4323bd2-3ad0-4504-845d-4b2d4e600032 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:44.401343 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4323bd2-3ad0-4504-845d-4b2d4e600032 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:44.401643 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4323bd2-3ad0-4504-845d-4b2d4e600032 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:44.403063 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 481/974] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:44.405897 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4323bd2-3ad0-4504-845d-4b2d4e600032 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:44.433676 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aaa387-36ff-404a-bfb6-37357f9be92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:44.434312 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aaa387-36ff-404a-bfb6-37357f9be92a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:44.434586 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aaa387-36ff-404a-bfb6-37357f9be92a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:44.434849 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aaa387-36ff-404a-bfb6-37357f9be92a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:44.445885 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aaa387-36ff-404a-bfb6-37357f9be92a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:44.447349 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aaa387-36ff-404a-bfb6-37357f9be92a None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:44.461261 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-d1aaa387-36ff-404a-bfb6-37357f9be92a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:44.461261 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:44.461261 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:44.461261 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:44.461261 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:44.461261 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:44.461261 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:44.461261 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:44.461261 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:44.461261 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:44.461261 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:44.461261 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:44.461261 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:44.461261 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:44.461261 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:44.461261 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:44.462485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:44.462485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:44.462485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:44.462485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:44.462485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:44.462485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:44.462485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:44.462485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:44.462485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:44.462485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:44.462485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:44.462485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:44.462485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:44.462485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:44.462485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:44.462485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:44.462485 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:44.463385 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:44.463385 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:44.463385 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:44.463385 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 494/975] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:42:44.464000 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0fea0-719e-402c-bdd2-513b41c701d4 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:44.464290 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0fea0-719e-402c-bdd2-513b41c701d4 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:44.464563 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0fea0-719e-402c-bdd2-513b41c701d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:44.484032 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-30a0fea0-719e-402c-bdd2-513b41c701d4 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:44.485144 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-30a0fea0-719e-402c-bdd2-513b41c701d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:44.513783 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4323bd2-3ad0-4504-845d-4b2d4e600032 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:44.548107 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80193b94-4aec-4b13-b762-514dbeee2207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:44.548713 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80193b94-4aec-4b13-b762-514dbeee2207 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:44.548986 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80193b94-4aec-4b13-b762-514dbeee2207 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:44.549249 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80193b94-4aec-4b13-b762-514dbeee2207 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:44.549902 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80193b94-4aec-4b13-b762-514dbeee2207 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:44.550198 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80193b94-4aec-4b13-b762-514dbeee2207 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:44.551581 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80193b94-4aec-4b13-b762-514dbeee2207 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:44.554652 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 495/976] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:42:44.555550 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0fea0-719e-402c-bdd2-513b41c701d4 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:44.561584 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 482/977] 10.222.0.52 () {56 vars in 1122 bytes} [Sun Aug 28 00:42:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:42:44.562491 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80193b94-4aec-4b13-b762-514dbeee2207 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:44.618844 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:44.623461 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:44.670674 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0fea0-719e-402c-bdd2-513b41c701d4 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:44.676977 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80193b94-4aec-4b13-b762-514dbeee2207 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:44.704903 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0310708-fbb1-4125-90e1-e4e2b3d54157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:44.705503 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0310708-fbb1-4125-90e1-e4e2b3d54157 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:44.705774 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0310708-fbb1-4125-90e1-e4e2b3d54157 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:44.706067 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0310708-fbb1-4125-90e1-e4e2b3d54157 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:44.706702 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0310708-fbb1-4125-90e1-e4e2b3d54157 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:44.706996 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0310708-fbb1-4125-90e1-e4e2b3d54157 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:44.708361 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0310708-fbb1-4125-90e1-e4e2b3d54157 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:44.713762 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99879f5-5087-4dee-ba7d-a40a5cde7c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:44.715058 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99879f5-5087-4dee-ba7d-a40a5cde7c4b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:44.715514 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99879f5-5087-4dee-ba7d-a40a5cde7c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:44.715972 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99879f5-5087-4dee-ba7d-a40a5cde7c4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:44.717301 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99879f5-5087-4dee-ba7d-a40a5cde7c4b None admin] RBAC: Adding query filter params (interface=admin, service_id=38842d59e9c24692beecfe51535d9e67, region_id=RegionOne) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:44.717781 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99879f5-5087-4dee-ba7d-a40a5cde7c4b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:44.719408 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 496/978] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:44.719525 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99879f5-5087-4dee-ba7d-a40a5cde7c4b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:44.725207 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0310708-fbb1-4125-90e1-e4e2b3d54157 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:44.725614 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 483/979] 10.222.0.52 () {56 vars in 1249 bytes} [Sun Aug 28 00:42:44 2022] GET /identity/v3/endpoints?service_id=38842d59e9c24692beecfe51535d9e67&interface=admin®ion_id=RegionOne => generated 193 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:44.730942 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99879f5-5087-4dee-ba7d-a40a5cde7c4b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:44.831227 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0310708-fbb1-4125-90e1-e4e2b3d54157 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:44.833312 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99879f5-5087-4dee-ba7d-a40a5cde7c4b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:44.842318 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:44.847776 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:44.865725 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177aea8-8aed-4fa3-a5b4-40e37d5367c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:44.866401 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177aea8-8aed-4fa3-a5b4-40e37d5367c5 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:44.866672 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177aea8-8aed-4fa3-a5b4-40e37d5367c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:44.866937 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177aea8-8aed-4fa3-a5b4-40e37d5367c5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:44.868220 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e68d09-72aa-495e-bb7d-4633d678dc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:44.868829 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e68d09-72aa-495e-bb7d-4633d678dc8e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:44.869109 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e68d09-72aa-495e-bb7d-4633d678dc8e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:44.869384 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e68d09-72aa-495e-bb7d-4633d678dc8e None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:44.870045 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e68d09-72aa-495e-bb7d-4633d678dc8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:44.871430 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e68d09-72aa-495e-bb7d-4633d678dc8e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:44.874274 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177aea8-8aed-4fa3-a5b4-40e37d5367c5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:44.875699 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177aea8-8aed-4fa3-a5b4-40e37d5367c5 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:44.877539 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 484/980] 10.222.0.52 () {56 vars in 1087 bytes} [Sun Aug 28 00:42:44 2022] GET /identity/v3/services => generated 1497 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:42:44.878344 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e68d09-72aa-495e-bb7d-4633d678dc8e None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:44.887226 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-9177aea8-8aed-4fa3-a5b4-40e37d5367c5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:42:44.887226 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:44.887226 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:44.887226 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:44.887226 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:44.887226 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:44.887226 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:44.887226 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:44.887226 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:44.887226 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:44.887226 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:44.887226 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:44.887226 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:42:44.887226 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:42:44.887226 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:42:44.887226 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:42:44.888489 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:44.888489 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:44.888489 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:42:44.888489 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:44.888489 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:42:44.888489 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:44.888489 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:44.888489 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:44.888489 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:44.888489 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:44.888489 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:44.888489 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:44.888489 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:44.888489 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:44.888489 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:44.888489 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:44.888489 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:44.888489 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:44.889502 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:44.889502 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:44.889502 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:42:44.889502 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:42:44.889502 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:42:44.889502 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:42:44.889502 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:42:44.889502 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:42:44.889502 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:42:44.889502 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:44.895709 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 497/981] 10.222.0.52 () {56 vars in 1117 bytes} [Sun Aug 28 00:42:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:42:44.896114 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177aea8-8aed-4fa3-a5b4-40e37d5367c5 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:44.992946 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e68d09-72aa-495e-bb7d-4633d678dc8e None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:45.009099 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177aea8-8aed-4fa3-a5b4-40e37d5367c5 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:45.030635 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d3390-1df1-4c36-89c6-de72834b90ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:45.031244 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d3390-1df1-4c36-89c6-de72834b90ba None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:45.031522 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d3390-1df1-4c36-89c6-de72834b90ba None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:45.032070 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d3390-1df1-4c36-89c6-de72834b90ba None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:45.033593 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d3390-1df1-4c36-89c6-de72834b90ba None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:45.033941 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d3390-1df1-4c36-89c6-de72834b90ba None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:45.049272 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a350abc-427a-49a8-ab40-57bc1c042b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:45.049905 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a350abc-427a-49a8-ab40-57bc1c042b0c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:45.050184 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a350abc-427a-49a8-ab40-57bc1c042b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:45.050348 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 485/982] 10.222.0.52 () {60 vars in 1141 bytes} [Sun Aug 28 00:42:44 2022] POST /identity/v3/services => generated 242 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:42:45.050464 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a350abc-427a-49a8-ab40-57bc1c042b0c None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:45.051169 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a350abc-427a-49a8-ab40-57bc1c042b0c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:45.051471 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a350abc-427a-49a8-ab40-57bc1c042b0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:45.052900 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a350abc-427a-49a8-ab40-57bc1c042b0c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:45.074333 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 498/983] 10.222.0.52 () {56 vars in 1149 bytes} [Sun Aug 28 00:42:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:42:45.080355 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d3390-1df1-4c36-89c6-de72834b90ba None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:45.117534 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:45.203512 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d3390-1df1-4c36-89c6-de72834b90ba None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:45.242758 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498e87d-ea7a-4ffa-bd22-1c922ccd5e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:45.243382 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498e87d-ea7a-4ffa-bd22-1c922ccd5e28 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:45.243659 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498e87d-ea7a-4ffa-bd22-1c922ccd5e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:45.243927 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498e87d-ea7a-4ffa-bd22-1c922ccd5e28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:45.315546 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498e87d-ea7a-4ffa-bd22-1c922ccd5e28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:45.317016 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498e87d-ea7a-4ffa-bd22-1c922ccd5e28 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:45.345104 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:45.421428 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 486/984] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:42:45 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:42:45.426966 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a350abc-427a-49a8-ab40-57bc1c042b0c None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:45.462125 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:45.538880 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a350abc-427a-49a8-ab40-57bc1c042b0c None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:45.574964 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f10f93-399f-4dd1-9b6e-59866976e77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:45.575591 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f10f93-399f-4dd1-9b6e-59866976e77e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:45.575871 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f10f93-399f-4dd1-9b6e-59866976e77e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:45.576218 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f10f93-399f-4dd1-9b6e-59866976e77e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:45.586700 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f10f93-399f-4dd1-9b6e-59866976e77e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:45.588156 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f10f93-399f-4dd1-9b6e-59866976e77e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:45.604721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-77f10f93-399f-4dd1-9b6e-59866976e77e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:45.604721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:45.604721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:45.604721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:45.604721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:45.604721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:45.604721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:45.604721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:45.604721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:45.604721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:45.604721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:45.604721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:45.604721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:45.604721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:45.604721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:45.604721 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:45.605825 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:45.605825 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:45.605825 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:45.605825 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:45.605825 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:45.605825 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:45.605825 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:45.605825 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:45.605825 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:45.605825 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:45.605825 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:45.605825 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:45.605825 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:45.605825 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:45.605825 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:45.605825 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:45.605825 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:45.607136 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:45.607136 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:45.607136 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:45.610162 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 499/985] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:45.611885 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498e87d-ea7a-4ffa-bd22-1c922ccd5e28 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:45.718516 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498e87d-ea7a-4ffa-bd22-1c922ccd5e28 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:45.745705 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:45.755288 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f0fd1-89f3-4502-a631-89d5cc856acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:45.755901 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f0fd1-89f3-4502-a631-89d5cc856acd None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:45.756179 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f0fd1-89f3-4502-a631-89d5cc856acd None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:45.756450 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f0fd1-89f3-4502-a631-89d5cc856acd None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:45.757098 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f0fd1-89f3-4502-a631-89d5cc856acd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:45.757399 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f0fd1-89f3-4502-a631-89d5cc856acd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:45.758816 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f0fd1-89f3-4502-a631-89d5cc856acd None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:45.774534 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 487/986] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:45.776142 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f10f93-399f-4dd1-9b6e-59866976e77e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:45.865509 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:45.881239 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f10f93-399f-4dd1-9b6e-59866976e77e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:45.921490 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebc47f-2b0b-43cd-98fb-527596625e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:45.922156 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebc47f-2b0b-43cd-98fb-527596625e22 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:45.922430 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebc47f-2b0b-43cd-98fb-527596625e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:45.922695 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebc47f-2b0b-43cd-98fb-527596625e22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:45.929433 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebc47f-2b0b-43cd-98fb-527596625e22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:45.930907 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebc47f-2b0b-43cd-98fb-527596625e22 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:45.942482 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-c5ebc47f-2b0b-43cd-98fb-527596625e22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:45.942482 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:45.942482 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:45.942482 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:45.942482 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:45.942482 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:45.942482 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:45.942482 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:45.942482 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:45.942482 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:45.942482 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:45.942482 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:45.942482 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:42:45.942482 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:42:45.942482 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:42:45.943444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:42:45.943444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:45.943444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:45.943444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:45.943444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:45.943444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:45.943444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:45.943444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:45.943444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:45.943444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:45.943444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:45.943444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:45.943444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:45.943444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:45.943444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:45.943444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:45.943444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:45.944370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:42:45.944370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:42:45.944370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:42:45.944370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:42:45.944370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:42:45.944370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:42:45.944370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:45.944370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:45.946171 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 500/987] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:42:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:42:45.949285 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f0fd1-89f3-4502-a631-89d5cc856acd None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:46.050027 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f0fd1-89f3-4502-a631-89d5cc856acd None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:46.084261 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6ea51-51d4-44ab-8641-ca315bf1b143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:46.084868 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6ea51-51d4-44ab-8641-ca315bf1b143 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:46.085141 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6ea51-51d4-44ab-8641-ca315bf1b143 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:46.085404 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6ea51-51d4-44ab-8641-ca315bf1b143 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:46.086128 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6ea51-51d4-44ab-8641-ca315bf1b143 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:46.086429 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6ea51-51d4-44ab-8641-ca315bf1b143 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:46.087882 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6ea51-51d4-44ab-8641-ca315bf1b143 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:46.100594 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 488/988] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:42:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:46.106503 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebc47f-2b0b-43cd-98fb-527596625e22 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:46.214515 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebc47f-2b0b-43cd-98fb-527596625e22 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:46.249133 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871ce49-4dec-435d-83a9-9c5643636680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:46.249818 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871ce49-4dec-435d-83a9-9c5643636680 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:46.250130 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871ce49-4dec-435d-83a9-9c5643636680 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:46.250403 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871ce49-4dec-435d-83a9-9c5643636680 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:46.251126 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871ce49-4dec-435d-83a9-9c5643636680 None admin] RBAC: Adding query filter params (role.id=40e39507eac04ff6b770e29fce3b7e81, scope.project.id=45c69e3e973c449895457bb610103a43, user.id=3302fdf33b5b4583a10e7c760c577cda) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:46.251433 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871ce49-4dec-435d-83a9-9c5643636680 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:46.252871 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871ce49-4dec-435d-83a9-9c5643636680 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:46.258907 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 501/989] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:42:46 2022] GET /identity/v3/role_assignments?user.id=3302fdf33b5b4583a10e7c760c577cda&scope.project.id=45c69e3e973c449895457bb610103a43&role.id=40e39507eac04ff6b770e29fce3b7e81 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:46.791101 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d8112-0bdd-4b39-9fc4-bdfd12ff1594 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:46.791292 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d8112-0bdd-4b39-9fc4-bdfd12ff1594 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:46.791594 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d8112-0bdd-4b39-9fc4-bdfd12ff1594 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:46.792993 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 489/990] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:46.798682 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3595da-515b-4b5a-9b6b-8b7e6378a0c5 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:46.798937 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3595da-515b-4b5a-9b6b-8b7e6378a0c5 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:46.799233 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3595da-515b-4b5a-9b6b-8b7e6378a0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:46.817652 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-3b3595da-515b-4b5a-9b6b-8b7e6378a0c5 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:46.818856 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3b3595da-515b-4b5a-9b6b-8b7e6378a0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:46.822579 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:46.889414 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 502/991] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:42:46.984317 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4af10-9636-49ea-a714-f662f4959aae None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:46.984906 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4af10-9636-49ea-a714-f662f4959aae None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:46.984906 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4af10-9636-49ea-a714-f662f4959aae None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:46.986379 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 490/992] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:46.991475 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f5eb8-25c3-4c6e-9a48-6bd8df6abade None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:46.991762 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f5eb8-25c3-4c6e-9a48-6bd8df6abade None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:46.991996 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f5eb8-25c3-4c6e-9a48-6bd8df6abade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:47.010725 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-cd6f5eb8-25c3-4c6e-9a48-6bd8df6abade None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:47.011912 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-cd6f5eb8-25c3-4c6e-9a48-6bd8df6abade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:47.079717 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 503/993] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:42:47.153763 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4af10-9636-49ea-a714-f662f4959aae None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:47.208916 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:47.262783 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4af10-9636-49ea-a714-f662f4959aae None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:47.298121 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0043f6-30c7-4ff3-92f9-8f34db5b0884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:47.299319 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0043f6-30c7-4ff3-92f9-8f34db5b0884 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:47.299842 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0043f6-30c7-4ff3-92f9-8f34db5b0884 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:47.300302 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0043f6-30c7-4ff3-92f9-8f34db5b0884 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:47.301126 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0043f6-30c7-4ff3-92f9-8f34db5b0884 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:47.302742 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0043f6-30c7-4ff3-92f9-8f34db5b0884 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:47.312330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-7d0043f6-30c7-4ff3-92f9-8f34db5b0884 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:42:47.312330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:47.312330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:42:47.312330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:42:47.312330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:42:47.312330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:42:47.312330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:42:47.312330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:47.312330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:42:47.312330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:47.312330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:42:47.312330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:47.312330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:47.312330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:47.312330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:47.312330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:47.312330 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:47.313308 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:47.313308 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:47.313308 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:47.313308 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:47.313308 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:47.313308 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:47.313308 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:42:47.313308 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:42:47.313308 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:42:47.313308 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:42:47.313308 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:47.313308 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:47.313308 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:47.313308 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:47.313308 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:47.313308 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:47.314192 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:47.314192 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:47.314192 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:47.314192 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:47.314192 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:47.314192 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:47.314192 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:47.314192 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:47.314192 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:47.314192 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:47.314192 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:42:47.314192 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:47.314192 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:42:47.314192 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:47.318225 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 491/994] 10.222.0.52 () {56 vars in 1126 bytes} [Sun Aug 28 00:42:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:47.321223 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f5eb8-25c3-4c6e-9a48-6bd8df6abade None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:47.352032 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0043f6-30c7-4ff3-92f9-8f34db5b0884 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:47.397537 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:47.429596 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f5eb8-25c3-4c6e-9a48-6bd8df6abade None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:47.455211 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0043f6-30c7-4ff3-92f9-8f34db5b0884 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:47.464415 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e673e5-54b5-4dc1-b339-1d559c2dc956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:47.465128 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e673e5-54b5-4dc1-b339-1d559c2dc956 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:47.465402 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e673e5-54b5-4dc1-b339-1d559c2dc956 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:47.465665 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e673e5-54b5-4dc1-b339-1d559c2dc956 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:47.466427 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e673e5-54b5-4dc1-b339-1d559c2dc956 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:47.466773 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e673e5-54b5-4dc1-b339-1d559c2dc956 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:47.468170 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e673e5-54b5-4dc1-b339-1d559c2dc956 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:47.468697 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:47.477873 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 504/995] 10.222.0.52 () {56 vars in 1122 bytes} [Sun Aug 28 00:42:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:47.480643 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e673e5-54b5-4dc1-b339-1d559c2dc956 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:47.495179 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc709e8-5b7a-4550-b158-c7d7a4b8c8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:47.496163 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc709e8-5b7a-4550-b158-c7d7a4b8c8c6 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:47.496603 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc709e8-5b7a-4550-b158-c7d7a4b8c8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:47.496873 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc709e8-5b7a-4550-b158-c7d7a4b8c8c6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:47.497471 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc709e8-5b7a-4550-b158-c7d7a4b8c8c6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:47.499004 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc709e8-5b7a-4550-b158-c7d7a4b8c8c6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:47.508282 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-7dc709e8-5b7a-4550-b158-c7d7a4b8c8c6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:42:47.508282 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:47.508282 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:42:47.508282 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:42:47.508282 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:42:47.508282 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:42:47.508282 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:42:47.508282 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:47.508282 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:42:47.508282 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:47.508282 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:42:47.508282 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:47.508282 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:47.508282 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:47.508282 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:47.508282 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:47.508282 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:47.509527 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:47.509527 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:47.509527 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:47.509527 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:47.509527 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:47.509527 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:47.509527 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:42:47.509527 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:42:47.509527 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:42:47.509527 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:42:47.509527 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:47.509527 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:47.509527 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:47.509527 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:47.509527 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:47.509527 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:47.510543 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:47.510543 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:47.510543 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:47.510543 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:47.510543 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:47.510543 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:47.510543 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:47.510543 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:47.510543 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:47.510543 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:47.510543 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:42:47.510543 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:47.510543 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:42:47.510543 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:47.510543 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 492/996] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:42:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:47.515148 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc709e8-5b7a-4550-b158-c7d7a4b8c8c6 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:47.591436 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e673e5-54b5-4dc1-b339-1d559c2dc956 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:47.628205 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc709e8-5b7a-4550-b158-c7d7a4b8c8c6 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:47.631490 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615c438-2dfa-4892-9b08-610cf05306b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:47.632275 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615c438-2dfa-4892-9b08-610cf05306b6 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:47.632692 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615c438-2dfa-4892-9b08-610cf05306b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:47.633106 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615c438-2dfa-4892-9b08-610cf05306b6 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:47.633946 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615c438-2dfa-4892-9b08-610cf05306b6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:47.634443 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615c438-2dfa-4892-9b08-610cf05306b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:47.636367 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615c438-2dfa-4892-9b08-610cf05306b6 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:47.638938 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:47.644105 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 505/997] 10.222.0.52 () {56 vars in 1122 bytes} [Sun Aug 28 00:42:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:42:47.649370 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615c438-2dfa-4892-9b08-610cf05306b6 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:47.668616 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cad09-5007-4165-8d5c-040e8d7a025e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:47.669217 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cad09-5007-4165-8d5c-040e8d7a025e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:47.669497 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cad09-5007-4165-8d5c-040e8d7a025e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:47.670050 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cad09-5007-4165-8d5c-040e8d7a025e None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:47.670715 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34cad09-5007-4165-8d5c-040e8d7a025e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:47.671014 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34cad09-5007-4165-8d5c-040e8d7a025e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:47.672386 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34cad09-5007-4165-8d5c-040e8d7a025e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:47.682027 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 493/998] 10.222.0.52 () {56 vars in 1112 bytes} [Sun Aug 28 00:42:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:42:47.683743 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cad09-5007-4165-8d5c-040e8d7a025e None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:47.730697 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:47.766467 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615c438-2dfa-4892-9b08-610cf05306b6 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:47.792000 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cad09-5007-4165-8d5c-040e8d7a025e None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:47.806441 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7baeec2-bba3-4599-afb2-3d31676c9802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:47.807057 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7baeec2-bba3-4599-afb2-3d31676c9802 None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:47.807336 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7baeec2-bba3-4599-afb2-3d31676c9802 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:47.807615 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7baeec2-bba3-4599-afb2-3d31676c9802 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:47.808279 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7baeec2-bba3-4599-afb2-3d31676c9802 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:47.809650 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7baeec2-bba3-4599-afb2-3d31676c9802 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:47.827268 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 506/999] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:42:47 2022] POST /identity/v3/endpoints => generated 325 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:42:47.847399 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698975e-b354-4c31-acf3-f2a37ae4a4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:47.848028 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698975e-b354-4c31-acf3-f2a37ae4a4cd None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:47.848307 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698975e-b354-4c31-acf3-f2a37ae4a4cd None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:47.848577 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698975e-b354-4c31-acf3-f2a37ae4a4cd None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:47.849287 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698975e-b354-4c31-acf3-f2a37ae4a4cd None admin] RBAC: Adding query filter params (type=compute) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:47.849595 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698975e-b354-4c31-acf3-f2a37ae4a4cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:47.851062 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698975e-b354-4c31-acf3-f2a37ae4a4cd None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:47.861290 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 494/1000] 10.222.0.52 () {56 vars in 1112 bytes} [Sun Aug 28 00:42:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:47.863845 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7baeec2-bba3-4599-afb2-3d31676c9802 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:47.928816 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:47.982360 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7baeec2-bba3-4599-afb2-3d31676c9802 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:48.019662 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0622b17-f37b-4a74-8f00-d775148f838c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:48.020282 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0622b17-f37b-4a74-8f00-d775148f838c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:48.020558 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0622b17-f37b-4a74-8f00-d775148f838c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:48.020824 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0622b17-f37b-4a74-8f00-d775148f838c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:48.021528 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0622b17-f37b-4a74-8f00-d775148f838c None admin] RBAC: Adding query filter params (interface=public, service_id=9ae0033e2c7b4b6eb50b518724762c10, region_id=RegionOne) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:48.021834 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0622b17-f37b-4a74-8f00-d775148f838c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:48.023234 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0622b17-f37b-4a74-8f00-d775148f838c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:48.028704 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 507/1001] 10.222.0.52 () {56 vars in 1251 bytes} [Sun Aug 28 00:42:47 2022] GET /identity/v3/endpoints?service_id=9ae0033e2c7b4b6eb50b518724762c10&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:48.034362 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698975e-b354-4c31-acf3-f2a37ae4a4cd None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:48.137191 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:48.140850 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698975e-b354-4c31-acf3-f2a37ae4a4cd None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:48.176225 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4db615-2e2f-4322-a025-94961d0b4fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:48.176837 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4db615-2e2f-4322-a025-94961d0b4fcc None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:48.177117 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4db615-2e2f-4322-a025-94961d0b4fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:48.177387 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4db615-2e2f-4322-a025-94961d0b4fcc None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:48.178024 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4db615-2e2f-4322-a025-94961d0b4fcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:48.179470 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4db615-2e2f-4322-a025-94961d0b4fcc None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:48.191180 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 495/1002] 10.222.0.52 () {56 vars in 1087 bytes} [Sun Aug 28 00:42:48 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:42:48.193028 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf15b91-1c86-44bf-8837-022456085b58 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:48.193311 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf15b91-1c86-44bf-8837-022456085b58 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:48.193583 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf15b91-1c86-44bf-8837-022456085b58 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:48.195199 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 508/1003] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:48.200992 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e7dde-0f35-4643-a5b4-d79eb6486ce8 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:48.201668 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e7dde-0f35-4643-a5b4-d79eb6486ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:48.202088 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e7dde-0f35-4643-a5b4-d79eb6486ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:48.222043 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-ef8e7dde-0f35-4643-a5b4-d79eb6486ce8 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:48.223279 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ef8e7dde-0f35-4643-a5b4-d79eb6486ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:48.297346 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 496/1004] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:48 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:42:48.563964 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf15b91-1c86-44bf-8837-022456085b58 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:48.672403 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf15b91-1c86-44bf-8837-022456085b58 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:48.696501 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:48.709514 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2aad2-c79a-481a-a715-85b537eda2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:48.710403 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2aad2-c79a-481a-a715-85b537eda2e5 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:48.710827 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2aad2-c79a-481a-a715-85b537eda2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:48.711281 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2aad2-c79a-481a-a715-85b537eda2e5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:48.712020 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2aad2-c79a-481a-a715-85b537eda2e5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:48.713631 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2aad2-c79a-481a-a715-85b537eda2e5 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:48.726761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-e3a2aad2-c79a-481a-a715-85b537eda2e5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:42:48.726761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:48.726761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:42:48.726761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:42:48.726761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:42:48.726761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:42:48.726761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:42:48.726761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:48.726761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:42:48.726761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:48.726761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:42:48.726761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:48.726761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:48.726761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:48.726761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:48.726761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:48.726761 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:48.727866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:48.727866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:48.727866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:48.727866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:48.727866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:48.727866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:48.727866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:42:48.727866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:42:48.727866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:42:48.727866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:42:48.727866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:48.727866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:48.727866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:48.727866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:48.727866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:48.727866 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:48.728729 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:48.728729 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:48.728729 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:48.728729 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:48.728729 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:48.728729 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:48.728729 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:48.728729 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:48.728729 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:48.728729 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:48.728729 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:42:48.728729 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:48.728729 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:42:48.728729 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:48.728729 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 509/1005] 10.222.0.52 () {56 vars in 1105 bytes} [Sun Aug 28 00:42:48 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:48.736131 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e7dde-0f35-4643-a5b4-d79eb6486ce8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:48.831584 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:48.840127 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e7dde-0f35-4643-a5b4-d79eb6486ce8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:48.875421 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39842afe-cc97-4160-bbda-0806ce3cfa12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:48.876029 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39842afe-cc97-4160-bbda-0806ce3cfa12 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:48.876303 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39842afe-cc97-4160-bbda-0806ce3cfa12 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:48.876572 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39842afe-cc97-4160-bbda-0806ce3cfa12 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:48.877209 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39842afe-cc97-4160-bbda-0806ce3cfa12 None admin] RBAC: Adding query filter params (name=image) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:48.877507 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39842afe-cc97-4160-bbda-0806ce3cfa12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:48.878927 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39842afe-cc97-4160-bbda-0806ce3cfa12 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:48.884129 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 497/1006] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:48.889726 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2aad2-c79a-481a-a715-85b537eda2e5 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:48.993601 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2aad2-c79a-481a-a715-85b537eda2e5 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:49.026902 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f6991-2831-4b2c-b4fa-c7204ec48b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:49.027512 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f6991-2831-4b2c-b4fa-c7204ec48b6c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:49.027791 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f6991-2831-4b2c-b4fa-c7204ec48b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:49.028064 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f6991-2831-4b2c-b4fa-c7204ec48b6c None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:49.028705 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f6991-2831-4b2c-b4fa-c7204ec48b6c None admin] RBAC: Adding query filter params (type=image) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:49.029015 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f6991-2831-4b2c-b4fa-c7204ec48b6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:49.030580 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f6991-2831-4b2c-b4fa-c7204ec48b6c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:49.035063 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 510/1007] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:48 2022] GET /identity/v3/services?type=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:49.769894 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4944135-f761-4327-8270-94cdc4b015c3 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:49.770460 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4944135-f761-4327-8270-94cdc4b015c3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:49.770460 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4944135-f761-4327-8270-94cdc4b015c3 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:49.771762 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 498/1008] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:49.777452 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b10f4-6f50-4bd5-b5cf-af88e42ae138 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:49.777926 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b10f4-6f50-4bd5-b5cf-af88e42ae138 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:49.778009 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b10f4-6f50-4bd5-b5cf-af88e42ae138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:49.796959 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-ad1b10f4-6f50-4bd5-b5cf-af88e42ae138 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:49.798039 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ad1b10f4-6f50-4bd5-b5cf-af88e42ae138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:49.846993 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:49.869321 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 511/1009] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:49 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:42:50.088898 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299fdc5-f95b-447f-bd6b-67f0fa658603 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:50.089084 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299fdc5-f95b-447f-bd6b-67f0fa658603 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:50.089380 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299fdc5-f95b-447f-bd6b-67f0fa658603 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:50.090891 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 499/1010] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:50.096516 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28184945-baad-44f7-9412-b5ffaa1fed6b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:50.096811 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28184945-baad-44f7-9412-b5ffaa1fed6b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:50.097046 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28184945-baad-44f7-9412-b5ffaa1fed6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:50.115975 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-28184945-baad-44f7-9412-b5ffaa1fed6b None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:50.117186 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-28184945-baad-44f7-9412-b5ffaa1fed6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:50.133178 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299fdc5-f95b-447f-bd6b-67f0fa658603 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:50.195606 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 512/1011] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:50 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:42:50.236041 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299fdc5-f95b-447f-bd6b-67f0fa658603 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:50.270828 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055b516-8ab5-4482-9e94-6415bf8ff273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:50.271445 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055b516-8ab5-4482-9e94-6415bf8ff273 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:50.271718 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055b516-8ab5-4482-9e94-6415bf8ff273 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:50.271981 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055b516-8ab5-4482-9e94-6415bf8ff273 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:50.273080 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055b516-8ab5-4482-9e94-6415bf8ff273 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:50.274551 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055b516-8ab5-4482-9e94-6415bf8ff273 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:50.276282 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 500/1012] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:50.282096 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28184945-baad-44f7-9412-b5ffaa1fed6b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:50.380212 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28184945-baad-44f7-9412-b5ffaa1fed6b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:50.391009 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:50.415274 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f6201-480f-4195-83b9-aff621b5ca19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:50.415876 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f6201-480f-4195-83b9-aff621b5ca19 None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:50.416148 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f6201-480f-4195-83b9-aff621b5ca19 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:50.416415 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f6201-480f-4195-83b9-aff621b5ca19 None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:50.417064 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f6201-480f-4195-83b9-aff621b5ca19 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:50.418519 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f6201-480f-4195-83b9-aff621b5ca19 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:50.446352 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 513/1013] 10.222.0.52 () {60 vars in 1141 bytes} [Sun Aug 28 00:42:50 2022] POST /identity/v3/projects => generated 311 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:42:50.464123 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055b516-8ab5-4482-9e94-6415bf8ff273 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:50.496255 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:50.578937 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055b516-8ab5-4482-9e94-6415bf8ff273 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:50.619899 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5cbb21-19d8-4188-a983-c9a121a3d711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:50.620736 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5cbb21-19d8-4188-a983-c9a121a3d711 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:50.620846 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5cbb21-19d8-4188-a983-c9a121a3d711 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:50.621047 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5cbb21-19d8-4188-a983-c9a121a3d711 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:50.621627 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5cbb21-19d8-4188-a983-c9a121a3d711 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:50.623302 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5cbb21-19d8-4188-a983-c9a121a3d711 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:50.632712 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-4f5cbb21-19d8-4188-a983-c9a121a3d711 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:42:50.632712 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:50.632712 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:42:50.632712 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:42:50.632712 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:42:50.632712 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:42:50.632712 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:42:50.632712 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:50.632712 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:42:50.632712 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:50.632712 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:42:50.632712 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:50.632712 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:50.632712 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:50.632712 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:50.632712 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:50.632712 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:50.633688 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:50.633688 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:50.633688 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:50.633688 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:50.633688 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:50.633688 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:50.633688 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:42:50.633688 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:42:50.633688 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:42:50.633688 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:42:50.633688 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:50.633688 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:50.633688 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:50.633688 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:50.633688 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:50.633688 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:50.635184 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:50.635184 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:50.635184 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:50.635184 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:50.635184 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:50.635184 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:50.635184 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:50.635184 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:50.635184 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:50.635184 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:50.635184 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:42:50.635184 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:50.635184 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:42:50.635184 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:50.635184 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 501/1014] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:42:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:50.640998 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f6201-480f-4195-83b9-aff621b5ca19 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:50.746832 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f6201-480f-4195-83b9-aff621b5ca19 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:50.781041 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971ef73-d16b-4617-bfa5-c51fc548acf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:50.781666 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971ef73-d16b-4617-bfa5-c51fc548acf2 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:50.781936 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971ef73-d16b-4617-bfa5-c51fc548acf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:50.782222 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971ef73-d16b-4617-bfa5-c51fc548acf2 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:50.782852 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971ef73-d16b-4617-bfa5-c51fc548acf2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:50.783149 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971ef73-d16b-4617-bfa5-c51fc548acf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:50.784567 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971ef73-d16b-4617-bfa5-c51fc548acf2 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:50.789677 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 514/1015] 10.222.0.52 () {56 vars in 1112 bytes} [Sun Aug 28 00:42:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:50.795926 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5cbb21-19d8-4188-a983-c9a121a3d711 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:50.894984 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:50.906625 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5cbb21-19d8-4188-a983-c9a121a3d711 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:50.943004 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83bad3-ac09-46f4-b138-8c2e2b9ac402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:50.944111 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83bad3-ac09-46f4-b138-8c2e2b9ac402 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:50.944684 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83bad3-ac09-46f4-b138-8c2e2b9ac402 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:50.945162 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83bad3-ac09-46f4-b138-8c2e2b9ac402 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:50.946048 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83bad3-ac09-46f4-b138-8c2e2b9ac402 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:50.946547 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83bad3-ac09-46f4-b138-8c2e2b9ac402 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:50.948153 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83bad3-ac09-46f4-b138-8c2e2b9ac402 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:50.954886 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 502/1016] 10.222.0.52 () {56 vars in 1112 bytes} [Sun Aug 28 00:42:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:50.960730 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971ef73-d16b-4617-bfa5-c51fc548acf2 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:50.966440 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595e1d8-3756-4eb8-922a-5a71e6a145a6 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:50.966797 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595e1d8-3756-4eb8-922a-5a71e6a145a6 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:50.967078 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595e1d8-3756-4eb8-922a-5a71e6a145a6 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:50.968551 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 503/1017] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:42:50.973639 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc4247-4e50-41d8-aa87-a6b91f34736c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:50.974063 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc4247-4e50-41d8-aa87-a6b91f34736c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:50.974343 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc4247-4e50-41d8-aa87-a6b91f34736c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:50.990953 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:50.994668 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-94fc4247-4e50-41d8-aa87-a6b91f34736c None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:50.995866 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-94fc4247-4e50-41d8-aa87-a6b91f34736c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:51.066729 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 504/1018] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:50 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:42:51.077764 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971ef73-d16b-4617-bfa5-c51fc548acf2 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:51.116917 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7b19f-c511-4599-b9e4-8566acf4e7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:51.117860 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7b19f-c511-4599-b9e4-8566acf4e7a1 None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:51.118151 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7b19f-c511-4599-b9e4-8566acf4e7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:51.118420 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7b19f-c511-4599-b9e4-8566acf4e7a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:51.119084 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7b19f-c511-4599-b9e4-8566acf4e7a1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:51.120501 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7b19f-c511-4599-b9e4-8566acf4e7a1 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:51.149975 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 515/1019] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:42:50 2022] POST /identity/v3/endpoints => generated 334 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:42:51.333925 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc4247-4e50-41d8-aa87-a6b91f34736c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:51.428223 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:51.444993 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc4247-4e50-41d8-aa87-a6b91f34736c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:51.489167 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749cbfa-b895-4500-8fda-3882f72335cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:51.489784 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749cbfa-b895-4500-8fda-3882f72335cd None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:51.490095 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749cbfa-b895-4500-8fda-3882f72335cd None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:51.490357 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749cbfa-b895-4500-8fda-3882f72335cd None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:51.491007 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749cbfa-b895-4500-8fda-3882f72335cd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:51.492395 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749cbfa-b895-4500-8fda-3882f72335cd None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:51.510417 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 505/1020] 10.222.0.52 () {60 vars in 1141 bytes} [Sun Aug 28 00:42:51 2022] POST /identity/v3/services => generated 242 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:42:52.426566 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e828261-383c-495d-bd34-10002cdc272e None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:52.427086 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e828261-383c-495d-bd34-10002cdc272e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:52.427086 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e828261-383c-495d-bd34-10002cdc272e None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:52.428594 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 516/1021] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:52.433991 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cba017-a94d-4b25-9165-d34875c12d20 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:52.434425 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cba017-a94d-4b25-9165-d34875c12d20 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:52.434504 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cba017-a94d-4b25-9165-d34875c12d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:52.453246 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-59cba017-a94d-4b25-9165-d34875c12d20 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:52.454448 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-59cba017-a94d-4b25-9165-d34875c12d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:52.537263 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 506/1022] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:52 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:42:52.814014 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e828261-383c-495d-bd34-10002cdc272e None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:52.920349 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:52.944107 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e828261-383c-495d-bd34-10002cdc272e None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:52.982656 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643facb2-2465-466c-82fe-9dd07565d6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:52.983384 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643facb2-2465-466c-82fe-9dd07565d6b6 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:52.983706 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643facb2-2465-466c-82fe-9dd07565d6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:52.984032 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643facb2-2465-466c-82fe-9dd07565d6b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:52.985149 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643facb2-2465-466c-82fe-9dd07565d6b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:52.986618 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643facb2-2465-466c-82fe-9dd07565d6b6 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:52.994153 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cba017-a94d-4b25-9165-d34875c12d20 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:52.996479 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 517/1023] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:53.059342 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:53.097568 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cba017-a94d-4b25-9165-d34875c12d20 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:53.138386 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba2842-7421-40d5-adc0-dec5f531cade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:53.141884 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba2842-7421-40d5-adc0-dec5f531cade None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:53.141884 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba2842-7421-40d5-adc0-dec5f531cade None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:53.141884 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba2842-7421-40d5-adc0-dec5f531cade None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:53.141884 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba2842-7421-40d5-adc0-dec5f531cade None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:53.142221 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba2842-7421-40d5-adc0-dec5f531cade None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:53.163833 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e1def-f9ca-4f09-87c2-0c168901bed1 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:53.164163 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e1def-f9ca-4f09-87c2-0c168901bed1 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:53.164490 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e1def-f9ca-4f09-87c2-0c168901bed1 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:53.166738 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 518/1024] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:53.175392 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d35643-7b51-438d-8e74-d768fe8823df None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:53.175679 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d35643-7b51-438d-8e74-d768fe8823df None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:53.176878 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d35643-7b51-438d-8e74-d768fe8823df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:53.179419 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 507/1025] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Aug 28 00:42:52 2022] POST /identity/v3/users => generated 285 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:42:53.205543 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-e4d35643-7b51-438d-8e74-d768fe8823df None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:53.207881 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e4d35643-7b51-438d-8e74-d768fe8823df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:53.286967 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 519/1026] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:42:53.448728 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7e742-0ac0-4b79-bebc-5148c988619c None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:53.449253 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7e742-0ac0-4b79-bebc-5148c988619c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:53.449253 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7e742-0ac0-4b79-bebc-5148c988619c None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:53.450732 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 508/1027] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:53.455840 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c085432-0cca-432c-bfa1-d153e9c69511 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:53.456264 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c085432-0cca-432c-bfa1-d153e9c69511 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:53.456386 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c085432-0cca-432c-bfa1-d153e9c69511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:53.475023 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-4c085432-0cca-432c-bfa1-d153e9c69511 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:53.476460 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-4c085432-0cca-432c-bfa1-d153e9c69511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:53.553633 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 520/1028] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:42:53.560144 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7e742-0ac0-4b79-bebc-5148c988619c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:53.670005 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7e742-0ac0-4b79-bebc-5148c988619c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:53.694685 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:53.708661 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6e3bc-3cfa-46c9-8c8a-b2ebe5c8c609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:53.709222 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6e3bc-3cfa-46c9-8c8a-b2ebe5c8c609 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:53.709493 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6e3bc-3cfa-46c9-8c8a-b2ebe5c8c609 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:53.709757 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6e3bc-3cfa-46c9-8c8a-b2ebe5c8c609 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:53.720605 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6e3bc-3cfa-46c9-8c8a-b2ebe5c8c609 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:42:53.725444 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-42a6e3bc-3cfa-46c9-8c8a-b2ebe5c8c609 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:42:53.725444 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:53.725444 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:53.725444 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:53.725444 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:53.725444 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:53.725444 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:53.725444 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:53.725444 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:53.725444 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:53.725444 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:53.725444 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:53.725444 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:42:53.725444 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:42:53.725444 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:42:53.725444 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:42:53.726495 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:42:53.726495 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:42:53.726495 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:42:53.726495 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:42:53.726495 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:53.726495 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:53.726495 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:53.726495 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:53.726495 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:53.726495 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:53.726495 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:53.726495 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:53.726495 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:53.726495 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:53.726495 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:53.726495 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:53.727424 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:53.727424 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:53.727424 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:53.727424 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:53.727424 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:42:53.727424 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:42:53.727424 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:42:53.727424 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:42:53.727424 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:42:53.727424 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:42:53.727424 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:42:53.727424 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:53.727424 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 509/1029] 10.222.0.52 () {56 vars in 1120 bytes} [Sun Aug 28 00:42:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:53.735014 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c085432-0cca-432c-bfa1-d153e9c69511 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:53.747629 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:53.823675 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6e3bc-3cfa-46c9-8c8a-b2ebe5c8c609 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:53.839569 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c085432-0cca-432c-bfa1-d153e9c69511 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:53.876407 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d969caf-a6b7-42c4-89d1-d536db8088c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:53.876992 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d969caf-a6b7-42c4-89d1-d536db8088c6 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:53.877303 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d969caf-a6b7-42c4-89d1-d536db8088c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:53.877559 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d969caf-a6b7-42c4-89d1-d536db8088c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:53.878264 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d969caf-a6b7-42c4-89d1-d536db8088c6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:53.878617 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d969caf-a6b7-42c4-89d1-d536db8088c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:53.879932 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d969caf-a6b7-42c4-89d1-d536db8088c6 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:53.893779 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 521/1030] 10.222.0.52 () {56 vars in 1115 bytes} [Sun Aug 28 00:42:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:42:53.894861 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d969caf-a6b7-42c4-89d1-d536db8088c6 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:53.933294 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6e3bc-3cfa-46c9-8c8a-b2ebe5c8c609 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:53.969960 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fcbb53-1452-40bc-8a10-04ab5497d02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:53.970160 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:53.970758 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fcbb53-1452-40bc-8a10-04ab5497d02a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:53.971042 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fcbb53-1452-40bc-8a10-04ab5497d02a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:53.971484 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fcbb53-1452-40bc-8a10-04ab5497d02a None admin] PATH_INFO: `/v3/services/image` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:53.971934 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fcbb53-1452-40bc-8a10-04ab5497d02a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:53.973478 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fcbb53-1452-40bc-8a10-04ab5497d02a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:53.982707 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-39fcbb53-1452-40bc-8a10-04ab5497d02a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:42:53.982707 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:53.982707 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:42:53.982707 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:42:53.982707 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:42:53.982707 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:42:53.982707 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:42:53.982707 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:53.982707 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:42:53.982707 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:53.982707 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:42:53.982707 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:53.982707 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:53.982707 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:53.982707 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:53.982707 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:53.982707 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:53.983763 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:53.983763 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:53.983763 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:53.983763 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:53.983763 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:53.983763 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:53.983763 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:42:53.983763 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:42:53.983763 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:42:53.983763 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:42:53.983763 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:53.983763 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:53.983763 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:53.983763 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:53.983763 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:53.983763 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:53.984919 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:53.984919 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:53.984919 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:53.984919 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:53.984919 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:53.984919 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:53.984919 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:53.984919 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:53.984919 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:53.984919 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:53.984919 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:42:53.984919 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:53.984919 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:42:53.984919 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:53.984919 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 510/1031] 10.222.0.52 () {56 vars in 1105 bytes} [Sun Aug 28 00:42:53 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:53.990066 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fcbb53-1452-40bc-8a10-04ab5497d02a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:54.006067 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d969caf-a6b7-42c4-89d1-d536db8088c6 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:54.039511 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a39956-d4e8-416f-8533-07a274f33519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:54.040136 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a39956-d4e8-416f-8533-07a274f33519 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:54.040413 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a39956-d4e8-416f-8533-07a274f33519 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:54.040683 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a39956-d4e8-416f-8533-07a274f33519 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:54.048173 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:54.051975 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a39956-d4e8-416f-8533-07a274f33519 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:54.053743 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a39956-d4e8-416f-8533-07a274f33519 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:54.069072 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-93a39956-d4e8-416f-8533-07a274f33519 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:54.069072 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:54.069072 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:54.069072 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:54.069072 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:54.069072 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:54.069072 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:54.069072 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:54.069072 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:54.069072 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:54.069072 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:54.069072 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:54.069072 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:54.069072 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:54.069072 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:54.069072 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:54.070187 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:54.070187 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:54.070187 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:54.070187 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:54.070187 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:54.070187 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:54.070187 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:54.070187 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:54.070187 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:54.070187 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:54.070187 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:54.070187 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:54.070187 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:54.070187 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:54.070187 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:54.070187 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:54.070187 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:54.071126 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:54.071126 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:54.071126 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:54.071126 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 522/1032] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:42:54.076635 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a39956-d4e8-416f-8533-07a274f33519 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:54.110514 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fcbb53-1452-40bc-8a10-04ab5497d02a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:54.147043 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2a3bb-c418-497f-8c91-e801d1b9917d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:54.147649 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2a3bb-c418-497f-8c91-e801d1b9917d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:54.147934 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2a3bb-c418-497f-8c91-e801d1b9917d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:54.148207 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2a3bb-c418-497f-8c91-e801d1b9917d None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:54.148846 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2a3bb-c418-497f-8c91-e801d1b9917d None admin] RBAC: Adding query filter params (name=image) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:54.149146 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2a3bb-c418-497f-8c91-e801d1b9917d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:54.150565 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2a3bb-c418-497f-8c91-e801d1b9917d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:54.160228 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 511/1033] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:42:54.161642 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2a3bb-c418-497f-8c91-e801d1b9917d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:54.179442 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a39956-d4e8-416f-8533-07a274f33519 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:54.204164 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:54.216440 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47c1f4-0439-4d00-a1c8-4fa3499d5c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:54.217110 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47c1f4-0439-4d00-a1c8-4fa3499d5c05 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:54.217390 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47c1f4-0439-4d00-a1c8-4fa3499d5c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:54.217663 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47c1f4-0439-4d00-a1c8-4fa3499d5c05 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:54.218339 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47c1f4-0439-4d00-a1c8-4fa3499d5c05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:54.219018 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47c1f4-0439-4d00-a1c8-4fa3499d5c05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:54.220085 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47c1f4-0439-4d00-a1c8-4fa3499d5c05 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:54.237266 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 523/1034] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:54.238344 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47c1f4-0439-4d00-a1c8-4fa3499d5c05 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:54.278532 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2a3bb-c418-497f-8c91-e801d1b9917d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:54.289789 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:54.317225 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ca2ee-6b83-464d-85ff-81b071153e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:54.317872 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ca2ee-6b83-464d-85ff-81b071153e03 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:54.318157 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ca2ee-6b83-464d-85ff-81b071153e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:54.318429 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ca2ee-6b83-464d-85ff-81b071153e03 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:54.319196 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ca2ee-6b83-464d-85ff-81b071153e03 None admin] RBAC: Adding query filter params (type=image) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:54.319498 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ca2ee-6b83-464d-85ff-81b071153e03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:54.321000 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ca2ee-6b83-464d-85ff-81b071153e03 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:54.326830 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 512/1035] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:54.332708 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ca2ee-6b83-464d-85ff-81b071153e03 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:54.349914 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47c1f4-0439-4d00-a1c8-4fa3499d5c05 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:54.388356 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a1cda-1216-4544-a320-1c2fad2e5e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:54.389138 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a1cda-1216-4544-a320-1c2fad2e5e64 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:54.389401 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a1cda-1216-4544-a320-1c2fad2e5e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:54.389677 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a1cda-1216-4544-a320-1c2fad2e5e64 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:54.396923 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a1cda-1216-4544-a320-1c2fad2e5e64 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:54.398413 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a1cda-1216-4544-a320-1c2fad2e5e64 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:54.410132 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-532a1cda-1216-4544-a320-1c2fad2e5e64 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:42:54.410132 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:54.410132 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:54.410132 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:54.410132 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:54.410132 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:54.410132 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:54.410132 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:54.410132 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:54.410132 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:54.410132 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:54.410132 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:54.410132 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:42:54.410132 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:42:54.410132 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:42:54.410132 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:42:54.411133 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:54.411133 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:54.411133 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:42:54.411133 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:54.411133 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:42:54.411133 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:54.411133 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:54.411133 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:54.411133 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:54.411133 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:54.411133 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:54.411133 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:54.411133 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:54.411133 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:54.411133 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:54.411133 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:54.411133 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:54.411133 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:54.412095 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:54.412095 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:54.412095 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:42:54.412095 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:42:54.412095 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:42:54.412095 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:42:54.412095 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:42:54.412095 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:42:54.412095 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:42:54.412095 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:54.412095 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 524/1036] 10.222.0.52 () {56 vars in 1093 bytes} [Sun Aug 28 00:42:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:54.418777 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a1cda-1216-4544-a320-1c2fad2e5e64 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:54.444911 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ca2ee-6b83-464d-85ff-81b071153e03 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:54.470255 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:54.480509 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22cdd76-9b96-464d-aebc-d45936aa5dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:54.481115 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cdd76-9b96-464d-aebc-d45936aa5dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:54.481494 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cdd76-9b96-464d-aebc-d45936aa5dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:54.481665 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cdd76-9b96-464d-aebc-d45936aa5dc0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:54.482675 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22cdd76-9b96-464d-aebc-d45936aa5dc0 None admin] RBAC: Adding query filter params (interface=public, service_id=07d017f1978c4729b69fd5cdc3b2311d, region_id=RegionOne) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:54.482982 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22cdd76-9b96-464d-aebc-d45936aa5dc0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:54.484414 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22cdd76-9b96-464d-aebc-d45936aa5dc0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:54.490428 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 513/1037] 10.222.0.52 () {56 vars in 1251 bytes} [Sun Aug 28 00:42:54 2022] GET /identity/v3/endpoints?service_id=07d017f1978c4729b69fd5cdc3b2311d&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:54.495687 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22cdd76-9b96-464d-aebc-d45936aa5dc0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:54.541077 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:54.542421 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a1cda-1216-4544-a320-1c2fad2e5e64 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:54.578003 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d237d-465e-4725-956a-5bfbfb7bcf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:54.578613 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d237d-465e-4725-956a-5bfbfb7bcf60 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:54.578890 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d237d-465e-4725-956a-5bfbfb7bcf60 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:54.579166 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d237d-465e-4725-956a-5bfbfb7bcf60 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:54.580175 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d237d-465e-4725-956a-5bfbfb7bcf60 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:54.580482 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d237d-465e-4725-956a-5bfbfb7bcf60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:54.581969 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d237d-465e-4725-956a-5bfbfb7bcf60 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:54.605482 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 525/1038] 10.222.0.52 () {56 vars in 1133 bytes} [Sun Aug 28 00:42:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:54.606257 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22cdd76-9b96-464d-aebc-d45936aa5dc0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:54.606460 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d237d-465e-4725-956a-5bfbfb7bcf60 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:54.645959 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1058942-09bb-4f0a-ac81-17c1d1f2b0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:54.646657 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1058942-09bb-4f0a-ac81-17c1d1f2b0cf None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:54.646944 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1058942-09bb-4f0a-ac81-17c1d1f2b0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:54.647255 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1058942-09bb-4f0a-ac81-17c1d1f2b0cf None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:54.648020 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1058942-09bb-4f0a-ac81-17c1d1f2b0cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:54.649680 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1058942-09bb-4f0a-ac81-17c1d1f2b0cf None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:54.658181 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 514/1039] 10.222.0.52 () {56 vars in 1087 bytes} [Sun Aug 28 00:42:54 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:42:54.723056 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d237d-465e-4725-956a-5bfbfb7bcf60 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:54.724651 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:54.764088 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cce5c-8ce5-4ef3-81e0-4670d89c8aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:54.764707 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cce5c-8ce5-4ef3-81e0-4670d89c8aae None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:54.764996 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cce5c-8ce5-4ef3-81e0-4670d89c8aae None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:54.765264 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cce5c-8ce5-4ef3-81e0-4670d89c8aae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:54.842495 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00cce5c-8ce5-4ef3-81e0-4670d89c8aae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:54.843768 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00cce5c-8ce5-4ef3-81e0-4670d89c8aae None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:54.942855 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 526/1040] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:42:54 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 28 00:42:54.948646 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1058942-09bb-4f0a-ac81-17c1d1f2b0cf None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:55.055690 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1058942-09bb-4f0a-ac81-17c1d1f2b0cf None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:55.057518 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:55.095159 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2059cc-bb42-4fb2-a911-d940152c9199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:55.096105 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2059cc-bb42-4fb2-a911-d940152c9199 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:55.096377 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2059cc-bb42-4fb2-a911-d940152c9199 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:55.096645 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2059cc-bb42-4fb2-a911-d940152c9199 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:55.107081 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2059cc-bb42-4fb2-a911-d940152c9199 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:55.109119 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2059cc-bb42-4fb2-a911-d940152c9199 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:55.124692 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-4a2059cc-bb42-4fb2-a911-d940152c9199 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:55.124692 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:55.124692 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:55.124692 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:55.124692 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:55.124692 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:55.124692 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:55.124692 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:55.124692 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:55.124692 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:55.124692 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:55.124692 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:55.124692 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:55.124692 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:55.124692 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:55.124692 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:55.125678 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:55.125678 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:55.125678 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:55.125678 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:55.125678 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:55.125678 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:55.125678 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:55.125678 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:55.125678 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:55.125678 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:55.125678 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:55.125678 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:55.125678 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:55.125678 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:55.125678 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:55.125678 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:55.125678 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:55.130417 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:55.130417 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:55.130417 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:55.130417 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 515/1041] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:55.131966 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cce5c-8ce5-4ef3-81e0-4670d89c8aae None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:55.134395 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:55.144870 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908f3ce-82aa-4043-b2ab-eda6031d2f6a None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:55.145149 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908f3ce-82aa-4043-b2ab-eda6031d2f6a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:55.145419 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908f3ce-82aa-4043-b2ab-eda6031d2f6a None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:55.147064 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 516/1042] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:42:55.152132 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec3bd3-21c3-41fc-aab7-7847ce863d63 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:55.152458 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec3bd3-21c3-41fc-aab7-7847ce863d63 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:55.152728 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec3bd3-21c3-41fc-aab7-7847ce863d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:55.170705 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-dbec3bd3-21c3-41fc-aab7-7847ce863d63 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:55.171907 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-dbec3bd3-21c3-41fc-aab7-7847ce863d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:55.243467 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 517/1043] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:55 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:42:55.244869 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cce5c-8ce5-4ef3-81e0-4670d89c8aae None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:55.282999 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1feb770-c1bc-45f9-86d5-87e679712584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:55.283605 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1feb770-c1bc-45f9-86d5-87e679712584 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:55.283893 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1feb770-c1bc-45f9-86d5-87e679712584 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:55.284161 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1feb770-c1bc-45f9-86d5-87e679712584 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:55.284803 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1feb770-c1bc-45f9-86d5-87e679712584 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:55.285104 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1feb770-c1bc-45f9-86d5-87e679712584 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:55.286810 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1feb770-c1bc-45f9-86d5-87e679712584 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:55.298903 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 527/1044] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:55.304587 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec3bd3-21c3-41fc-aab7-7847ce863d63 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:55.389919 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:55.406771 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec3bd3-21c3-41fc-aab7-7847ce863d63 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:55.442821 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648fe23-4486-42c6-b75d-0f34e7cf7f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:55.443428 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648fe23-4486-42c6-b75d-0f34e7cf7f3e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:55.443728 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648fe23-4486-42c6-b75d-0f34e7cf7f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:55.443996 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648fe23-4486-42c6-b75d-0f34e7cf7f3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:55.450837 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648fe23-4486-42c6-b75d-0f34e7cf7f3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:55.452485 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648fe23-4486-42c6-b75d-0f34e7cf7f3e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:55.463616 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-0648fe23-4486-42c6-b75d-0f34e7cf7f3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:55.463616 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:55.463616 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:55.463616 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:55.463616 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:55.463616 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:55.463616 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:55.463616 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:55.463616 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:55.463616 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:55.463616 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:55.463616 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:55.463616 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:42:55.463616 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:42:55.463616 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:42:55.464500 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:42:55.464500 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:55.464500 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:55.464500 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:55.464500 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:55.464500 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:55.464500 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:55.464500 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:55.464500 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:55.464500 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:55.464500 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:55.464500 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:55.464500 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:55.464500 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:55.464500 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:55.464500 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:55.464500 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:55.465400 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:42:55.465400 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:42:55.465400 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:42:55.465400 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:42:55.465400 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:42:55.465400 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:42:55.465400 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:55.465400 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:55.469710 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 518/1045] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:42:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:55.471305 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1feb770-c1bc-45f9-86d5-87e679712584 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:55.527851 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648fe23-4486-42c6-b75d-0f34e7cf7f3e None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:55.542546 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:55.584814 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1feb770-c1bc-45f9-86d5-87e679712584 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:55.618907 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdbc9c-8754-42bf-b89c-356a745bfb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:55.619519 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdbc9c-8754-42bf-b89c-356a745bfb06 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:55.619791 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdbc9c-8754-42bf-b89c-356a745bfb06 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:55.620151 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdbc9c-8754-42bf-b89c-356a745bfb06 None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:55.620741 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdbc9c-8754-42bf-b89c-356a745bfb06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:55.621039 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdbc9c-8754-42bf-b89c-356a745bfb06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:55.622495 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdbc9c-8754-42bf-b89c-356a745bfb06 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:55.632370 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648fe23-4486-42c6-b75d-0f34e7cf7f3e None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:55.635178 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 528/1046] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:42:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:42:55.641299 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdbc9c-8754-42bf-b89c-356a745bfb06 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:55.668686 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf61d4-05dd-4175-9aef-99e4adbc903e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:55.669577 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf61d4-05dd-4175-9aef-99e4adbc903e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:55.670127 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf61d4-05dd-4175-9aef-99e4adbc903e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:55.670400 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf61d4-05dd-4175-9aef-99e4adbc903e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:55.680849 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf61d4-05dd-4175-9aef-99e4adbc903e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:42:55.686188 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-c5cf61d4-05dd-4175-9aef-99e4adbc903e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:42:55.686188 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:55.686188 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:55.686188 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:55.686188 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:55.686188 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:55.686188 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:55.686188 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:55.686188 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:55.686188 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:55.686188 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:55.686188 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:55.686188 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:42:55.686188 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:42:55.686188 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:42:55.686188 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:42:55.687159 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:42:55.687159 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:42:55.687159 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:42:55.687159 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:42:55.687159 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:55.687159 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:55.687159 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:55.687159 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:55.687159 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:55.687159 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:55.687159 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:55.687159 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:55.687159 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:55.687159 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:55.687159 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:55.687159 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:55.688014 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:55.688014 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:55.688014 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:55.688014 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:55.688014 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:42:55.688014 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:42:55.688014 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:42:55.688014 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:42:55.688014 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:42:55.688014 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:42:55.688014 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:42:55.688014 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:55.688014 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 519/1047] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:42:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:55.693197 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf61d4-05dd-4175-9aef-99e4adbc903e None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:55.698173 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:55.750397 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdbc9c-8754-42bf-b89c-356a745bfb06 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:55.776419 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:55.790030 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee7044-c714-41ef-8eb4-b7166f5f1daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:55.790625 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee7044-c714-41ef-8eb4-b7166f5f1daa None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:55.790897 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee7044-c714-41ef-8eb4-b7166f5f1daa None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:55.791164 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee7044-c714-41ef-8eb4-b7166f5f1daa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:55.791880 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee7044-c714-41ef-8eb4-b7166f5f1daa None admin] RBAC: Adding query filter params (role.id=40e39507eac04ff6b770e29fce3b7e81, scope.project.id=45c69e3e973c449895457bb610103a43, user.id=f890ff4e7807477db7f17c2f6434dce8) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:55.792174 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee7044-c714-41ef-8eb4-b7166f5f1daa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:55.793611 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee7044-c714-41ef-8eb4-b7166f5f1daa None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:55.809887 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 529/1048] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:42:55 2022] GET /identity/v3/role_assignments?user.id=f890ff4e7807477db7f17c2f6434dce8&scope.project.id=45c69e3e973c449895457bb610103a43&role.id=40e39507eac04ff6b770e29fce3b7e81 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:42:55.810110 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf61d4-05dd-4175-9aef-99e4adbc903e None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:55.849534 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c120b-a6ef-4d41-9757-47d5949c82a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:55.850345 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c120b-a6ef-4d41-9757-47d5949c82a4 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:55.850692 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c120b-a6ef-4d41-9757-47d5949c82a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:55.851032 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c120b-a6ef-4d41-9757-47d5949c82a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:55.851793 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c120b-a6ef-4d41-9757-47d5949c82a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:55.852162 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c120b-a6ef-4d41-9757-47d5949c82a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:55.853698 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c120b-a6ef-4d41-9757-47d5949c82a4 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:55.864268 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 520/1049] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:42:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:42:55.870265 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee7044-c714-41ef-8eb4-b7166f5f1daa None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:55.985746 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee7044-c714-41ef-8eb4-b7166f5f1daa None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:56.024755 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecab71c-876d-4726-a754-305ff608d0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:56.025395 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecab71c-876d-4726-a754-305ff608d0ff None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:56.025670 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecab71c-876d-4726-a754-305ff608d0ff None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:56.025971 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecab71c-876d-4726-a754-305ff608d0ff None admin] PATH_INFO: `/v3/users/7da2162b11014f409121d65d8b12cd2c` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:56.040833 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecab71c-876d-4726-a754-305ff608d0ff None admin] RBAC: Authorizing `identity:get_user(user_id=7da2162b11014f409121d65d8b12cd2c)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:56.042327 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecab71c-876d-4726-a754-305ff608d0ff None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:56.049040 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 530/1050] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:42:55 2022] GET /identity/v3/users/7da2162b11014f409121d65d8b12cd2c => generated 285 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:56.050310 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c120b-a6ef-4d41-9757-47d5949c82a4 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:56.119918 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:56.157635 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c120b-a6ef-4d41-9757-47d5949c82a4 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:56.193471 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57003365-20f6-4412-9e93-9c203f2c28c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:56.194150 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57003365-20f6-4412-9e93-9c203f2c28c3 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:56.194427 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57003365-20f6-4412-9e93-9c203f2c28c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:56.194693 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57003365-20f6-4412-9e93-9c203f2c28c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:56.265738 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57003365-20f6-4412-9e93-9c203f2c28c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:56.267140 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57003365-20f6-4412-9e93-9c203f2c28c3 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:56.332578 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:56.371019 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 521/1051] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:42:56 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:42:56.377722 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecab71c-876d-4726-a754-305ff608d0ff None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:56.424794 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:56.481161 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecab71c-876d-4726-a754-305ff608d0ff None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:56.515673 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67329896-7471-446a-9ec6-95917b70e879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:56.516365 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67329896-7471-446a-9ec6-95917b70e879 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:56.516580 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67329896-7471-446a-9ec6-95917b70e879 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:56.516858 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67329896-7471-446a-9ec6-95917b70e879 None admin] PATH_INFO: `/v3/projects/758ef4f88b824b94b14eeec36cbee618` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:56.518010 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67329896-7471-446a-9ec6-95917b70e879 None admin] RBAC: Authorizing `identity:get_project(project_id=758ef4f88b824b94b14eeec36cbee618)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:56.519449 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67329896-7471-446a-9ec6-95917b70e879 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:56.521235 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 531/1052] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:42:56 2022] GET /identity/v3/projects/758ef4f88b824b94b14eeec36cbee618 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:56.527300 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57003365-20f6-4412-9e93-9c203f2c28c3 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:56.609147 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca55c7-926d-474f-a391-b01e9ba1f6e9 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:56.609825 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca55c7-926d-474f-a391-b01e9ba1f6e9 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:56.610358 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca55c7-926d-474f-a391-b01e9ba1f6e9 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:56.612136 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 532/1053] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:56.617135 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc682a3-747e-4324-a400-f015f456d45c None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:56.617444 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc682a3-747e-4324-a400-f015f456d45c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:56.617697 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc682a3-747e-4324-a400-f015f456d45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:56.639382 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-6cc682a3-747e-4324-a400-f015f456d45c None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:56.641562 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6cc682a3-747e-4324-a400-f015f456d45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:56.642569 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57003365-20f6-4412-9e93-9c203f2c28c3 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:56.680507 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6702d8-1f30-4d33-8535-5d4e2d8ee1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:56.681124 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6702d8-1f30-4d33-8535-5d4e2d8ee1ff None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:56.681420 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6702d8-1f30-4d33-8535-5d4e2d8ee1ff None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:56.681657 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6702d8-1f30-4d33-8535-5d4e2d8ee1ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:56.682414 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6702d8-1f30-4d33-8535-5d4e2d8ee1ff None admin] RBAC: Adding query filter params (role.id=cc013581bb07418d9ec6a3a1d282ea53, scope.project.id=758ef4f88b824b94b14eeec36cbee618, user.id=7da2162b11014f409121d65d8b12cd2c) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:56.682718 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6702d8-1f30-4d33-8535-5d4e2d8ee1ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:56.684150 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6702d8-1f30-4d33-8535-5d4e2d8ee1ff None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:56.700759 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 522/1054] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:42:56 2022] GET /identity/v3/role_assignments?user.id=7da2162b11014f409121d65d8b12cd2c&scope.project.id=758ef4f88b824b94b14eeec36cbee618&role.id=cc013581bb07418d9ec6a3a1d282ea53 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:56.741032 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 533/1055] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:42:57.008206 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6702d8-1f30-4d33-8535-5d4e2d8ee1ff None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:57.041237 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:57.116927 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6702d8-1f30-4d33-8535-5d4e2d8ee1ff None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:57.153136 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f377936-08d9-44a2-85df-a56e7c539740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:57.153812 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f377936-08d9-44a2-85df-a56e7c539740 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:57.154190 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f377936-08d9-44a2-85df-a56e7c539740 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:57.154462 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f377936-08d9-44a2-85df-a56e7c539740 None admin] PATH_INFO: `/v3/services/image` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:57.155040 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f377936-08d9-44a2-85df-a56e7c539740 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:57.156426 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f377936-08d9-44a2-85df-a56e7c539740 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:57.165374 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-0f377936-08d9-44a2-85df-a56e7c539740 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:42:57.165374 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:57.165374 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:42:57.165374 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:42:57.165374 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:42:57.165374 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:42:57.165374 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:42:57.165374 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:57.165374 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:42:57.165374 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:57.165374 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:42:57.165374 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:57.165374 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:57.165374 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:57.165374 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:57.165374 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:57.165374 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:57.166415 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:57.166415 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:57.166415 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:57.166415 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:57.166415 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:57.166415 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:57.166415 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:42:57.166415 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:42:57.166415 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:42:57.166415 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:42:57.166415 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:57.166415 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:57.166415 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:57.166415 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:57.166415 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:57.166415 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:57.167272 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:57.167272 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:57.167272 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:57.167272 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:57.167272 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:57.167272 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:57.167272 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:57.167272 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:57.167272 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:57.167272 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:57.167272 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:42:57.167272 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:42:57.167272 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:42:57.167272 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:57.171541 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 523/1056] 10.222.0.52 () {56 vars in 1105 bytes} [Sun Aug 28 00:42:57 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:57.172846 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc682a3-747e-4324-a400-f015f456d45c None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:57.217529 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:57.281202 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc682a3-747e-4324-a400-f015f456d45c None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:57.316441 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87b4a5-6cc2-4ea6-aeb0-45b20e7fda31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:57.317058 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87b4a5-6cc2-4ea6-aeb0-45b20e7fda31 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:57.317336 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87b4a5-6cc2-4ea6-aeb0-45b20e7fda31 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:57.317605 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87b4a5-6cc2-4ea6-aeb0-45b20e7fda31 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:57.318280 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af87b4a5-6cc2-4ea6-aeb0-45b20e7fda31 None admin] RBAC: Adding query filter params (name=image) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:57.318582 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af87b4a5-6cc2-4ea6-aeb0-45b20e7fda31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:57.319968 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af87b4a5-6cc2-4ea6-aeb0-45b20e7fda31 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:57.325509 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 534/1057] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:57.331225 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f377936-08d9-44a2-85df-a56e7c539740 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:57.430108 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:57.438827 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f377936-08d9-44a2-85df-a56e7c539740 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:57.473180 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e169be-feab-403b-806a-ff050746faa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:57.473788 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e169be-feab-403b-806a-ff050746faa8 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:57.474095 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e169be-feab-403b-806a-ff050746faa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:57.474369 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e169be-feab-403b-806a-ff050746faa8 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:57.475004 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e169be-feab-403b-806a-ff050746faa8 None admin] RBAC: Adding query filter params (type=image) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:57.475307 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e169be-feab-403b-806a-ff050746faa8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:57.476704 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e169be-feab-403b-806a-ff050746faa8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:57.481722 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 524/1058] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:57.487477 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87b4a5-6cc2-4ea6-aeb0-45b20e7fda31 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:57.596495 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87b4a5-6cc2-4ea6-aeb0-45b20e7fda31 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:57.604767 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:57.634830 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7026bc9-19d9-4c92-9fd6-0d016abd86f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:57.635449 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7026bc9-19d9-4c92-9fd6-0d016abd86f0 None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:57.635728 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7026bc9-19d9-4c92-9fd6-0d016abd86f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:57.635999 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7026bc9-19d9-4c92-9fd6-0d016abd86f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:57.636665 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7026bc9-19d9-4c92-9fd6-0d016abd86f0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:57.638137 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7026bc9-19d9-4c92-9fd6-0d016abd86f0 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:57.658855 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 535/1059] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:42:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:42:57.712638 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7048a4f-80fb-481a-8876-8127a73392e0 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:57.713224 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7048a4f-80fb-481a-8876-8127a73392e0 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:57.713224 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7048a4f-80fb-481a-8876-8127a73392e0 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:57.714794 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 525/1060] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:57.720877 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0e0de-58e9-4000-ba33-2b4ba36a6860 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:57.721166 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0e0de-58e9-4000-ba33-2b4ba36a6860 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:57.721434 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0e0de-58e9-4000-ba33-2b4ba36a6860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:57.740949 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-9da0e0de-58e9-4000-ba33-2b4ba36a6860 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:57.742224 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9da0e0de-58e9-4000-ba33-2b4ba36a6860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:57.824922 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 536/1061] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:42:58.090081 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7048a4f-80fb-481a-8876-8127a73392e0 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:58.202305 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7048a4f-80fb-481a-8876-8127a73392e0 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:58.237942 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589cf1c-1943-45a8-a69a-2daaf0de6f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:58.238715 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589cf1c-1943-45a8-a69a-2daaf0de6f4d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:58.238992 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589cf1c-1943-45a8-a69a-2daaf0de6f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:58.239261 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589cf1c-1943-45a8-a69a-2daaf0de6f4d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:58.249662 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589cf1c-1943-45a8-a69a-2daaf0de6f4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:42:58.254443 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-0589cf1c-1943-45a8-a69a-2daaf0de6f4d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:42:58.254443 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:58.254443 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:58.254443 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:58.254443 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:58.254443 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:58.254443 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:58.254443 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:58.254443 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:58.254443 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:58.254443 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:58.254443 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:58.254443 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:42:58.254443 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:42:58.254443 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:42:58.254443 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:42:58.255362 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:42:58.255362 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:42:58.255362 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:42:58.255362 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:42:58.255362 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:58.255362 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:58.255362 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:58.255362 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:58.255362 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:58.255362 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:58.255362 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:58.255362 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:58.255362 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:58.255362 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:58.255362 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:58.255362 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:58.258848 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:58.258848 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:58.258848 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:58.258848 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:58.258848 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:42:58.258848 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:42:58.258848 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:42:58.258848 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:42:58.258848 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:42:58.258848 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:42:58.258848 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:42:58.258848 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:58.258848 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 526/1062] 10.222.0.52 () {56 vars in 1120 bytes} [Sun Aug 28 00:42:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:58.261501 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0e0de-58e9-4000-ba33-2b4ba36a6860 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:58.354617 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:58.368558 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0e0de-58e9-4000-ba33-2b4ba36a6860 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:58.403262 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305a3bb-b40f-47c3-b9d2-fcbfa1260511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:58.403862 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305a3bb-b40f-47c3-b9d2-fcbfa1260511 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:58.404229 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305a3bb-b40f-47c3-b9d2-fcbfa1260511 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:58.404498 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305a3bb-b40f-47c3-b9d2-fcbfa1260511 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:58.405150 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305a3bb-b40f-47c3-b9d2-fcbfa1260511 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:58.405449 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305a3bb-b40f-47c3-b9d2-fcbfa1260511 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:58.406852 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305a3bb-b40f-47c3-b9d2-fcbfa1260511 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:58.414907 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 537/1063] 10.222.0.52 () {56 vars in 1115 bytes} [Sun Aug 28 00:42:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:58.420783 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589cf1c-1943-45a8-a69a-2daaf0de6f4d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:58.444137 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:58.528139 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589cf1c-1943-45a8-a69a-2daaf0de6f4d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:58.568765 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec28a0-dca7-4f1f-9bcb-c2bac488023e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:58.569390 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec28a0-dca7-4f1f-9bcb-c2bac488023e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:58.569664 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec28a0-dca7-4f1f-9bcb-c2bac488023e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:58.569955 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec28a0-dca7-4f1f-9bcb-c2bac488023e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:58.580173 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec28a0-dca7-4f1f-9bcb-c2bac488023e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:58.581624 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec28a0-dca7-4f1f-9bcb-c2bac488023e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:58.597176 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-e2ec28a0-dca7-4f1f-9bcb-c2bac488023e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:58.597176 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:58.597176 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:58.597176 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:58.597176 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:58.597176 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:58.597176 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:58.597176 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:58.597176 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:58.597176 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:58.597176 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:58.597176 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:58.597176 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:58.597176 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:58.597176 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:58.597176 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:58.598218 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:58.598218 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:58.598218 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:58.598218 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:58.598218 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:58.598218 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:58.598218 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:58.598218 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:58.598218 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:58.598218 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:58.598218 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:58.598218 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:58.598218 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:58.598218 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:58.598218 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:58.598218 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:58.598218 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:58.599143 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:58.599143 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:58.599143 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:58.599143 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 527/1064] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:58.605508 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305a3bb-b40f-47c3-b9d2-fcbfa1260511 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:58.621650 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef7389-8d07-4e9b-b649-6399c66e63ff None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:58.622071 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef7389-8d07-4e9b-b649-6399c66e63ff None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:58.622247 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef7389-8d07-4e9b-b649-6399c66e63ff None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:58.623718 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 528/1065] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:42:58.628806 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03311685-aa0a-44de-b5a2-18808a3b72a5 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:58.629255 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03311685-aa0a-44de-b5a2-18808a3b72a5 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:58.629526 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03311685-aa0a-44de-b5a2-18808a3b72a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:58.647885 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-03311685-aa0a-44de-b5a2-18808a3b72a5 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:58.649049 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-03311685-aa0a-44de-b5a2-18808a3b72a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:58.715927 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:58.718883 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305a3bb-b40f-47c3-b9d2-fcbfa1260511 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:58.725888 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 529/1066] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:42:58.762853 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35218ac2-821b-4cb4-9ef3-3b3763aba1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:58.763631 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35218ac2-821b-4cb4-9ef3-3b3763aba1af None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:58.763906 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35218ac2-821b-4cb4-9ef3-3b3763aba1af None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:58.764177 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35218ac2-821b-4cb4-9ef3-3b3763aba1af None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:58.764825 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35218ac2-821b-4cb4-9ef3-3b3763aba1af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:58.765125 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35218ac2-821b-4cb4-9ef3-3b3763aba1af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:58.766539 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35218ac2-821b-4cb4-9ef3-3b3763aba1af None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:58.784423 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 538/1067] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:58.785745 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03311685-aa0a-44de-b5a2-18808a3b72a5 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:58.887450 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03311685-aa0a-44de-b5a2-18808a3b72a5 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:58.921387 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fea6c6-afdc-4945-8744-6d9b0ccda192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:58.922033 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fea6c6-afdc-4945-8744-6d9b0ccda192 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:58.922589 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fea6c6-afdc-4945-8744-6d9b0ccda192 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:58.922861 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fea6c6-afdc-4945-8744-6d9b0ccda192 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:58.929835 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fea6c6-afdc-4945-8744-6d9b0ccda192 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:58.931325 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fea6c6-afdc-4945-8744-6d9b0ccda192 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:58.942869 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-84fea6c6-afdc-4945-8744-6d9b0ccda192 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:42:58.942869 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:58.942869 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:58.942869 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:58.942869 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:58.942869 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:58.942869 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:58.942869 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:58.942869 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:58.942869 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:58.942869 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:58.942869 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:58.942869 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:42:58.942869 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:42:58.942869 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:42:58.942869 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:42:58.943820 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:58.943820 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:58.943820 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:42:58.943820 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:58.943820 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:42:58.943820 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:42:58.943820 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:58.943820 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:58.943820 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:58.943820 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:58.943820 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:58.943820 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:58.943820 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:58.943820 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:58.943820 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:58.943820 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:58.943820 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:58.943820 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:58.944802 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:58.944802 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:58.944802 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:42:58.944802 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:42:58.944802 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:42:58.944802 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:42:58.944802 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:42:58.944802 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:42:58.944802 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:42:58.944802 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:58.944802 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 530/1068] 10.222.0.52 () {56 vars in 1093 bytes} [Sun Aug 28 00:42:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:42:58.949709 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35218ac2-821b-4cb4-9ef3-3b3763aba1af None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:58.962901 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:58.994110 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fea6c6-afdc-4945-8744-6d9b0ccda192 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:59.054549 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:59.058617 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35218ac2-821b-4cb4-9ef3-3b3763aba1af None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:59.094977 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e97cab-5a86-483b-a163-adf777f3fcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:59.095890 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e97cab-5a86-483b-a163-adf777f3fcd0 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:59.096162 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e97cab-5a86-483b-a163-adf777f3fcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:59.096427 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e97cab-5a86-483b-a163-adf777f3fcd0 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:59.096748 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fea6c6-afdc-4945-8744-6d9b0ccda192 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:59.097142 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e97cab-5a86-483b-a163-adf777f3fcd0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:59.097437 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e97cab-5a86-483b-a163-adf777f3fcd0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:59.098892 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e97cab-5a86-483b-a163-adf777f3fcd0 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:59.116014 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 539/1069] 10.222.0.52 () {56 vars in 1133 bytes} [Sun Aug 28 00:42:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:42:59.121816 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e97cab-5a86-483b-a163-adf777f3fcd0 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:59.138881 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fcfb5-5bec-4047-ba51-f057d6db6ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:59.139430 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fcfb5-5bec-4047-ba51-f057d6db6ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:59.139715 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fcfb5-5bec-4047-ba51-f057d6db6ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:59.139970 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fcfb5-5bec-4047-ba51-f057d6db6ef9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:59.151142 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294fcfb5-5bec-4047-ba51-f057d6db6ef9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:42:59.156018 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-294fcfb5-5bec-4047-ba51-f057d6db6ef9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:42:59.156018 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:59.156018 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:59.156018 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:59.156018 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:59.156018 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:59.156018 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:59.156018 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:59.156018 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:59.156018 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:59.156018 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:59.156018 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:59.156018 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:42:59.156018 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:42:59.156018 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:42:59.156018 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:42:59.157989 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:42:59.157989 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:42:59.157989 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:42:59.157989 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:42:59.157989 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:59.157989 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:59.157989 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:59.157989 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:59.157989 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:59.157989 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:59.157989 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:59.157989 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:59.157989 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:59.157989 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:59.157989 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:59.157989 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:59.158879 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:59.158879 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:59.158879 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:59.158879 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:59.158879 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:42:59.158879 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:42:59.158879 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:42:59.158879 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:42:59.158879 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:42:59.158879 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:42:59.158879 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:42:59.158879 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:42:59.158879 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 531/1070] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:42:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:42:59.164924 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fcfb5-5bec-4047-ba51-f057d6db6ef9 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:59.196743 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:59.230549 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e97cab-5a86-483b-a163-adf777f3fcd0 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:59.265903 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616ad86-7d83-4481-8c02-a72924f3b734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:59.266510 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616ad86-7d83-4481-8c02-a72924f3b734 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:59.266791 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616ad86-7d83-4481-8c02-a72924f3b734 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:59.267063 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616ad86-7d83-4481-8c02-a72924f3b734 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:59.277030 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fcfb5-5bec-4047-ba51-f057d6db6ef9 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:59.277399 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616ad86-7d83-4481-8c02-a72924f3b734 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:59.278902 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616ad86-7d83-4481-8c02-a72924f3b734 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:59.295289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-5616ad86-7d83-4481-8c02-a72924f3b734 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:59.295289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:59.295289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:59.295289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:59.295289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:59.295289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:59.295289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:59.295289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:59.295289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:59.295289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:59.295289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:59.295289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:59.295289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:42:59.295289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:42:59.295289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:42:59.295289 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:42:59.296704 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:59.296704 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:59.296704 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:59.296704 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:59.296704 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:59.296704 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:59.296704 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:59.296704 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:59.296704 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:59.296704 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:59.296704 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:59.296704 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:59.296704 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:59.296704 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:59.296704 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:59.296704 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:59.296704 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:42:59.297896 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:42:59.297896 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:42:59.297896 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:59.303379 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 540/1071] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:42:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:42:59.304486 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616ad86-7d83-4481-8c02-a72924f3b734 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:59.308344 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:59.326118 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2b1c3-e8f0-4104-834b-1fbc5ec2ee00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:59.326724 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2b1c3-e8f0-4104-834b-1fbc5ec2ee00 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:59.326997 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2b1c3-e8f0-4104-834b-1fbc5ec2ee00 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:59.327300 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2b1c3-e8f0-4104-834b-1fbc5ec2ee00 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:59.327913 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d2b1c3-e8f0-4104-834b-1fbc5ec2ee00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:59.328327 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d2b1c3-e8f0-4104-834b-1fbc5ec2ee00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:59.329581 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d2b1c3-e8f0-4104-834b-1fbc5ec2ee00 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:59.343669 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 532/1072] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:42:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:59.344998 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2b1c3-e8f0-4104-834b-1fbc5ec2ee00 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:59.414576 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616ad86-7d83-4481-8c02-a72924f3b734 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:59.436643 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:59.451435 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6a247-2900-4225-9dbc-62b80cab098a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:59.452049 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6a247-2900-4225-9dbc-62b80cab098a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:59.452329 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6a247-2900-4225-9dbc-62b80cab098a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:59.452601 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6a247-2900-4225-9dbc-62b80cab098a None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:59.453247 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6a247-2900-4225-9dbc-62b80cab098a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:59.453553 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6a247-2900-4225-9dbc-62b80cab098a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:59.454967 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6a247-2900-4225-9dbc-62b80cab098a None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:59.460691 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2b1c3-e8f0-4104-834b-1fbc5ec2ee00 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:59.467832 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 541/1073] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:59.473528 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6a247-2900-4225-9dbc-62b80cab098a None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:59.500469 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca02061-7503-4706-b4c2-947330a0bfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:59.501552 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca02061-7503-4706-b4c2-947330a0bfbd None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:59.502195 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca02061-7503-4706-b4c2-947330a0bfbd None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:59.502831 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca02061-7503-4706-b4c2-947330a0bfbd None admin] PATH_INFO: `/v3/users/7da2162b11014f409121d65d8b12cd2c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:59.504263 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca02061-7503-4706-b4c2-947330a0bfbd None admin] RBAC: Authorizing `identity:get_user(user_id=7da2162b11014f409121d65d8b12cd2c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:59.506244 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca02061-7503-4706-b4c2-947330a0bfbd None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:59.512568 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 533/1074] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:42:59 2022] GET /identity/v3/users/7da2162b11014f409121d65d8b12cd2c => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:59.513474 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca02061-7503-4706-b4c2-947330a0bfbd None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:59.572374 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:59.585446 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6a247-2900-4225-9dbc-62b80cab098a None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:59.622422 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ded85e-4bac-433b-8d3b-2410d85766e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:59.623183 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ded85e-4bac-433b-8d3b-2410d85766e1 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:59.623507 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ded85e-4bac-433b-8d3b-2410d85766e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:59.623787 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ded85e-4bac-433b-8d3b-2410d85766e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:59.626951 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca02061-7503-4706-b4c2-947330a0bfbd None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:59.630759 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ded85e-4bac-433b-8d3b-2410d85766e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:59.632275 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ded85e-4bac-433b-8d3b-2410d85766e1 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:59.643821 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-a1ded85e-4bac-433b-8d3b-2410d85766e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:59.643821 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:42:59.643821 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:42:59.643821 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:42:59.643821 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:42:59.643821 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:42:59.643821 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:42:59.643821 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:42:59.643821 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:42:59.643821 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:42:59.643821 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:42:59.643821 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:42:59.643821 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:42:59.643821 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:42:59.643821 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:42:59.644766 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:42:59.644766 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:42:59.644766 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:42:59.644766 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:42:59.644766 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:42:59.644766 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:42:59.644766 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:42:59.644766 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:42:59.644766 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:42:59.644766 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:42:59.644766 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:42:59.644766 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:42:59.644766 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:42:59.644766 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:42:59.644766 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:42:59.644766 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:42:59.644766 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:42:59.645695 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:42:59.645695 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:42:59.645695 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:42:59.645695 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:42:59.645695 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:42:59.645695 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:42:59.645695 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:42:59.645695 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:42:59.645695 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 542/1075] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:42:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:42:59.646628 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa543ba-6529-44c4-95f2-f6c8493012bf None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:59.646628 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa543ba-6529-44c4-95f2-f6c8493012bf None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:59.646838 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa543ba-6529-44c4-95f2-f6c8493012bf None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:59.648172 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 543/1076] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:42:59.651155 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa543ba-6529-44c4-95f2-f6c8493012bf None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:59.665356 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c439a-3d27-4881-aee7-6e6524df23cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:59.665951 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c439a-3d27-4881-aee7-6e6524df23cf None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:59.666231 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c439a-3d27-4881-aee7-6e6524df23cf None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:59.666500 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c439a-3d27-4881-aee7-6e6524df23cf None admin] PATH_INFO: `/v3/projects/758ef4f88b824b94b14eeec36cbee618` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:59.667658 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c439a-3d27-4881-aee7-6e6524df23cf None admin] RBAC: Authorizing `identity:get_project(project_id=758ef4f88b824b94b14eeec36cbee618)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:59.669104 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c439a-3d27-4881-aee7-6e6524df23cf None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:59.675955 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 534/1077] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:42:59 2022] GET /identity/v3/projects/758ef4f88b824b94b14eeec36cbee618 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:42:59.675955 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b5bac-0f64-4f44-9628-4c209ac88fbd None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:59.675955 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b5bac-0f64-4f44-9628-4c209ac88fbd None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:59.675955 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b5bac-0f64-4f44-9628-4c209ac88fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:59.690970 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-414b5bac-0f64-4f44-9628-4c209ac88fbd None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:42:59.692221 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-414b5bac-0f64-4f44-9628-4c209ac88fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:42:59.700326 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:59.759194 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 535/1078] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:42:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:42:59.760005 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b5bac-0f64-4f44-9628-4c209ac88fbd None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:59.760597 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa543ba-6529-44c4-95f2-f6c8493012bf None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:59.797069 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c457618-f6ee-4917-a2d4-05961b443435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:59.797674 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c457618-f6ee-4917-a2d4-05961b443435 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:59.797986 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c457618-f6ee-4917-a2d4-05961b443435 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:59.798261 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c457618-f6ee-4917-a2d4-05961b443435 None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:59.798974 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c457618-f6ee-4917-a2d4-05961b443435 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:42:59.799276 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c457618-f6ee-4917-a2d4-05961b443435 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:59.800713 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c457618-f6ee-4917-a2d4-05961b443435 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:59.812714 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 544/1079] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:42:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:42:59.818861 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c457618-f6ee-4917-a2d4-05961b443435 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:42:59.825539 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:59.876562 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b5bac-0f64-4f44-9628-4c209ac88fbd None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:59.912997 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d198980-5db4-4bb8-b51c-e540f0a56ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:59.913652 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d198980-5db4-4bb8-b51c-e540f0a56ae2 None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:59.913958 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d198980-5db4-4bb8-b51c-e540f0a56ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:59.914235 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d198980-5db4-4bb8-b51c-e540f0a56ae2 None admin] PATH_INFO: `/v3/projects/758ef4f88b824b94b14eeec36cbee618/users/7da2162b11014f409121d65d8b12cd2c/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:59.916596 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d198980-5db4-4bb8-b51c-e540f0a56ae2 None admin] RBAC: Authorizing `identity:create_grant(project_id=758ef4f88b824b94b14eeec36cbee618, user_id=7da2162b11014f409121d65d8b12cd2c, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:59.918027 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d198980-5db4-4bb8-b51c-e540f0a56ae2 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:59.924769 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:42:59.928104 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c457618-f6ee-4917-a2d4-05961b443435 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:42:59.933918 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 536/1080] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Aug 28 00:42:59 2022] PUT /identity/v3/projects/758ef4f88b824b94b14eeec36cbee618/users/7da2162b11014f409121d65d8b12cd2c/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:42:59.968873 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad3142-6bbd-4d1e-b338-1f6c135b33e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:42:59.969559 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad3142-6bbd-4d1e-b338-1f6c135b33e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:42:59.969830 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad3142-6bbd-4d1e-b338-1f6c135b33e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:42:59.970130 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad3142-6bbd-4d1e-b338-1f6c135b33e7 None admin] PATH_INFO: `/v3/projects/45c69e3e973c449895457bb610103a43/users/f890ff4e7807477db7f17c2f6434dce8/roles/40e39507eac04ff6b770e29fce3b7e81` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:42:59.972607 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad3142-6bbd-4d1e-b338-1f6c135b33e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=45c69e3e973c449895457bb610103a43, user_id=f890ff4e7807477db7f17c2f6434dce8, role_id=40e39507eac04ff6b770e29fce3b7e81)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:42:59.974106 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad3142-6bbd-4d1e-b338-1f6c135b33e7 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:42:59.997874 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 545/1081] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Aug 28 00:42:59 2022] PUT /identity/v3/projects/45c69e3e973c449895457bb610103a43/users/f890ff4e7807477db7f17c2f6434dce8/roles/40e39507eac04ff6b770e29fce3b7e81 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:43:00.024689 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d198980-5db4-4bb8-b51c-e540f0a56ae2 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:00.144617 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d198980-5db4-4bb8-b51c-e540f0a56ae2 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:00.155980 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:00.185458 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e59d75-444b-4bcf-b0c2-55f215483b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:00.185937 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e59d75-444b-4bcf-b0c2-55f215483b5f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:00.186234 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e59d75-444b-4bcf-b0c2-55f215483b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:00.186581 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e59d75-444b-4bcf-b0c2-55f215483b5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:00.258409 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e59d75-444b-4bcf-b0c2-55f215483b5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:00.259876 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e59d75-444b-4bcf-b0c2-55f215483b5f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:00.362944 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 537/1082] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:43:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:43:00.368622 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad3142-6bbd-4d1e-b338-1f6c135b33e7 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:00.480995 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad3142-6bbd-4d1e-b338-1f6c135b33e7 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:00.518308 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44678ed6-74a1-4dbd-b1da-a0b4e77e77d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:00.519346 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44678ed6-74a1-4dbd-b1da-a0b4e77e77d7 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:00.519825 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44678ed6-74a1-4dbd-b1da-a0b4e77e77d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:00.520300 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44678ed6-74a1-4dbd-b1da-a0b4e77e77d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:00.539026 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44678ed6-74a1-4dbd-b1da-a0b4e77e77d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:00.540507 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44678ed6-74a1-4dbd-b1da-a0b4e77e77d7 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:00.556068 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-44678ed6-74a1-4dbd-b1da-a0b4e77e77d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:43:00.556068 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:43:00.556068 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:43:00.556068 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:43:00.556068 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:43:00.556068 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:43:00.556068 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:43:00.556068 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:43:00.556068 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:43:00.556068 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:43:00.556068 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:43:00.556068 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:43:00.556068 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:43:00.556068 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:43:00.556068 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:43:00.556068 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:43:00.557054 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:43:00.557054 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:43:00.557054 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:43:00.557054 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:43:00.557054 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:43:00.557054 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:43:00.557054 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:43:00.557054 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:43:00.557054 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:43:00.557054 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:43:00.557054 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:43:00.557054 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:43:00.557054 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:43:00.557054 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:43:00.557054 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:43:00.557054 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:43:00.557054 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:43:00.557991 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:43:00.557991 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:43:00.557991 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:43:00.557991 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 546/1083] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:43:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:43:00.563401 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e59d75-444b-4bcf-b0c2-55f215483b5f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:00.574129 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:00.668182 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e59d75-444b-4bcf-b0c2-55f215483b5f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:00.702072 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd831833-af1c-48ea-8ac0-f9cd0db7e5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:00.702675 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd831833-af1c-48ea-8ac0-f9cd0db7e5e0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:00.702950 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd831833-af1c-48ea-8ac0-f9cd0db7e5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:00.703213 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd831833-af1c-48ea-8ac0-f9cd0db7e5e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:00.703856 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd831833-af1c-48ea-8ac0-f9cd0db7e5e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:43:00.704160 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd831833-af1c-48ea-8ac0-f9cd0db7e5e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:00.705550 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd831833-af1c-48ea-8ac0-f9cd0db7e5e0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:00.716943 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 538/1084] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:01.850870 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb821487-ec0d-41ba-98c5-266d764dae12 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:01.851403 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb821487-ec0d-41ba-98c5-266d764dae12 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:01.851611 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb821487-ec0d-41ba-98c5-266d764dae12 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:01.852980 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 547/1085] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:43:01.858479 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef9092-a964-457f-9e1b-dd3b2654eb19 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:01.858896 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef9092-a964-457f-9e1b-dd3b2654eb19 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:01.859145 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef9092-a964-457f-9e1b-dd3b2654eb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:01.877794 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-9fef9092-a964-457f-9e1b-dd3b2654eb19 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:43:01.879019 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9fef9092-a964-457f-9e1b-dd3b2654eb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:43:01.912414 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c9cf4-6175-4459-8229-02d8f0d94d70 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:01.912688 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c9cf4-6175-4459-8229-02d8f0d94d70 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:01.912959 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c9cf4-6175-4459-8229-02d8f0d94d70 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:01.914359 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 548/1086] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:43:01.919514 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a585c-5def-47e6-b91c-f5a32b44ce00 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:01.919912 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a585c-5def-47e6-b91c-f5a32b44ce00 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:01.920579 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a585c-5def-47e6-b91c-f5a32b44ce00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:01.939045 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-368a585c-5def-47e6-b91c-f5a32b44ce00 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:43:01.940247 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-368a585c-5def-47e6-b91c-f5a32b44ce00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:43:01.944990 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:01.948410 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:01.953945 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 539/1087] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:43:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:43:02.012204 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 549/1088] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:43:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:43:02.217706 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef9092-a964-457f-9e1b-dd3b2654eb19 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:02.281815 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a585c-5def-47e6-b91c-f5a32b44ce00 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:02.320827 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef9092-a964-457f-9e1b-dd3b2654eb19 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:02.356526 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966a2cb-ff82-455e-a86e-9f5cd97b388b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:02.357161 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966a2cb-ff82-455e-a86e-9f5cd97b388b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:02.358067 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966a2cb-ff82-455e-a86e-9f5cd97b388b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:02.358346 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966a2cb-ff82-455e-a86e-9f5cd97b388b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:02.368709 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966a2cb-ff82-455e-a86e-9f5cd97b388b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:43:02.374366 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-2966a2cb-ff82-455e-a86e-9f5cd97b388b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:43:02.374366 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:43:02.374366 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:43:02.374366 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:43:02.374366 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:43:02.374366 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:43:02.374366 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:43:02.374366 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:43:02.374366 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:43:02.374366 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:43:02.374366 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:43:02.374366 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:43:02.374366 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:43:02.374366 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:43:02.374366 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:43:02.374366 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:43:02.375417 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:43:02.375417 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:43:02.375417 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:43:02.375417 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:43:02.375417 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:43:02.375417 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:43:02.375417 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:43:02.375417 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:43:02.375417 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:43:02.375417 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:43:02.375417 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:43:02.375417 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:43:02.375417 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:43:02.375417 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:43:02.375417 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:43:02.375417 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:43:02.376276 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:43:02.376276 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:43:02.376276 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:43:02.376276 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:43:02.376276 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:43:02.376276 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:43:02.376276 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:43:02.376276 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:43:02.376276 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:43:02.376276 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:43:02.376276 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:43:02.376276 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:43:02.376276 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 540/1089] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:43:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:43:02.381400 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966a2cb-ff82-455e-a86e-9f5cd97b388b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:02.383117 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a585c-5def-47e6-b91c-f5a32b44ce00 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:02.417102 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3cbe5-922b-4671-9d13-dac1cc45c0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:02.417746 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3cbe5-922b-4671-9d13-dac1cc45c0f6 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:02.418090 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3cbe5-922b-4671-9d13-dac1cc45c0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:02.418401 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3cbe5-922b-4671-9d13-dac1cc45c0f6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:02.429240 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3cbe5-922b-4671-9d13-dac1cc45c0f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:43:02.434216 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-41c3cbe5-922b-4671-9d13-dac1cc45c0f6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:43:02.434216 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:43:02.434216 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:43:02.434216 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:43:02.434216 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:43:02.434216 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:43:02.434216 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:43:02.434216 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:43:02.434216 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:43:02.434216 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:43:02.434216 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:43:02.434216 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:43:02.434216 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:43:02.434216 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:43:02.434216 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:43:02.434216 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:43:02.435253 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:43:02.435253 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:43:02.435253 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:43:02.435253 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:43:02.435253 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:43:02.435253 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:43:02.435253 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:43:02.435253 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:43:02.435253 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:43:02.435253 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:43:02.435253 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:43:02.435253 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:43:02.435253 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:43:02.435253 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:43:02.435253 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:43:02.435253 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:43:02.436906 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:43:02.436906 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:43:02.436906 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:43:02.436906 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:43:02.436906 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:43:02.436906 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:43:02.436906 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:43:02.436906 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:43:02.436906 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:43:02.436906 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:43:02.436906 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:43:02.436906 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:43:02.436906 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 550/1090] 10.222.0.52 () {56 vars in 1120 bytes} [Sun Aug 28 00:43:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:43:02.438449 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:02.441726 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3cbe5-922b-4671-9d13-dac1cc45c0f6 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:02.445474 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:02.483300 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966a2cb-ff82-455e-a86e-9f5cd97b388b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:02.516755 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b0091-d84d-4b07-8e9e-bcedc13b2597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:02.517348 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b0091-d84d-4b07-8e9e-bcedc13b2597 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:02.517621 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b0091-d84d-4b07-8e9e-bcedc13b2597 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:02.517913 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b0091-d84d-4b07-8e9e-bcedc13b2597 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:02.518570 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b0091-d84d-4b07-8e9e-bcedc13b2597 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:43:02.518865 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b0091-d84d-4b07-8e9e-bcedc13b2597 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:02.520276 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b0091-d84d-4b07-8e9e-bcedc13b2597 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:02.528134 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 541/1091] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:43:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:43:02.534450 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b0091-d84d-4b07-8e9e-bcedc13b2597 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:02.545996 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3cbe5-922b-4671-9d13-dac1cc45c0f6 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:02.583321 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f29d2b-7872-456b-bfb4-d9c45eb9fbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:02.583926 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f29d2b-7872-456b-bfb4-d9c45eb9fbb7 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:02.584202 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f29d2b-7872-456b-bfb4-d9c45eb9fbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:02.584472 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f29d2b-7872-456b-bfb4-d9c45eb9fbb7 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:02.585166 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f29d2b-7872-456b-bfb4-d9c45eb9fbb7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:43:02.585467 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f29d2b-7872-456b-bfb4-d9c45eb9fbb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:02.586955 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f29d2b-7872-456b-bfb4-d9c45eb9fbb7 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:02.594777 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 551/1092] 10.222.0.52 () {56 vars in 1115 bytes} [Sun Aug 28 00:43:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:02.600749 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f29d2b-7872-456b-bfb4-d9c45eb9fbb7 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:02.632715 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b0091-d84d-4b07-8e9e-bcedc13b2597 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:02.651884 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:02.660686 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:02.665906 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24fa75-aae3-48f4-89b8-aaa74ac8976f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:02.666672 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24fa75-aae3-48f4-89b8-aaa74ac8976f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:02.666951 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24fa75-aae3-48f4-89b8-aaa74ac8976f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:02.667217 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24fa75-aae3-48f4-89b8-aaa74ac8976f None admin] PATH_INFO: `/v3/users/7da2162b11014f409121d65d8b12cd2c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:02.668329 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24fa75-aae3-48f4-89b8-aaa74ac8976f None admin] RBAC: Authorizing `identity:get_user(user_id=7da2162b11014f409121d65d8b12cd2c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:02.669813 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24fa75-aae3-48f4-89b8-aaa74ac8976f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:02.671563 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 542/1093] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:43:02 2022] GET /identity/v3/users/7da2162b11014f409121d65d8b12cd2c => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:43:02.677330 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24fa75-aae3-48f4-89b8-aaa74ac8976f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:02.701483 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f29d2b-7872-456b-bfb4-d9c45eb9fbb7 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:02.735883 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ea5b8-2910-42ce-a3d3-449cdc649e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:02.736439 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ea5b8-2910-42ce-a3d3-449cdc649e77 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:02.736705 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ea5b8-2910-42ce-a3d3-449cdc649e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:02.736955 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ea5b8-2910-42ce-a3d3-449cdc649e77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:02.749857 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ea5b8-2910-42ce-a3d3-449cdc649e77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:02.751345 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ea5b8-2910-42ce-a3d3-449cdc649e77 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:02.766326 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-0e9ea5b8-2910-42ce-a3d3-449cdc649e77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:43:02.766326 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:43:02.766326 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:43:02.766326 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:43:02.766326 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:43:02.766326 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:43:02.766326 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:43:02.766326 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:43:02.766326 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:43:02.766326 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:43:02.766326 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:43:02.766326 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:43:02.766326 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:43:02.766326 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:43:02.766326 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:43:02.766326 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:43:02.767409 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:43:02.767409 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:43:02.767409 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:43:02.767409 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:43:02.767409 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:43:02.767409 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:43:02.767409 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:43:02.767409 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:43:02.767409 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:43:02.767409 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:43:02.767409 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:43:02.767409 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:43:02.767409 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:43:02.767409 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:43:02.767409 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:43:02.767409 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:43:02.767409 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:43:02.768308 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:43:02.768308 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:43:02.768308 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:43:02.768308 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 552/1094] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:43:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:43:02.773455 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ea5b8-2910-42ce-a3d3-449cdc649e77 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:02.783427 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24fa75-aae3-48f4-89b8-aaa74ac8976f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:02.817567 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea5652-50ef-4bda-849b-d49c494fd921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:02.818278 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea5652-50ef-4bda-849b-d49c494fd921 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:02.818557 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea5652-50ef-4bda-849b-d49c494fd921 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:02.818826 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea5652-50ef-4bda-849b-d49c494fd921 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:02.871350 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ea5b8-2910-42ce-a3d3-449cdc649e77 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:02.874853 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:02.887591 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:02.887741 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea5652-50ef-4bda-849b-d49c494fd921 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:02.889115 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea5652-50ef-4bda-849b-d49c494fd921 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:02.905610 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c26414-6f1d-496c-8351-73d5e8941b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:02.906238 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c26414-6f1d-496c-8351-73d5e8941b93 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:02.906523 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c26414-6f1d-496c-8351-73d5e8941b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:02.906795 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c26414-6f1d-496c-8351-73d5e8941b93 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:02.907434 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c26414-6f1d-496c-8351-73d5e8941b93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:43:02.907736 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c26414-6f1d-496c-8351-73d5e8941b93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:02.909108 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c26414-6f1d-496c-8351-73d5e8941b93 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:02.920895 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 553/1095] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:43:02.926553 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c26414-6f1d-496c-8351-73d5e8941b93 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:02.990179 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 543/1096] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:43:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 28 00:43:02.995934 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea5652-50ef-4bda-849b-d49c494fd921 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:03.028468 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c26414-6f1d-496c-8351-73d5e8941b93 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:03.062956 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f4c33-5ece-4f3f-a78c-d26c6c76e91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:03.063604 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f4c33-5ece-4f3f-a78c-d26c6c76e91d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:03.063917 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f4c33-5ece-4f3f-a78c-d26c6c76e91d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:03.064222 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f4c33-5ece-4f3f-a78c-d26c6c76e91d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:03.071951 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f4c33-5ece-4f3f-a78c-d26c6c76e91d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:03.073446 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f4c33-5ece-4f3f-a78c-d26c6c76e91d None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:03.082104 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:03.085939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-af7f4c33-5ece-4f3f-a78c-d26c6c76e91d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:43:03.085939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:43:03.085939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:43:03.085939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:43:03.085939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:43:03.085939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:43:03.085939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:43:03.085939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:43:03.085939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:43:03.085939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:43:03.085939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:43:03.085939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:43:03.085939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:43:03.085939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:43:03.085939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:43:03.085939 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:43:03.086889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:43:03.086889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:43:03.086889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:43:03.086889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:43:03.086889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:43:03.086889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:43:03.086889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:43:03.086889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:43:03.086889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:43:03.086889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:43:03.086889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:43:03.086889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:43:03.086889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:43:03.086889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:43:03.086889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:43:03.086889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:43:03.086889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:43:03.086889 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:43:03.087836 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:43:03.087836 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:43:03.087836 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:43:03.087836 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:43:03.087836 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:43:03.087836 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:43:03.087836 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:43:03.087836 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:43:03.087836 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:43:03.087836 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:43:03.087836 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 554/1097] 10.222.0.52 () {56 vars in 1093 bytes} [Sun Aug 28 00:43:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:43:03.093494 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f4c33-5ece-4f3f-a78c-d26c6c76e91d None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:03.095875 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea5652-50ef-4bda-849b-d49c494fd921 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:03.129861 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019e19f-18c2-42d5-a2d8-5a89606091d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:03.130501 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019e19f-18c2-42d5-a2d8-5a89606091d9 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:03.130613 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:03.130777 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019e19f-18c2-42d5-a2d8-5a89606091d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:03.131049 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019e19f-18c2-42d5-a2d8-5a89606091d9 None admin] PATH_INFO: `/v3/projects/758ef4f88b824b94b14eeec36cbee618` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:03.132190 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019e19f-18c2-42d5-a2d8-5a89606091d9 None admin] RBAC: Authorizing `identity:get_project(project_id=758ef4f88b824b94b14eeec36cbee618)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:03.133629 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019e19f-18c2-42d5-a2d8-5a89606091d9 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:03.135286 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 544/1098] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:43:02 2022] GET /identity/v3/projects/758ef4f88b824b94b14eeec36cbee618 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:43:03.141684 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019e19f-18c2-42d5-a2d8-5a89606091d9 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:03.198301 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f4c33-5ece-4f3f-a78c-d26c6c76e91d None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:03.232975 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ceea1-3d64-4c5d-aebc-e6129d2c0168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:03.233697 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ceea1-3d64-4c5d-aebc-e6129d2c0168 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:03.234090 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ceea1-3d64-4c5d-aebc-e6129d2c0168 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:03.234410 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ceea1-3d64-4c5d-aebc-e6129d2c0168 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:03.235141 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ceea1-3d64-4c5d-aebc-e6129d2c0168 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:43:03.235471 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ceea1-3d64-4c5d-aebc-e6129d2c0168 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:03.236961 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ceea1-3d64-4c5d-aebc-e6129d2c0168 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:03.244649 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019e19f-18c2-42d5-a2d8-5a89606091d9 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:03.254317 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 555/1099] 10.222.0.52 () {56 vars in 1133 bytes} [Sun Aug 28 00:43:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:03.260253 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ceea1-3d64-4c5d-aebc-e6129d2c0168 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:03.280295 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7f9da-41ff-4adb-895d-6a5411e63cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:03.280892 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7f9da-41ff-4adb-895d-6a5411e63cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:03.281169 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7f9da-41ff-4adb-895d-6a5411e63cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:03.281439 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7f9da-41ff-4adb-895d-6a5411e63cb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:03.282211 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7f9da-41ff-4adb-895d-6a5411e63cb7 None admin] RBAC: Adding query filter params (role.id=cc013581bb07418d9ec6a3a1d282ea53, scope.project.id=758ef4f88b824b94b14eeec36cbee618, user.id=7da2162b11014f409121d65d8b12cd2c) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:43:03.282517 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7f9da-41ff-4adb-895d-6a5411e63cb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:03.284020 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7f9da-41ff-4adb-895d-6a5411e63cb7 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:03.289994 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 545/1100] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:43:03 2022] GET /identity/v3/role_assignments?user.id=7da2162b11014f409121d65d8b12cd2c&scope.project.id=758ef4f88b824b94b14eeec36cbee618&role.id=cc013581bb07418d9ec6a3a1d282ea53 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:43:03.363690 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:03.371344 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ceea1-3d64-4c5d-aebc-e6129d2c0168 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:03.410508 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e4138-2a37-44e1-9a9c-e3cbd76288b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:03.411148 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e4138-2a37-44e1-9a9c-e3cbd76288b0 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:03.411461 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e4138-2a37-44e1-9a9c-e3cbd76288b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:03.411771 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e4138-2a37-44e1-9a9c-e3cbd76288b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:03.481608 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e4138-2a37-44e1-9a9c-e3cbd76288b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:03.483198 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e4138-2a37-44e1-9a9c-e3cbd76288b0 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:03.578786 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:03.586925 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 556/1101] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:43:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 28 00:43:03.593098 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7f9da-41ff-4adb-895d-6a5411e63cb7 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:03.616123 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:03.694380 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7f9da-41ff-4adb-895d-6a5411e63cb7 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:03.728992 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada7a9b-fadd-4807-a4a1-5f96d80cdfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:03.729615 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada7a9b-fadd-4807-a4a1-5f96d80cdfe0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:03.729903 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada7a9b-fadd-4807-a4a1-5f96d80cdfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:03.730172 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada7a9b-fadd-4807-a4a1-5f96d80cdfe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:03.740926 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada7a9b-fadd-4807-a4a1-5f96d80cdfe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:03.742422 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada7a9b-fadd-4807-a4a1-5f96d80cdfe0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:03.756943 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-7ada7a9b-fadd-4807-a4a1-5f96d80cdfe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:43:03.756943 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:43:03.756943 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:43:03.756943 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:43:03.756943 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:43:03.756943 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:43:03.756943 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:43:03.756943 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:43:03.756943 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:43:03.756943 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:43:03.756943 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:43:03.756943 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:43:03.756943 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:43:03.756943 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:43:03.756943 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:43:03.756943 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:43:03.757991 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:43:03.757991 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:43:03.757991 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:43:03.757991 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:43:03.757991 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:43:03.757991 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:43:03.757991 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:43:03.757991 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:43:03.757991 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:43:03.757991 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:43:03.757991 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:43:03.757991 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:43:03.757991 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:43:03.757991 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:43:03.757991 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:43:03.757991 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:43:03.757991 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:43:03.759460 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:43:03.759460 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:43:03.759460 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:43:03.759460 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 546/1102] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:43:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:43:03.764272 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e4138-2a37-44e1-9a9c-e3cbd76288b0 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:03.872066 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e4138-2a37-44e1-9a9c-e3cbd76288b0 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:03.907214 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df46eb-567d-4842-8e20-a8386151b66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:03.907834 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df46eb-567d-4842-8e20-a8386151b66c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:03.908145 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df46eb-567d-4842-8e20-a8386151b66c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:03.908445 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df46eb-567d-4842-8e20-a8386151b66c None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:03.909109 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df46eb-567d-4842-8e20-a8386151b66c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:43:03.909440 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df46eb-567d-4842-8e20-a8386151b66c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:03.910865 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df46eb-567d-4842-8e20-a8386151b66c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:03.922835 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 557/1103] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:03.929036 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada7a9b-fadd-4807-a4a1-5f96d80cdfe0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:04.002628 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:04.033200 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada7a9b-fadd-4807-a4a1-5f96d80cdfe0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:04.069307 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75515407-70a1-4c50-bdfb-37170bfcb313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:04.069960 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75515407-70a1-4c50-bdfb-37170bfcb313 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:04.070239 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75515407-70a1-4c50-bdfb-37170bfcb313 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:04.070505 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75515407-70a1-4c50-bdfb-37170bfcb313 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:04.078012 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75515407-70a1-4c50-bdfb-37170bfcb313 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:04.079495 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75515407-70a1-4c50-bdfb-37170bfcb313 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:04.091129 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-75515407-70a1-4c50-bdfb-37170bfcb313 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:43:04.091129 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:43:04.091129 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:43:04.091129 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:43:04.091129 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:43:04.091129 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:43:04.091129 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:43:04.091129 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:43:04.091129 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:43:04.091129 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:43:04.091129 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:43:04.091129 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:43:04.091129 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:43:04.091129 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:43:04.091129 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:43:04.092348 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:43:04.092348 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:43:04.092348 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:43:04.092348 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:43:04.092348 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:43:04.092348 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:43:04.092348 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:43:04.092348 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:43:04.092348 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:43:04.092348 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:43:04.092348 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:43:04.092348 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:43:04.092348 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:43:04.092348 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:43:04.092348 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:43:04.092348 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:43:04.092348 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:43:04.093269 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:43:04.093269 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:43:04.093269 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:43:04.093269 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:43:04.093269 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:43:04.093269 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:43:04.093269 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:43:04.093269 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:43:04.093269 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 547/1104] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:43:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:43:04.099407 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df46eb-567d-4842-8e20-a8386151b66c None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:04.159817 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:04.208867 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df46eb-567d-4842-8e20-a8386151b66c None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:04.243671 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ccf10-4fdf-4f74-a82c-3aa840ab343a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:04.244270 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ccf10-4fdf-4f74-a82c-3aa840ab343a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:04.244548 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ccf10-4fdf-4f74-a82c-3aa840ab343a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:04.244824 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ccf10-4fdf-4f74-a82c-3aa840ab343a None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:04.245510 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ccf10-4fdf-4f74-a82c-3aa840ab343a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:43:04.245812 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ccf10-4fdf-4f74-a82c-3aa840ab343a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:04.247268 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ccf10-4fdf-4f74-a82c-3aa840ab343a None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:04.260064 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 558/1105] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:43:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:04.267099 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75515407-70a1-4c50-bdfb-37170bfcb313 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:04.372071 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75515407-70a1-4c50-bdfb-37170bfcb313 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:04.405027 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:04.411330 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7f2cf-aafd-409c-b044-3890f53760c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:04.411882 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7f2cf-aafd-409c-b044-3890f53760c0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:04.412147 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7f2cf-aafd-409c-b044-3890f53760c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:04.412418 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7f2cf-aafd-409c-b044-3890f53760c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:04.413156 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f7f2cf-aafd-409c-b044-3890f53760c0 None admin] RBAC: Adding query filter params (role.id=40e39507eac04ff6b770e29fce3b7e81, scope.project.id=45c69e3e973c449895457bb610103a43, user.id=f890ff4e7807477db7f17c2f6434dce8) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:43:04.413464 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f7f2cf-aafd-409c-b044-3890f53760c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:04.414958 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f7f2cf-aafd-409c-b044-3890f53760c0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:04.421288 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 548/1106] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:43:04 2022] GET /identity/v3/role_assignments?user.id=f890ff4e7807477db7f17c2f6434dce8&scope.project.id=45c69e3e973c449895457bb610103a43&role.id=40e39507eac04ff6b770e29fce3b7e81 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:05.215915 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffafd44-25c0-46a2-8a4d-223f6a2106b3 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:05.216618 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffafd44-25c0-46a2-8a4d-223f6a2106b3 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:05.216618 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffafd44-25c0-46a2-8a4d-223f6a2106b3 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:05.218076 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 559/1107] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:43:05.223854 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0c995-9d2f-41dd-ac9e-a8e5444047f6 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:05.224322 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0c995-9d2f-41dd-ac9e-a8e5444047f6 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:05.224502 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0c995-9d2f-41dd-ac9e-a8e5444047f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:05.252003 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c1b0c995-9d2f-41dd-ac9e-a8e5444047f6 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:43:05.253216 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c1b0c995-9d2f-41dd-ac9e-a8e5444047f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:43:05.340861 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 549/1108] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:43:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:43:05.607646 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffafd44-25c0-46a2-8a4d-223f6a2106b3 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:05.726657 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffafd44-25c0-46a2-8a4d-223f6a2106b3 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:05.740502 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:05.763843 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446e2ff-550b-405e-852d-96a89f0aa166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:05.764465 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446e2ff-550b-405e-852d-96a89f0aa166 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:05.764741 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446e2ff-550b-405e-852d-96a89f0aa166 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:05.765009 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446e2ff-550b-405e-852d-96a89f0aa166 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:05.766224 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446e2ff-550b-405e-852d-96a89f0aa166 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:05.767669 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446e2ff-550b-405e-852d-96a89f0aa166 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:05.769247 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 560/1109] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:43:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:05.778875 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0c995-9d2f-41dd-ac9e-a8e5444047f6 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:05.879709 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0c995-9d2f-41dd-ac9e-a8e5444047f6 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:05.909140 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:05.919415 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be628ad-7da1-4bd4-a536-b6248d9e7c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:05.920178 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be628ad-7da1-4bd4-a536-b6248d9e7c10 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:05.920459 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be628ad-7da1-4bd4-a536-b6248d9e7c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:05.920735 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be628ad-7da1-4bd4-a536-b6248d9e7c10 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:05.921371 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be628ad-7da1-4bd4-a536-b6248d9e7c10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:05.922853 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be628ad-7da1-4bd4-a536-b6248d9e7c10 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:05.945322 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 550/1110] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Aug 28 00:43:05 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:43:07.883424 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47927daa-7b55-4004-9530-1313e6f1dd81 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:07.883993 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47927daa-7b55-4004-9530-1313e6f1dd81 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:07.883993 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47927daa-7b55-4004-9530-1313e6f1dd81 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:07.885257 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 561/1111] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:43:07.891689 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c68c20-c248-4c85-9a18-44f5251925ac None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:07.892378 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c68c20-c248-4c85-9a18-44f5251925ac None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:07.892568 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c68c20-c248-4c85-9a18-44f5251925ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:07.921598 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-89c68c20-c248-4c85-9a18-44f5251925ac None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:43:07.922852 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-89c68c20-c248-4c85-9a18-44f5251925ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:43:07.992227 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 551/1112] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:43:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:43:08.271149 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47927daa-7b55-4004-9530-1313e6f1dd81 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:08.384848 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47927daa-7b55-4004-9530-1313e6f1dd81 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:08.423668 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43bd25-1033-4ca9-b32a-70c48bb0e99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:08.424286 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43bd25-1033-4ca9-b32a-70c48bb0e99b None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:08.424559 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43bd25-1033-4ca9-b32a-70c48bb0e99b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:08.424829 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43bd25-1033-4ca9-b32a-70c48bb0e99b None admin] PATH_INFO: `/v3/roles/258091cadd094ad2a608d396036e8869` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:08.426355 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43bd25-1033-4ca9-b32a-70c48bb0e99b None admin] RBAC: Authorizing `identity:get_role(role_id=258091cadd094ad2a608d396036e8869)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:08.427736 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43bd25-1033-4ca9-b32a-70c48bb0e99b None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:08.429066 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 562/1113] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:43:08 2022] GET /identity/v3/roles/258091cadd094ad2a608d396036e8869 => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:43:08.435505 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c68c20-c248-4c85-9a18-44f5251925ac None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:08.562645 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c68c20-c248-4c85-9a18-44f5251925ac None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:08.577523 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:08.610543 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45006a-af07-4bcb-a1f5-78d42ec5fdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:08.611181 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45006a-af07-4bcb-a1f5-78d42ec5fdf5 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:08.611452 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45006a-af07-4bcb-a1f5-78d42ec5fdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:08.611700 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45006a-af07-4bcb-a1f5-78d42ec5fdf5 None admin] PATH_INFO: `/v3/users/6d637e52c8c64186bfba6d765e777407` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:08.627858 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45006a-af07-4bcb-a1f5-78d42ec5fdf5 None admin] RBAC: Authorizing `identity:get_user(user_id=6d637e52c8c64186bfba6d765e777407)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:08.629330 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45006a-af07-4bcb-a1f5-78d42ec5fdf5 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:08.631793 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 552/1114] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:43:08 2022] GET /identity/v3/users/6d637e52c8c64186bfba6d765e777407 => generated 286 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:08.640284 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43bd25-1033-4ca9-b32a-70c48bb0e99b None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:08.701324 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:08.762061 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43bd25-1033-4ca9-b32a-70c48bb0e99b None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:08.805254 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8057c-c0ea-4979-813e-72fc9735dc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:08.805785 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8057c-c0ea-4979-813e-72fc9735dc94 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:08.806093 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8057c-c0ea-4979-813e-72fc9735dc94 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:08.806363 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8057c-c0ea-4979-813e-72fc9735dc94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:08.877311 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8057c-c0ea-4979-813e-72fc9735dc94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:08.878788 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8057c-c0ea-4979-813e-72fc9735dc94 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:08.932060 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:08.994273 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 563/1115] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:43:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:43:09.001649 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45006a-af07-4bcb-a1f5-78d42ec5fdf5 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:09.126523 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45006a-af07-4bcb-a1f5-78d42ec5fdf5 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:09.169080 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c4660-7570-4feb-b6fe-c1f1b07dbbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:09.169769 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c4660-7570-4feb-b6fe-c1f1b07dbbee None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:09.170133 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c4660-7570-4feb-b6fe-c1f1b07dbbee None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:09.170408 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c4660-7570-4feb-b6fe-c1f1b07dbbee None admin] PATH_INFO: `/v3/projects/758ef4f88b824b94b14eeec36cbee618` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:09.171549 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c4660-7570-4feb-b6fe-c1f1b07dbbee None admin] RBAC: Authorizing `identity:get_project(project_id=758ef4f88b824b94b14eeec36cbee618)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:09.173017 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c4660-7570-4feb-b6fe-c1f1b07dbbee None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:09.174688 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 553/1116] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:43:09 2022] GET /identity/v3/projects/758ef4f88b824b94b14eeec36cbee618 => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:09.180955 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8057c-c0ea-4979-813e-72fc9735dc94 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:09.289440 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8057c-c0ea-4979-813e-72fc9735dc94 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:09.332244 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead38e8c-0f37-45b4-a534-9477cb62ca7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:09.332837 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead38e8c-0f37-45b4-a534-9477cb62ca7a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:09.333113 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead38e8c-0f37-45b4-a534-9477cb62ca7a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:09.333419 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead38e8c-0f37-45b4-a534-9477cb62ca7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:09.334179 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead38e8c-0f37-45b4-a534-9477cb62ca7a None admin] RBAC: Adding query filter params (role.id=258091cadd094ad2a608d396036e8869, scope.project.id=758ef4f88b824b94b14eeec36cbee618, user.id=6d637e52c8c64186bfba6d765e777407) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:43:09.334484 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead38e8c-0f37-45b4-a534-9477cb62ca7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:09.335918 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead38e8c-0f37-45b4-a534-9477cb62ca7a None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:09.342577 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 564/1117] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:43:09 2022] GET /identity/v3/role_assignments?user.id=6d637e52c8c64186bfba6d765e777407&scope.project.id=758ef4f88b824b94b14eeec36cbee618&role.id=258091cadd094ad2a608d396036e8869 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:11.187404 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9af880-8811-454e-ae4c-da80344f4ef3 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:11.187960 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9af880-8811-454e-ae4c-da80344f4ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:11.187960 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9af880-8811-454e-ae4c-da80344f4ef3 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:11.189241 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 554/1118] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:43:11.198210 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cc24e-866e-49ee-93f5-5720a63391cd None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:11.198961 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cc24e-866e-49ee-93f5-5720a63391cd None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:11.199108 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cc24e-866e-49ee-93f5-5720a63391cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:11.219935 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-724cc24e-866e-49ee-93f5-5720a63391cd None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:43:11.221455 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-724cc24e-866e-49ee-93f5-5720a63391cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:43:11.231709 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:11.299778 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 565/1119] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:43:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:43:11.569348 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9af880-8811-454e-ae4c-da80344f4ef3 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:11.620409 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:11.702491 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9af880-8811-454e-ae4c-da80344f4ef3 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:11.737971 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c31e58-0d0a-4eac-a5b2-ac8f4ffeb294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:11.738584 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c31e58-0d0a-4eac-a5b2-ac8f4ffeb294 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:11.738862 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c31e58-0d0a-4eac-a5b2-ac8f4ffeb294 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:11.739118 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c31e58-0d0a-4eac-a5b2-ac8f4ffeb294 None admin] PATH_INFO: `/v3/roles/258091cadd094ad2a608d396036e8869` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:11.740614 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c31e58-0d0a-4eac-a5b2-ac8f4ffeb294 None admin] RBAC: Authorizing `identity:get_role(role_id=258091cadd094ad2a608d396036e8869)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:11.742015 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c31e58-0d0a-4eac-a5b2-ac8f4ffeb294 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:11.743362 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 555/1120] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:43:11 2022] GET /identity/v3/roles/258091cadd094ad2a608d396036e8869 => generated 223 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:11.750648 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724cc24e-866e-49ee-93f5-5720a63391cd None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:11.866547 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724cc24e-866e-49ee-93f5-5720a63391cd None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:11.901656 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877fe36-74e2-446c-bad1-1a7db90b1a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:11.902317 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877fe36-74e2-446c-bad1-1a7db90b1a17 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:11.902591 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877fe36-74e2-446c-bad1-1a7db90b1a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:11.902861 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877fe36-74e2-446c-bad1-1a7db90b1a17 None admin] PATH_INFO: `/v3/users/6d637e52c8c64186bfba6d765e777407` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:11.904120 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877fe36-74e2-446c-bad1-1a7db90b1a17 None admin] RBAC: Authorizing `identity:get_user(user_id=6d637e52c8c64186bfba6d765e777407)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:11.905562 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877fe36-74e2-446c-bad1-1a7db90b1a17 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:11.907178 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 566/1121] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:43:11 2022] GET /identity/v3/users/6d637e52c8c64186bfba6d765e777407 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:11.913754 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c31e58-0d0a-4eac-a5b2-ac8f4ffeb294 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:12.020273 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c31e58-0d0a-4eac-a5b2-ac8f4ffeb294 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:12.027442 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:12.056121 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52aca4-9a43-4b8c-85b9-98297ac8248e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:12.056728 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52aca4-9a43-4b8c-85b9-98297ac8248e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:12.056999 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52aca4-9a43-4b8c-85b9-98297ac8248e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:12.057269 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52aca4-9a43-4b8c-85b9-98297ac8248e None admin] PATH_INFO: `/v3/projects/758ef4f88b824b94b14eeec36cbee618` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:12.058497 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52aca4-9a43-4b8c-85b9-98297ac8248e None admin] RBAC: Authorizing `identity:get_project(project_id=758ef4f88b824b94b14eeec36cbee618)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:12.059931 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52aca4-9a43-4b8c-85b9-98297ac8248e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:12.061712 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 556/1122] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:43:11 2022] GET /identity/v3/projects/758ef4f88b824b94b14eeec36cbee618 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:12.067746 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877fe36-74e2-446c-bad1-1a7db90b1a17 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:12.082659 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:12.174835 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877fe36-74e2-446c-bad1-1a7db90b1a17 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:12.212007 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495065e-653a-493b-bbbf-06c79a4064b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:12.212626 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495065e-653a-493b-bbbf-06c79a4064b6 None admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:12.212922 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495065e-653a-493b-bbbf-06c79a4064b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:12.213194 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495065e-653a-493b-bbbf-06c79a4064b6 None admin] PATH_INFO: `/v3/projects/758ef4f88b824b94b14eeec36cbee618/users/6d637e52c8c64186bfba6d765e777407/roles/258091cadd094ad2a608d396036e8869` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:12.215412 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495065e-653a-493b-bbbf-06c79a4064b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=758ef4f88b824b94b14eeec36cbee618, user_id=6d637e52c8c64186bfba6d765e777407, role_id=258091cadd094ad2a608d396036e8869)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:12.216934 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495065e-653a-493b-bbbf-06c79a4064b6 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:12.230641 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 567/1123] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Aug 28 00:43:12 2022] PUT /identity/v3/projects/758ef4f88b824b94b14eeec36cbee618/users/6d637e52c8c64186bfba6d765e777407/roles/258091cadd094ad2a608d396036e8869 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:43:14.126621 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10b38d-edcb-4db5-bf81-fd687934d0c9 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:14.127197 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10b38d-edcb-4db5-bf81-fd687934d0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:14.127197 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10b38d-edcb-4db5-bf81-fd687934d0c9 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:14.129239 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 557/1124] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:43:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:43:14.138356 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302170d7-39d2-4ec4-ab53-1df99bc2e695 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:14.139018 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302170d7-39d2-4ec4-ab53-1df99bc2e695 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:14.139018 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302170d7-39d2-4ec4-ab53-1df99bc2e695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:14.159668 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-302170d7-39d2-4ec4-ab53-1df99bc2e695 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:43:14.160871 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-302170d7-39d2-4ec4-ab53-1df99bc2e695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:43:14.237149 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 568/1125] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:43:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:43:14.506797 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10b38d-edcb-4db5-bf81-fd687934d0c9 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:14.630461 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10b38d-edcb-4db5-bf81-fd687934d0c9 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:14.664653 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffad887-9b9a-4639-b912-df78fd43d3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:14.665261 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffad887-9b9a-4639-b912-df78fd43d3df None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:14.665531 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffad887-9b9a-4639-b912-df78fd43d3df None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:14.665824 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffad887-9b9a-4639-b912-df78fd43d3df None admin] PATH_INFO: `/v3/roles/258091cadd094ad2a608d396036e8869` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:14.667249 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffad887-9b9a-4639-b912-df78fd43d3df None admin] RBAC: Authorizing `identity:get_role(role_id=258091cadd094ad2a608d396036e8869)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:14.668621 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffad887-9b9a-4639-b912-df78fd43d3df None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:14.670068 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 558/1126] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:43:14 2022] GET /identity/v3/roles/258091cadd094ad2a608d396036e8869 => generated 223 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:14.676238 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302170d7-39d2-4ec4-ab53-1df99bc2e695 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:14.678515 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:14.792500 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302170d7-39d2-4ec4-ab53-1df99bc2e695 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:14.833181 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3e0b9-5ba0-4582-882c-7e75e3cce5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:14.833181 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3e0b9-5ba0-4582-882c-7e75e3cce5c0 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:14.833181 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3e0b9-5ba0-4582-882c-7e75e3cce5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:14.833538 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3e0b9-5ba0-4582-882c-7e75e3cce5c0 None admin] PATH_INFO: `/v3/users/6d637e52c8c64186bfba6d765e777407` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:14.834572 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3e0b9-5ba0-4582-882c-7e75e3cce5c0 None admin] RBAC: Authorizing `identity:get_user(user_id=6d637e52c8c64186bfba6d765e777407)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:14.836042 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3e0b9-5ba0-4582-882c-7e75e3cce5c0 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:14.837642 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 569/1127] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:43:14 2022] GET /identity/v3/users/6d637e52c8c64186bfba6d765e777407 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:14.844176 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffad887-9b9a-4639-b912-df78fd43d3df None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:14.891913 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:14.951873 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffad887-9b9a-4639-b912-df78fd43d3df None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:14.988596 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a05f13-abec-4082-bf90-d859023c44c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:14.989187 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a05f13-abec-4082-bf90-d859023c44c4 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:14.989465 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a05f13-abec-4082-bf90-d859023c44c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:14.989736 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a05f13-abec-4082-bf90-d859023c44c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:15.060569 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a05f13-abec-4082-bf90-d859023c44c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:15.062218 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a05f13-abec-4082-bf90-d859023c44c4 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:15.109536 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:15.170573 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 559/1128] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:43:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:43:15.179440 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3e0b9-5ba0-4582-882c-7e75e3cce5c0 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:15.255802 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:15.296872 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3e0b9-5ba0-4582-882c-7e75e3cce5c0 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:15.333034 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32962cc-6f40-470f-a4a0-c51107637680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:15.333579 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32962cc-6f40-470f-a4a0-c51107637680 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:15.333879 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32962cc-6f40-470f-a4a0-c51107637680 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:15.334146 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32962cc-6f40-470f-a4a0-c51107637680 None admin] PATH_INFO: `/v3/projects/758ef4f88b824b94b14eeec36cbee618` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:15.335295 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32962cc-6f40-470f-a4a0-c51107637680 None admin] RBAC: Authorizing `identity:get_project(project_id=758ef4f88b824b94b14eeec36cbee618)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:15.336728 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32962cc-6f40-470f-a4a0-c51107637680 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:15.338378 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 570/1129] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:43:15 2022] GET /identity/v3/projects/758ef4f88b824b94b14eeec36cbee618 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:43:15.349221 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a05f13-abec-4082-bf90-d859023c44c4 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:15.462600 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a05f13-abec-4082-bf90-d859023c44c4 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:15.498537 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63cc3c-5649-4e1a-82b6-e8ea9cd31b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:15.499119 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63cc3c-5649-4e1a-82b6-e8ea9cd31b2a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:15.499370 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63cc3c-5649-4e1a-82b6-e8ea9cd31b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:15.499745 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63cc3c-5649-4e1a-82b6-e8ea9cd31b2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:15.500466 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c63cc3c-5649-4e1a-82b6-e8ea9cd31b2a None admin] RBAC: Adding query filter params (role.id=258091cadd094ad2a608d396036e8869, scope.project.id=758ef4f88b824b94b14eeec36cbee618, user.id=6d637e52c8c64186bfba6d765e777407) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:43:15.500771 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c63cc3c-5649-4e1a-82b6-e8ea9cd31b2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:15.502236 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c63cc3c-5649-4e1a-82b6-e8ea9cd31b2a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:15.510743 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 560/1130] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:43:15 2022] GET /identity/v3/role_assignments?user.id=6d637e52c8c64186bfba6d765e777407&scope.project.id=758ef4f88b824b94b14eeec36cbee618&role.id=258091cadd094ad2a608d396036e8869 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:17.422255 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9373a5-33a8-4975-b003-66653d4110b3 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:17.422842 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9373a5-33a8-4975-b003-66653d4110b3 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:17.422842 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9373a5-33a8-4975-b003-66653d4110b3 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:17.424151 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 571/1131] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:43:17.430784 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cecd6-f76d-4598-96ea-bd8828347b21 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:17.431520 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cecd6-f76d-4598-96ea-bd8828347b21 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:17.431679 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cecd6-f76d-4598-96ea-bd8828347b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:17.446893 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:17.455469 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-844cecd6-f76d-4598-96ea-bd8828347b21 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:43:17.457293 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-844cecd6-f76d-4598-96ea-bd8828347b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:43:17.539549 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 561/1132] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:43:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:43:17.806749 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9373a5-33a8-4975-b003-66653d4110b3 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:17.925129 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9373a5-33a8-4975-b003-66653d4110b3 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:17.961333 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14cd51-b994-4d07-9801-a89b7b28d052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:17.961970 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14cd51-b994-4d07-9801-a89b7b28d052 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:17.962248 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14cd51-b994-4d07-9801-a89b7b28d052 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:17.962516 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14cd51-b994-4d07-9801-a89b7b28d052 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:17.963783 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14cd51-b994-4d07-9801-a89b7b28d052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:17.965213 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14cd51-b994-4d07-9801-a89b7b28d052 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:17.966878 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 572/1133] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:43:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:17.974213 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cecd6-f76d-4598-96ea-bd8828347b21 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:18.092513 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cecd6-f76d-4598-96ea-bd8828347b21 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:18.128147 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46425679-89ee-43f9-8b46-f1bb92702a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:18.128750 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46425679-89ee-43f9-8b46-f1bb92702a0a None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:18.129024 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46425679-89ee-43f9-8b46-f1bb92702a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:18.129297 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46425679-89ee-43f9-8b46-f1bb92702a0a None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:18.129969 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46425679-89ee-43f9-8b46-f1bb92702a0a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:18.131424 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46425679-89ee-43f9-8b46-f1bb92702a0a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:18.137191 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:18.161363 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 562/1134] 10.222.0.52 () {60 vars in 1141 bytes} [Sun Aug 28 00:43:17 2022] POST /identity/v3/projects => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:43:20.104925 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c37344-7dbf-47a4-8d4f-b49f8b1b4ad1 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:20.105913 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c37344-7dbf-47a4-8d4f-b49f8b1b4ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:20.105913 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c37344-7dbf-47a4-8d4f-b49f8b1b4ad1 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:20.107882 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 573/1135] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:43:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:43:20.113333 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43270d9-7750-4f2a-b269-1e42a932c4fa None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:20.113790 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43270d9-7750-4f2a-b269-1e42a932c4fa None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:20.113915 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43270d9-7750-4f2a-b269-1e42a932c4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:20.133575 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a43270d9-7750-4f2a-b269-1e42a932c4fa None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:43:20.134777 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a43270d9-7750-4f2a-b269-1e42a932c4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:43:20.203476 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 563/1136] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:43:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:43:20.465239 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c37344-7dbf-47a4-8d4f-b49f8b1b4ad1 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:20.479261 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:20.596426 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c37344-7dbf-47a4-8d4f-b49f8b1b4ad1 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:20.640569 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3bf7b-044d-44c4-8112-6cd6080f7860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:20.641342 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3bf7b-044d-44c4-8112-6cd6080f7860 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:20.641505 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3bf7b-044d-44c4-8112-6cd6080f7860 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:20.641737 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3bf7b-044d-44c4-8112-6cd6080f7860 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:20.642994 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a3bf7b-044d-44c4-8112-6cd6080f7860 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:20.644430 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a3bf7b-044d-44c4-8112-6cd6080f7860 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:20.646020 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 574/1137] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:43:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:20.652113 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43270d9-7750-4f2a-b269-1e42a932c4fa None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:20.761681 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43270d9-7750-4f2a-b269-1e42a932c4fa None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:20.786804 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:20.806845 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb86f83-90c3-420e-95a6-c7475906fdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:20.807441 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb86f83-90c3-420e-95a6-c7475906fdf5 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:20.807710 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb86f83-90c3-420e-95a6-c7475906fdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:20.807973 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb86f83-90c3-420e-95a6-c7475906fdf5 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:20.808614 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb86f83-90c3-420e-95a6-c7475906fdf5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:20.810108 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb86f83-90c3-420e-95a6-c7475906fdf5 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:20.835187 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 564/1138] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Aug 28 00:43:20 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:43:22.765673 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bac876-fe95-4b9e-9ccc-6c1d9db61582 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:22.766412 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bac876-fe95-4b9e-9ccc-6c1d9db61582 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:22.766412 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bac876-fe95-4b9e-9ccc-6c1d9db61582 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:22.767597 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 575/1139] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:43:22.773070 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283f899-8f6e-4831-90c2-26cfff1fae68 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:22.773512 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283f899-8f6e-4831-90c2-26cfff1fae68 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:22.773697 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283f899-8f6e-4831-90c2-26cfff1fae68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:22.793723 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e283f899-8f6e-4831-90c2-26cfff1fae68 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:43:22.794908 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e283f899-8f6e-4831-90c2-26cfff1fae68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:43:22.867581 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 565/1140] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:43:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:43:23.134794 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bac876-fe95-4b9e-9ccc-6c1d9db61582 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:23.218317 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:23.250956 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bac876-fe95-4b9e-9ccc-6c1d9db61582 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:23.286992 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1963600-0080-48e6-9821-a358453b4bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:23.287636 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1963600-0080-48e6-9821-a358453b4bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:23.287911 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1963600-0080-48e6-9821-a358453b4bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:23.288180 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1963600-0080-48e6-9821-a358453b4bc6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:23.299362 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1963600-0080-48e6-9821-a358453b4bc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:43:23.304231 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-d1963600-0080-48e6-9821-a358453b4bc6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:43:23.304231 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:43:23.304231 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:43:23.304231 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:43:23.304231 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:43:23.304231 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:43:23.304231 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:43:23.304231 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:43:23.304231 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:43:23.304231 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:43:23.304231 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:43:23.304231 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:43:23.304231 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:43:23.304231 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:43:23.304231 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:43:23.304231 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:43:23.305411 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:43:23.305411 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:43:23.305411 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:43:23.305411 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:43:23.305411 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:43:23.305411 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:43:23.305411 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:43:23.305411 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:43:23.305411 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:43:23.305411 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:43:23.305411 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:43:23.305411 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:43:23.305411 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:43:23.305411 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:43:23.305411 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:43:23.305411 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:43:23.306519 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:43:23.306519 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:43:23.306519 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:43:23.306519 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:43:23.306519 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:43:23.306519 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:43:23.306519 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:43:23.306519 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:43:23.306519 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:43:23.306519 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:43:23.306519 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:43:23.306519 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:43:23.306519 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 576/1141] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:43:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:43:23.311739 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283f899-8f6e-4831-90c2-26cfff1fae68 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:23.413717 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283f899-8f6e-4831-90c2-26cfff1fae68 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:23.416003 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:23.457327 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ad366-0c7e-4e6f-826e-b2cb751df439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:23.457935 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ad366-0c7e-4e6f-826e-b2cb751df439 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:23.458223 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ad366-0c7e-4e6f-826e-b2cb751df439 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:23.458486 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ad366-0c7e-4e6f-826e-b2cb751df439 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:23.459148 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ad366-0c7e-4e6f-826e-b2cb751df439 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:43:23.459443 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ad366-0c7e-4e6f-826e-b2cb751df439 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:23.460825 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ad366-0c7e-4e6f-826e-b2cb751df439 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:23.468835 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 566/1142] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:43:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:23.475212 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1963600-0080-48e6-9821-a358453b4bc6 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:23.586201 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1963600-0080-48e6-9821-a358453b4bc6 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:23.626865 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e851d-80df-49ed-b9df-280128648cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:23.627780 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e851d-80df-49ed-b9df-280128648cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:23.628209 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e851d-80df-49ed-b9df-280128648cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:23.628640 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e851d-80df-49ed-b9df-280128648cd6 None admin] PATH_INFO: `/v3/users/9d302f93a24b4175b8cf3b9116459fde` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:23.631718 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:23.646828 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e851d-80df-49ed-b9df-280128648cd6 None admin] RBAC: Authorizing `identity:get_user(user_id=9d302f93a24b4175b8cf3b9116459fde)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:23.648281 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e851d-80df-49ed-b9df-280128648cd6 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:23.649939 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 577/1143] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:43:23 2022] GET /identity/v3/users/9d302f93a24b4175b8cf3b9116459fde => generated 286 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:23.656283 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ad366-0c7e-4e6f-826e-b2cb751df439 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:23.759823 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ad366-0c7e-4e6f-826e-b2cb751df439 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:23.804962 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47d887-cca8-4d18-bce9-b6a56d7d10e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:23.805544 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47d887-cca8-4d18-bce9-b6a56d7d10e8 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:23.805823 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47d887-cca8-4d18-bce9-b6a56d7d10e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:23.806127 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47d887-cca8-4d18-bce9-b6a56d7d10e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:23.841788 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:23.877816 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c47d887-cca8-4d18-bce9-b6a56d7d10e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:23.879466 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c47d887-cca8-4d18-bce9-b6a56d7d10e8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:23.987037 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 567/1144] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:43:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:43:23.993732 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e851d-80df-49ed-b9df-280128648cd6 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:24.104614 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e851d-80df-49ed-b9df-280128648cd6 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:24.140273 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d2617-2d7e-463d-ac4e-d0a89f8fc530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:24.140879 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d2617-2d7e-463d-ac4e-d0a89f8fc530 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:24.141153 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d2617-2d7e-463d-ac4e-d0a89f8fc530 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:24.141420 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d2617-2d7e-463d-ac4e-d0a89f8fc530 None admin] PATH_INFO: `/v3/projects/eb49d196f81142b18156313554497c0b` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:24.142632 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d2617-2d7e-463d-ac4e-d0a89f8fc530 None admin] RBAC: Authorizing `identity:get_project(project_id=eb49d196f81142b18156313554497c0b)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:24.144074 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d2617-2d7e-463d-ac4e-d0a89f8fc530 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:24.145686 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 578/1145] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:43:23 2022] GET /identity/v3/projects/eb49d196f81142b18156313554497c0b => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:24.152064 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47d887-cca8-4d18-bce9-b6a56d7d10e8 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:24.227690 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:24.270953 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47d887-cca8-4d18-bce9-b6a56d7d10e8 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:24.303990 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a67c8c-82ca-444a-8714-04b311a0f0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:24.304592 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a67c8c-82ca-444a-8714-04b311a0f0d9 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:24.304869 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a67c8c-82ca-444a-8714-04b311a0f0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:24.305145 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a67c8c-82ca-444a-8714-04b311a0f0d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:24.305883 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a67c8c-82ca-444a-8714-04b311a0f0d9 None admin] RBAC: Adding query filter params (role.id=cc013581bb07418d9ec6a3a1d282ea53, scope.project.id=eb49d196f81142b18156313554497c0b, user.id=9d302f93a24b4175b8cf3b9116459fde) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:43:24.306209 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a67c8c-82ca-444a-8714-04b311a0f0d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:24.307648 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a67c8c-82ca-444a-8714-04b311a0f0d9 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:24.313143 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 568/1146] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:43:24 2022] GET /identity/v3/role_assignments?user.id=9d302f93a24b4175b8cf3b9116459fde&scope.project.id=eb49d196f81142b18156313554497c0b&role.id=cc013581bb07418d9ec6a3a1d282ea53 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:26.179376 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98254d-2e43-4916-b10b-55c29d9141f1 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:26.179938 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98254d-2e43-4916-b10b-55c29d9141f1 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:26.179938 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98254d-2e43-4916-b10b-55c29d9141f1 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:26.181260 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 579/1147] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:43:26.188242 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714cc6b-fd63-44da-832d-5ec484eb66f0 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:26.188962 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714cc6b-fd63-44da-832d-5ec484eb66f0 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:26.189104 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714cc6b-fd63-44da-832d-5ec484eb66f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:26.214377 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-d714cc6b-fd63-44da-832d-5ec484eb66f0 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:43:26.215574 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d714cc6b-fd63-44da-832d-5ec484eb66f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:43:26.291059 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 569/1148] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:43:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:43:26.570105 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98254d-2e43-4916-b10b-55c29d9141f1 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:26.639214 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:26.682475 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98254d-2e43-4916-b10b-55c29d9141f1 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:26.718629 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb373b1-7cef-4c35-8a6a-5fbfedfb8af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:26.719260 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb373b1-7cef-4c35-8a6a-5fbfedfb8af5 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:26.719524 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb373b1-7cef-4c35-8a6a-5fbfedfb8af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:26.719801 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb373b1-7cef-4c35-8a6a-5fbfedfb8af5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:26.730933 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb373b1-7cef-4c35-8a6a-5fbfedfb8af5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:43:26.736009 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-feb373b1-7cef-4c35-8a6a-5fbfedfb8af5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:43:26.736009 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:43:26.736009 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:43:26.736009 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:43:26.736009 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:43:26.736009 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:43:26.736009 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:43:26.736009 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:43:26.736009 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:43:26.736009 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:43:26.736009 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:43:26.736009 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:43:26.736009 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:43:26.736009 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:43:26.736009 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:43:26.736009 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:43:26.737082 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:43:26.737082 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:43:26.737082 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:43:26.737082 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:43:26.737082 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:43:26.737082 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:43:26.737082 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:43:26.737082 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:43:26.737082 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:43:26.737082 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:43:26.737082 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:43:26.737082 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:43:26.737082 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:43:26.737082 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:43:26.737082 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:43:26.737082 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:43:26.738348 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:43:26.738348 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:43:26.738348 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:43:26.738348 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:43:26.738348 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:43:26.738348 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:43:26.738348 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:43:26.738348 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:43:26.738348 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:43:26.738348 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:43:26.738348 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:43:26.738348 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:43:26.738348 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 580/1149] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:43:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:43:26.743332 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714cc6b-fd63-44da-832d-5ec484eb66f0 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:26.806841 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:26.851214 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714cc6b-fd63-44da-832d-5ec484eb66f0 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:26.887077 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10df76-f392-4353-baba-4a318e21a5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:26.887665 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10df76-f392-4353-baba-4a318e21a5b2 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:26.887937 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10df76-f392-4353-baba-4a318e21a5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:26.888200 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10df76-f392-4353-baba-4a318e21a5b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:26.889012 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10df76-f392-4353-baba-4a318e21a5b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:43:26.889311 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10df76-f392-4353-baba-4a318e21a5b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:26.890727 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10df76-f392-4353-baba-4a318e21a5b2 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:26.898711 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 570/1150] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:43:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:26.904957 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb373b1-7cef-4c35-8a6a-5fbfedfb8af5 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:27.019747 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb373b1-7cef-4c35-8a6a-5fbfedfb8af5 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:27.039565 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:27.056116 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5be176-1337-44b0-9c73-9f2f85a91848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:27.056737 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5be176-1337-44b0-9c73-9f2f85a91848 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:27.057073 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5be176-1337-44b0-9c73-9f2f85a91848 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:27.057256 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5be176-1337-44b0-9c73-9f2f85a91848 None admin] PATH_INFO: `/v3/users/9d302f93a24b4175b8cf3b9116459fde` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:27.058492 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5be176-1337-44b0-9c73-9f2f85a91848 None admin] RBAC: Authorizing `identity:get_user(user_id=9d302f93a24b4175b8cf3b9116459fde)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:27.059968 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5be176-1337-44b0-9c73-9f2f85a91848 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:27.061749 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 581/1151] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:43:26 2022] GET /identity/v3/users/9d302f93a24b4175b8cf3b9116459fde => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:27.068355 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10df76-f392-4353-baba-4a318e21a5b2 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:27.193653 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10df76-f392-4353-baba-4a318e21a5b2 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:27.216479 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:27.231597 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e77e88-f45b-4d7d-a9bb-4623341346f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:27.232229 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e77e88-f45b-4d7d-a9bb-4623341346f4 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:27.232532 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e77e88-f45b-4d7d-a9bb-4623341346f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:27.232797 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e77e88-f45b-4d7d-a9bb-4623341346f4 None admin] PATH_INFO: `/v3/projects/eb49d196f81142b18156313554497c0b` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:27.234080 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e77e88-f45b-4d7d-a9bb-4623341346f4 None admin] RBAC: Authorizing `identity:get_project(project_id=eb49d196f81142b18156313554497c0b)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:27.235545 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e77e88-f45b-4d7d-a9bb-4623341346f4 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:27.237188 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 571/1152] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:43:27 2022] GET /identity/v3/projects/eb49d196f81142b18156313554497c0b => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:27.244201 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5be176-1337-44b0-9c73-9f2f85a91848 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:27.349580 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5be176-1337-44b0-9c73-9f2f85a91848 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:27.384513 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdcef0-004d-4ae3-adc9-5fad11ad0133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:27.385156 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdcef0-004d-4ae3-adc9-5fad11ad0133 None admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:27.385434 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdcef0-004d-4ae3-adc9-5fad11ad0133 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:27.385705 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdcef0-004d-4ae3-adc9-5fad11ad0133 None admin] PATH_INFO: `/v3/projects/eb49d196f81142b18156313554497c0b/users/9d302f93a24b4175b8cf3b9116459fde/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:27.387742 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cdcef0-004d-4ae3-adc9-5fad11ad0133 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb49d196f81142b18156313554497c0b, user_id=9d302f93a24b4175b8cf3b9116459fde, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:27.389403 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cdcef0-004d-4ae3-adc9-5fad11ad0133 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:27.407583 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 582/1153] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Aug 28 00:43:27 2022] PUT /identity/v3/projects/eb49d196f81142b18156313554497c0b/users/9d302f93a24b4175b8cf3b9116459fde/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:43:29.269624 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40923b-2000-4721-92f7-522e7400fc51 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:29.270264 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40923b-2000-4721-92f7-522e7400fc51 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:29.270264 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40923b-2000-4721-92f7-522e7400fc51 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:29.271541 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 572/1154] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:43:29.280586 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa3680-2f22-4dda-99cc-d47cea61f6cd None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:29.281288 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa3680-2f22-4dda-99cc-d47cea61f6cd None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:29.281496 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa3680-2f22-4dda-99cc-d47cea61f6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:29.301206 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-e9aa3680-2f22-4dda-99cc-d47cea61f6cd None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:43:29.302437 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e9aa3680-2f22-4dda-99cc-d47cea61f6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:43:29.348852 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:29.382088 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 583/1155] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:43:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:43:29.650276 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40923b-2000-4721-92f7-522e7400fc51 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:29.772598 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40923b-2000-4721-92f7-522e7400fc51 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:29.810099 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70cbda0-107f-4d96-a612-9a30e82f64ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:29.810786 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cbda0-107f-4d96-a612-9a30e82f64ac None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:29.810921 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cbda0-107f-4d96-a612-9a30e82f64ac None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:29.811208 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cbda0-107f-4d96-a612-9a30e82f64ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:29.821880 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70cbda0-107f-4d96-a612-9a30e82f64ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:43:29.826773 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-f70cbda0-107f-4d96-a612-9a30e82f64ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:43:29.826773 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:43:29.826773 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:43:29.826773 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:43:29.826773 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:43:29.826773 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:43:29.826773 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:43:29.826773 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:43:29.826773 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:43:29.826773 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:43:29.826773 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:43:29.826773 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:43:29.826773 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:43:29.826773 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:43:29.826773 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:43:29.826773 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:43:29.827824 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:43:29.827824 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:43:29.827824 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:43:29.827824 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:43:29.827824 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:43:29.827824 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:43:29.827824 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:43:29.827824 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:43:29.827824 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:43:29.827824 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:43:29.827824 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:43:29.827824 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:43:29.827824 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:43:29.827824 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:43:29.827824 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:43:29.827824 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:43:29.829033 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:43:29.829033 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:43:29.829033 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:43:29.829033 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:43:29.829033 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:43:29.829033 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:43:29.829033 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:43:29.829033 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:43:29.829033 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:43:29.829033 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:43:29.829033 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:43:29.829033 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:43:29.829033 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 573/1156] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:43:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:43:29.837136 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa3680-2f22-4dda-99cc-d47cea61f6cd None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:29.950555 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa3680-2f22-4dda-99cc-d47cea61f6cd None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:29.986840 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5627809-ea24-4cda-a671-418439fb2eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:29.987447 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5627809-ea24-4cda-a671-418439fb2eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:29.987727 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5627809-ea24-4cda-a671-418439fb2eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:29.987999 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5627809-ea24-4cda-a671-418439fb2eb9 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:29.988678 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5627809-ea24-4cda-a671-418439fb2eb9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:43:29.988984 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5627809-ea24-4cda-a671-418439fb2eb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:29.990415 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5627809-ea24-4cda-a671-418439fb2eb9 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:29.999106 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 584/1157] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:43:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:30.005747 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70cbda0-107f-4d96-a612-9a30e82f64ac None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:30.072700 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:30.123071 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70cbda0-107f-4d96-a612-9a30e82f64ac None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:30.158552 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55379556-1941-4caf-8380-27e893e3d943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:30.159159 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55379556-1941-4caf-8380-27e893e3d943 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:30.159431 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55379556-1941-4caf-8380-27e893e3d943 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:30.159694 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55379556-1941-4caf-8380-27e893e3d943 None admin] PATH_INFO: `/v3/users/9d302f93a24b4175b8cf3b9116459fde` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:30.160938 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55379556-1941-4caf-8380-27e893e3d943 None admin] RBAC: Authorizing `identity:get_user(user_id=9d302f93a24b4175b8cf3b9116459fde)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:30.162422 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55379556-1941-4caf-8380-27e893e3d943 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:30.163994 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 574/1158] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:43:30 2022] GET /identity/v3/users/9d302f93a24b4175b8cf3b9116459fde => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:30.170243 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5627809-ea24-4cda-a671-418439fb2eb9 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:30.216767 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:30.278421 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5627809-ea24-4cda-a671-418439fb2eb9 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:30.315068 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8cf02-a903-44a3-91a1-f1c61c29d930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:30.315653 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8cf02-a903-44a3-91a1-f1c61c29d930 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:30.315923 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8cf02-a903-44a3-91a1-f1c61c29d930 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:30.316191 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8cf02-a903-44a3-91a1-f1c61c29d930 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:30.384895 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8cf02-a903-44a3-91a1-f1c61c29d930 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:30.386324 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8cf02-a903-44a3-91a1-f1c61c29d930 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:30.429672 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:30.508191 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 585/1159] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:43:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:43:30.514672 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55379556-1941-4caf-8380-27e893e3d943 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:30.623911 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55379556-1941-4caf-8380-27e893e3d943 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:30.643050 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:30.661821 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf1eb7-8554-4fa1-9507-4f4467a1f624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:30.662471 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf1eb7-8554-4fa1-9507-4f4467a1f624 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:30.662748 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf1eb7-8554-4fa1-9507-4f4467a1f624 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:30.663014 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf1eb7-8554-4fa1-9507-4f4467a1f624 None admin] PATH_INFO: `/v3/projects/eb49d196f81142b18156313554497c0b` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:30.664168 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf1eb7-8554-4fa1-9507-4f4467a1f624 None admin] RBAC: Authorizing `identity:get_project(project_id=eb49d196f81142b18156313554497c0b)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:30.665628 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf1eb7-8554-4fa1-9507-4f4467a1f624 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:30.667294 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 575/1160] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:43:30 2022] GET /identity/v3/projects/eb49d196f81142b18156313554497c0b => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:30.673773 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8cf02-a903-44a3-91a1-f1c61c29d930 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:30.774492 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8cf02-a903-44a3-91a1-f1c61c29d930 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:30.809900 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7233ea-2945-4076-9db1-d34a88744fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:30.810550 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7233ea-2945-4076-9db1-d34a88744fae None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:30.810848 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7233ea-2945-4076-9db1-d34a88744fae None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:30.811116 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7233ea-2945-4076-9db1-d34a88744fae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:30.811846 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7233ea-2945-4076-9db1-d34a88744fae None admin] RBAC: Adding query filter params (role.id=cc013581bb07418d9ec6a3a1d282ea53, scope.project.id=eb49d196f81142b18156313554497c0b, user.id=9d302f93a24b4175b8cf3b9116459fde) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:43:30.812148 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7233ea-2945-4076-9db1-d34a88744fae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:30.813585 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7233ea-2945-4076-9db1-d34a88744fae None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:30.819449 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 586/1161] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:43:30 2022] GET /identity/v3/role_assignments?user.id=9d302f93a24b4175b8cf3b9116459fde&scope.project.id=eb49d196f81142b18156313554497c0b&role.id=cc013581bb07418d9ec6a3a1d282ea53 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:32.735226 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad770470-cf53-4928-bd31-3bd040925c14 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:32.735782 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad770470-cf53-4928-bd31-3bd040925c14 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:32.735782 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad770470-cf53-4928-bd31-3bd040925c14 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:32.737120 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 576/1162] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:43:32.743494 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889a485-e57f-45eb-a571-4ff53a25a606 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:32.744181 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889a485-e57f-45eb-a571-4ff53a25a606 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:32.744356 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889a485-e57f-45eb-a571-4ff53a25a606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:32.756858 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:32.770746 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-c889a485-e57f-45eb-a571-4ff53a25a606 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:43:32.771930 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c889a485-e57f-45eb-a571-4ff53a25a606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:43:32.841593 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 587/1163] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:43:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:43:33.106823 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad770470-cf53-4928-bd31-3bd040925c14 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:33.222080 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad770470-cf53-4928-bd31-3bd040925c14 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:33.258957 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c6020-d27a-476b-82e4-842bb713d55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:33.259559 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c6020-d27a-476b-82e4-842bb713d55f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:33.259880 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c6020-d27a-476b-82e4-842bb713d55f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:33.260194 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c6020-d27a-476b-82e4-842bb713d55f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:33.325829 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:33.340819 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c6020-d27a-476b-82e4-842bb713d55f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:33.342511 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c6020-d27a-476b-82e4-842bb713d55f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:33.440627 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 577/1164] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:43:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:43:33.449343 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889a485-e57f-45eb-a571-4ff53a25a606 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:33.562128 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889a485-e57f-45eb-a571-4ff53a25a606 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:33.599891 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38282da-1c0e-43d5-8f52-86064593156f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:33.600513 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38282da-1c0e-43d5-8f52-86064593156f None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:33.600756 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38282da-1c0e-43d5-8f52-86064593156f None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:33.601050 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38282da-1c0e-43d5-8f52-86064593156f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:33.603261 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:33.609178 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38282da-1c0e-43d5-8f52-86064593156f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:33.610946 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38282da-1c0e-43d5-8f52-86064593156f None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:33.622799 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-e38282da-1c0e-43d5-8f52-86064593156f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 28 00:43:33.622799 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:43:33.622799 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 00:43:33.622799 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 00:43:33.622799 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:43:33.622799 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:43:33.622799 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:43:33.622799 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:43:33.622799 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 28 00:43:33.622799 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:43:33.622799 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:43:33.622799 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:43:33.622799 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:43:33.622799 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:43:33.622799 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:43:33.622799 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:43:33.622799 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:43:33.624335 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:43:33.624335 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:43:33.624335 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:43:33.624335 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:43:33.624335 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:43:33.624335 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:43:33.624335 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:43:33.624335 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:43:33.624335 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:43:33.624335 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:43:33.624335 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:43:33.624335 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:43:33.624335 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:43:33.624335 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:43:33.624335 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:43:33.624335 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:43:33.625279 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:43:33.625279 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:43:33.625279 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:43:33.625279 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:43:33.625279 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:43:33.625279 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:43:33.625279 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:43:33.625279 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:43:33.625279 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:43:33.625279 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:43:33.625279 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 00:43:33.625279 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:43:33.625279 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 28 00:43:33.625279 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:43:33.625279 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 588/1165] 10.222.0.52 () {56 vars in 1117 bytes} [Sun Aug 28 00:43:33 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:43:33.630577 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c6020-d27a-476b-82e4-842bb713d55f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:33.715662 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:33.734205 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c6020-d27a-476b-82e4-842bb713d55f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:33.773340 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcd3c6-f88f-48cf-acf2-0de6485a7409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:33.773969 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcd3c6-f88f-48cf-acf2-0de6485a7409 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:33.774229 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcd3c6-f88f-48cf-acf2-0de6485a7409 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:33.774498 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcd3c6-f88f-48cf-acf2-0de6485a7409 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:33.775141 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbcd3c6-f88f-48cf-acf2-0de6485a7409 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:43:33.775442 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbcd3c6-f88f-48cf-acf2-0de6485a7409 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:33.776840 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbcd3c6-f88f-48cf-acf2-0de6485a7409 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:33.784363 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 578/1166] 10.222.0.52 () {56 vars in 1115 bytes} [Sun Aug 28 00:43:33 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:35.652566 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1d219-9886-4664-b22d-86bff6b23943 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:35.653445 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1d219-9886-4664-b22d-86bff6b23943 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:35.653445 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1d219-9886-4664-b22d-86bff6b23943 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:35.655701 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 589/1167] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:43:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:43:35.662670 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe98fe-67da-4c2e-8d18-26de31f8cdb7 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:35.663394 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe98fe-67da-4c2e-8d18-26de31f8cdb7 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:35.663580 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe98fe-67da-4c2e-8d18-26de31f8cdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:35.686159 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-49fe98fe-67da-4c2e-8d18-26de31f8cdb7 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:43:35.687355 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-49fe98fe-67da-4c2e-8d18-26de31f8cdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:43:35.764509 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 579/1168] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:43:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:43:36.043164 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1d219-9886-4664-b22d-86bff6b23943 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:36.155875 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1d219-9886-4664-b22d-86bff6b23943 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:36.193699 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda42de8-ed9c-44e2-a418-0ac73581335c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:36.194320 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda42de8-ed9c-44e2-a418-0ac73581335c None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:36.194601 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda42de8-ed9c-44e2-a418-0ac73581335c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:36.194874 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda42de8-ed9c-44e2-a418-0ac73581335c None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:36.195541 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda42de8-ed9c-44e2-a418-0ac73581335c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:36.196915 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda42de8-ed9c-44e2-a418-0ac73581335c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:36.215950 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 590/1169] 10.222.0.52 () {60 vars in 1138 bytes} [Sun Aug 28 00:43:36 2022] POST /identity/v3/domains => generated 267 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:43:38.160711 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef764b-d1c8-486b-87d4-fa5da90b62a3 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:38.161257 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef764b-d1c8-486b-87d4-fa5da90b62a3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:38.161257 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef764b-d1c8-486b-87d4-fa5da90b62a3 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:38.163375 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 580/1170] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:43:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:43:38.172158 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385c761-2bd9-49b1-bf6f-fcab83deced6 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:38.172561 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385c761-2bd9-49b1-bf6f-fcab83deced6 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:38.172742 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385c761-2bd9-49b1-bf6f-fcab83deced6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:38.201904 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-9385c761-2bd9-49b1-bf6f-fcab83deced6 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:43:38.203101 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9385c761-2bd9-49b1-bf6f-fcab83deced6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:43:38.261032 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:38.281541 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 591/1171] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:43:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:43:38.557298 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef764b-d1c8-486b-87d4-fa5da90b62a3 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:38.657089 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:38.683154 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef764b-d1c8-486b-87d4-fa5da90b62a3 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:38.731952 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fa017-4994-48a0-9bf6-c9c13c4f7af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:38.732871 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fa017-4994-48a0-9bf6-c9c13c4f7af1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:38.733136 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fa017-4994-48a0-9bf6-c9c13c4f7af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:38.733503 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fa017-4994-48a0-9bf6-c9c13c4f7af1 None admin] PATH_INFO: `/v3/domains/84d42f0e8aa54a4fbbe3dcda0aea98ef` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:38.751347 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847fa017-4994-48a0-9bf6-c9c13c4f7af1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=84d42f0e8aa54a4fbbe3dcda0aea98ef)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:38.753629 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847fa017-4994-48a0-9bf6-c9c13c4f7af1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:38.756148 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 581/1172] 10.222.0.52 () {56 vars in 1183 bytes} [Sun Aug 28 00:43:38 2022] GET /identity/v3/domains/84d42f0e8aa54a4fbbe3dcda0aea98ef => generated 267 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:38.762444 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385c761-2bd9-49b1-bf6f-fcab83deced6 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:38.877525 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385c761-2bd9-49b1-bf6f-fcab83deced6 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:38.917067 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a05a5-4ff3-4794-ace4-0c2563dbf99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:38.917663 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a05a5-4ff3-4794-ace4-0c2563dbf99e None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:38.917967 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a05a5-4ff3-4794-ace4-0c2563dbf99e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:38.918236 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a05a5-4ff3-4794-ace4-0c2563dbf99e None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:38.918877 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a05a5-4ff3-4794-ace4-0c2563dbf99e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:38.921019 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a05a5-4ff3-4794-ace4-0c2563dbf99e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:38.951777 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 592/1173] 10.222.0.52 () {60 vars in 1141 bytes} [Sun Aug 28 00:43:38 2022] POST /identity/v3/projects => generated 361 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:43:40.899622 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1dff83-4e1a-464a-ae60-407482cd42e8 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:40.900447 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1dff83-4e1a-464a-ae60-407482cd42e8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:40.900447 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1dff83-4e1a-464a-ae60-407482cd42e8 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:40.902623 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 582/1174] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:43:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:43:40.909219 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acda7b8-bf9e-4b69-8aad-b5441870d190 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:40.909981 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acda7b8-bf9e-4b69-8aad-b5441870d190 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:40.910116 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acda7b8-bf9e-4b69-8aad-b5441870d190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:40.934162 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-6acda7b8-bf9e-4b69-8aad-b5441870d190 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:43:40.935427 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6acda7b8-bf9e-4b69-8aad-b5441870d190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:43:40.967768 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:41.008605 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 593/1175] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:43:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:43:41.279330 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1dff83-4e1a-464a-ae60-407482cd42e8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:41.408985 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1dff83-4e1a-464a-ae60-407482cd42e8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:41.445515 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0b4ce-0e74-4643-b86b-6e1d28a659a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:41.446155 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0b4ce-0e74-4643-b86b-6e1d28a659a1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:41.446436 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0b4ce-0e74-4643-b86b-6e1d28a659a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:41.446707 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0b4ce-0e74-4643-b86b-6e1d28a659a1 None admin] PATH_INFO: `/v3/domains/84d42f0e8aa54a4fbbe3dcda0aea98ef` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:41.447960 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0b4ce-0e74-4643-b86b-6e1d28a659a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=84d42f0e8aa54a4fbbe3dcda0aea98ef)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:41.449419 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0b4ce-0e74-4643-b86b-6e1d28a659a1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:41.451085 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 583/1176] 10.222.0.52 () {56 vars in 1183 bytes} [Sun Aug 28 00:43:41 2022] GET /identity/v3/domains/84d42f0e8aa54a4fbbe3dcda0aea98ef => generated 267 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:41.457629 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acda7b8-bf9e-4b69-8aad-b5441870d190 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:41.576731 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acda7b8-bf9e-4b69-8aad-b5441870d190 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:41.613038 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651d404-f7fa-41b3-b70c-d2530985a840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:41.613635 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651d404-f7fa-41b3-b70c-d2530985a840 None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:41.613938 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651d404-f7fa-41b3-b70c-d2530985a840 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:41.614177 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651d404-f7fa-41b3-b70c-d2530985a840 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:41.614833 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651d404-f7fa-41b3-b70c-d2530985a840 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:41.616266 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651d404-f7fa-41b3-b70c-d2530985a840 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:41.639315 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 594/1177] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Aug 28 00:43:41 2022] POST /identity/v3/users => generated 311 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:43:43.700674 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a2b4d-2c85-4ccb-80d7-6c737f946e8f None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:43.701624 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a2b4d-2c85-4ccb-80d7-6c737f946e8f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:43.701624 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a2b4d-2c85-4ccb-80d7-6c737f946e8f None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:43.703824 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 584/1178] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:43:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:43:43.712622 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071c105-b0af-40f9-82b8-6da8925cf52a None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:43.713383 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071c105-b0af-40f9-82b8-6da8925cf52a None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:43.713552 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071c105-b0af-40f9-82b8-6da8925cf52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:43.734947 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-5071c105-b0af-40f9-82b8-6da8925cf52a None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:43:43.736144 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-5071c105-b0af-40f9-82b8-6da8925cf52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:43:43.755023 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:43.811593 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 595/1179] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:43:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:43:44.086072 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a2b4d-2c85-4ccb-80d7-6c737f946e8f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:44.101101 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:44.200216 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a2b4d-2c85-4ccb-80d7-6c737f946e8f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:44.235981 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b7de8-cf9c-4f0f-b3a9-c07ef9323006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:44.236589 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b7de8-cf9c-4f0f-b3a9-c07ef9323006 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:44.236835 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b7de8-cf9c-4f0f-b3a9-c07ef9323006 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:44.237139 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b7de8-cf9c-4f0f-b3a9-c07ef9323006 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:44.248349 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b7de8-cf9c-4f0f-b3a9-c07ef9323006 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:43:44.253173 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-ef3b7de8-cf9c-4f0f-b3a9-c07ef9323006 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:43:44.253173 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:43:44.253173 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:43:44.253173 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:43:44.253173 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:43:44.253173 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:43:44.253173 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:43:44.253173 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:43:44.253173 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:43:44.253173 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:43:44.253173 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:43:44.253173 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:43:44.253173 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:43:44.253173 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:43:44.253173 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:43:44.253173 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:43:44.254347 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:43:44.254347 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:43:44.254347 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:43:44.254347 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:43:44.254347 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:43:44.254347 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:43:44.254347 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:43:44.254347 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:43:44.254347 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:43:44.254347 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:43:44.254347 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:43:44.254347 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:43:44.254347 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:43:44.254347 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:43:44.254347 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:43:44.254347 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:43:44.255262 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:43:44.255262 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:43:44.255262 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:43:44.255262 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:43:44.255262 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:43:44.255262 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:43:44.255262 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:43:44.255262 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:43:44.255262 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:43:44.255262 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:43:44.255262 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:43:44.255262 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:43:44.255262 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 585/1180] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:43:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:43:44.262805 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071c105-b0af-40f9-82b8-6da8925cf52a None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:44.373500 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071c105-b0af-40f9-82b8-6da8925cf52a None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:44.412006 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ad460-d873-4fba-b038-7956de38e860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:44.412593 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ad460-d873-4fba-b038-7956de38e860 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:44.412874 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ad460-d873-4fba-b038-7956de38e860 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:44.413145 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ad460-d873-4fba-b038-7956de38e860 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:44.413796 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ad460-d873-4fba-b038-7956de38e860 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:43:44.414135 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ad460-d873-4fba-b038-7956de38e860 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:44.415513 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ad460-d873-4fba-b038-7956de38e860 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:44.423701 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 596/1181] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:43:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:44.430328 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b7de8-cf9c-4f0f-b3a9-c07ef9323006 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:44.503452 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:44.552023 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b7de8-cf9c-4f0f-b3a9-c07ef9323006 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:44.592597 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86dd5f-3131-4547-b3e1-22ce40fd408b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:44.593223 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86dd5f-3131-4547-b3e1-22ce40fd408b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:44.593498 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86dd5f-3131-4547-b3e1-22ce40fd408b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:44.593769 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86dd5f-3131-4547-b3e1-22ce40fd408b None admin] PATH_INFO: `/v3/users/eea34d7ba94a4be8a44cc34828022e98` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:44.609430 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86dd5f-3131-4547-b3e1-22ce40fd408b None admin] RBAC: Authorizing `identity:get_user(user_id=eea34d7ba94a4be8a44cc34828022e98)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:44.610928 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86dd5f-3131-4547-b3e1-22ce40fd408b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:44.612569 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 586/1182] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:43:44 2022] GET /identity/v3/users/eea34d7ba94a4be8a44cc34828022e98 => generated 311 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:44.618842 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ad460-d873-4fba-b038-7956de38e860 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:44.637299 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:44.724125 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ad460-d873-4fba-b038-7956de38e860 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:44.762737 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d06935-f759-42e9-b34b-2ea7bb7e07fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:44.763484 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d06935-f759-42e9-b34b-2ea7bb7e07fd None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:44.763764 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d06935-f759-42e9-b34b-2ea7bb7e07fd None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:44.764031 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d06935-f759-42e9-b34b-2ea7bb7e07fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:44.835447 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d06935-f759-42e9-b34b-2ea7bb7e07fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:44.836905 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d06935-f759-42e9-b34b-2ea7bb7e07fd None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:44.851548 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:44.941098 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 597/1183] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:43:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:43:44.949892 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86dd5f-3131-4547-b3e1-22ce40fd408b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:45.060142 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86dd5f-3131-4547-b3e1-22ce40fd408b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:45.087907 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:45.098523 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30d8fb-2c8c-4a31-a1b0-86262c3d27f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:45.099140 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30d8fb-2c8c-4a31-a1b0-86262c3d27f3 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:45.099410 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30d8fb-2c8c-4a31-a1b0-86262c3d27f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:45.099678 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30d8fb-2c8c-4a31-a1b0-86262c3d27f3 None admin] PATH_INFO: `/v3/projects/ae56ed2702414243a4485df287f07fbe` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:45.100818 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e30d8fb-2c8c-4a31-a1b0-86262c3d27f3 None admin] RBAC: Authorizing `identity:get_project(project_id=ae56ed2702414243a4485df287f07fbe)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:45.102303 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e30d8fb-2c8c-4a31-a1b0-86262c3d27f3 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:45.103930 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 587/1184] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:43:44 2022] GET /identity/v3/projects/ae56ed2702414243a4485df287f07fbe => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:43:45.113174 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d06935-f759-42e9-b34b-2ea7bb7e07fd None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:45.217316 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d06935-f759-42e9-b34b-2ea7bb7e07fd None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:45.231467 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:45.254581 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d2066-4f18-4ab6-94bd-f8769dd33aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:45.255170 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d2066-4f18-4ab6-94bd-f8769dd33aec None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:45.255445 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d2066-4f18-4ab6-94bd-f8769dd33aec None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:45.255714 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d2066-4f18-4ab6-94bd-f8769dd33aec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:45.256435 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d2066-4f18-4ab6-94bd-f8769dd33aec None admin] RBAC: Adding query filter params (role.id=cc013581bb07418d9ec6a3a1d282ea53, scope.project.id=ae56ed2702414243a4485df287f07fbe, user.id=eea34d7ba94a4be8a44cc34828022e98) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:43:45.256740 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d2066-4f18-4ab6-94bd-f8769dd33aec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:45.258203 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d2066-4f18-4ab6-94bd-f8769dd33aec None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:45.264066 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 598/1185] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:43:45 2022] GET /identity/v3/role_assignments?user.id=eea34d7ba94a4be8a44cc34828022e98&scope.project.id=ae56ed2702414243a4485df287f07fbe&role.id=cc013581bb07418d9ec6a3a1d282ea53 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:43:47.134294 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343d7e9-909f-4533-bf66-733cee71d844 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:47.135171 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343d7e9-909f-4533-bf66-733cee71d844 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:47.135171 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343d7e9-909f-4533-bf66-733cee71d844 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:47.137379 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 588/1186] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:43:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:43:47.142690 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0ef09-580d-4040-bf23-30f14e7f91ed None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:47.143147 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0ef09-580d-4040-bf23-30f14e7f91ed None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:47.143247 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0ef09-580d-4040-bf23-30f14e7f91ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:47.161822 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-4ac0ef09-580d-4040-bf23-30f14e7f91ed None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:43:47.163018 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-4ac0ef09-580d-4040-bf23-30f14e7f91ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:43:47.237064 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 599/1187] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:43:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:43:47.511499 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343d7e9-909f-4533-bf66-733cee71d844 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:47.624412 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343d7e9-909f-4533-bf66-733cee71d844 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:47.659993 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0f9c1-aba1-4293-8650-aca1fc66fe9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:47.660606 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0f9c1-aba1-4293-8650-aca1fc66fe9b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:47.660880 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0f9c1-aba1-4293-8650-aca1fc66fe9b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:47.661144 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0f9c1-aba1-4293-8650-aca1fc66fe9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:47.671985 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0f9c1-aba1-4293-8650-aca1fc66fe9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:43:47.676788 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-80e0f9c1-aba1-4293-8650-aca1fc66fe9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:43:47.676788 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:43:47.676788 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:43:47.676788 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:43:47.676788 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:43:47.676788 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:43:47.676788 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:43:47.676788 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:43:47.676788 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:43:47.676788 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:43:47.676788 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:43:47.676788 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:43:47.676788 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:43:47.676788 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:43:47.676788 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:43:47.676788 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:43:47.677943 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:43:47.677943 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:43:47.677943 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:43:47.677943 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:43:47.677943 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:43:47.677943 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:43:47.677943 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:43:47.677943 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:43:47.677943 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:43:47.677943 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:43:47.677943 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:43:47.677943 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:43:47.677943 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:43:47.677943 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:43:47.677943 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:43:47.677943 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:43:47.679002 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:43:47.679002 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:43:47.679002 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:43:47.679002 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:43:47.679002 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:43:47.679002 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:43:47.679002 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:43:47.679002 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:43:47.679002 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:43:47.679002 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:43:47.679002 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:43:47.679002 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:43:47.679002 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 589/1188] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:43:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:43:47.684073 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0ef09-580d-4040-bf23-30f14e7f91ed None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:47.786293 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0ef09-580d-4040-bf23-30f14e7f91ed None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:47.795585 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:47.828244 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb6d42-bc69-43cc-89a5-f114e487bf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:47.828837 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb6d42-bc69-43cc-89a5-f114e487bf26 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:47.829112 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb6d42-bc69-43cc-89a5-f114e487bf26 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:47.829379 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb6d42-bc69-43cc-89a5-f114e487bf26 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:47.830068 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb6d42-bc69-43cc-89a5-f114e487bf26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:43:47.830366 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb6d42-bc69-43cc-89a5-f114e487bf26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:47.831737 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb6d42-bc69-43cc-89a5-f114e487bf26 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:47.839945 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 600/1189] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:43:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:43:47.847347 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0f9c1-aba1-4293-8650-aca1fc66fe9b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:47.911947 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:47.961819 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0f9c1-aba1-4293-8650-aca1fc66fe9b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:47.999463 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e775c-23ee-4501-b470-c3e7b58863a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:48.000083 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e775c-23ee-4501-b470-c3e7b58863a9 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:48.000357 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e775c-23ee-4501-b470-c3e7b58863a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:48.000631 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e775c-23ee-4501-b470-c3e7b58863a9 None admin] PATH_INFO: `/v3/users/eea34d7ba94a4be8a44cc34828022e98` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:48.001878 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e775c-23ee-4501-b470-c3e7b58863a9 None admin] RBAC: Authorizing `identity:get_user(user_id=eea34d7ba94a4be8a44cc34828022e98)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:48.003332 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e775c-23ee-4501-b470-c3e7b58863a9 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:48.004926 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 590/1190] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:43:47 2022] GET /identity/v3/users/eea34d7ba94a4be8a44cc34828022e98 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:48.010978 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb6d42-bc69-43cc-89a5-f114e487bf26 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:48.120740 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb6d42-bc69-43cc-89a5-f114e487bf26 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:48.158587 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ed7ff-6abc-4ab5-8bf6-9046f198f07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:48.159199 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ed7ff-6abc-4ab5-8bf6-9046f198f07c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:48.159477 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ed7ff-6abc-4ab5-8bf6-9046f198f07c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:48.159746 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ed7ff-6abc-4ab5-8bf6-9046f198f07c None admin] PATH_INFO: `/v3/projects/ae56ed2702414243a4485df287f07fbe` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:48.161013 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ed7ff-6abc-4ab5-8bf6-9046f198f07c None admin] RBAC: Authorizing `identity:get_project(project_id=ae56ed2702414243a4485df287f07fbe)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:48.162588 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ed7ff-6abc-4ab5-8bf6-9046f198f07c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:48.164362 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 601/1191] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:43:48 2022] GET /identity/v3/projects/ae56ed2702414243a4485df287f07fbe => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:43:48.171102 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e775c-23ee-4501-b470-c3e7b58863a9 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:48.286363 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e775c-23ee-4501-b470-c3e7b58863a9 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:48.320875 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:48.336579 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbc5be-dc79-4adb-ad74-77fa01cc7631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:48.337402 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbc5be-dc79-4adb-ad74-77fa01cc7631 None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:48.337778 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbc5be-dc79-4adb-ad74-77fa01cc7631 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:48.338157 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbc5be-dc79-4adb-ad74-77fa01cc7631 None admin] PATH_INFO: `/v3/projects/ae56ed2702414243a4485df287f07fbe/users/eea34d7ba94a4be8a44cc34828022e98/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:48.341119 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbc5be-dc79-4adb-ad74-77fa01cc7631 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae56ed2702414243a4485df287f07fbe, user_id=eea34d7ba94a4be8a44cc34828022e98, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:48.343274 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbc5be-dc79-4adb-ad74-77fa01cc7631 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:48.361147 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 591/1192] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Aug 28 00:43:48 2022] PUT /identity/v3/projects/ae56ed2702414243a4485df287f07fbe/users/eea34d7ba94a4be8a44cc34828022e98/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:43:50.203261 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a46e66-88d0-449d-b5f2-fe7a1454a441 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:50.203869 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a46e66-88d0-449d-b5f2-fe7a1454a441 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:50.203869 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a46e66-88d0-449d-b5f2-fe7a1454a441 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:50.205120 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 602/1193] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:43:50.211444 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793784c-11de-471e-baf5-1f274c3775a9 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:50.212171 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793784c-11de-471e-baf5-1f274c3775a9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:50.212319 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793784c-11de-471e-baf5-1f274c3775a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:50.234791 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a793784c-11de-471e-baf5-1f274c3775a9 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:43:50.235999 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a793784c-11de-471e-baf5-1f274c3775a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:43:50.307075 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 592/1194] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:43:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:43:50.577716 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a46e66-88d0-449d-b5f2-fe7a1454a441 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:50.624003 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:50.692849 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a46e66-88d0-449d-b5f2-fe7a1454a441 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:50.735914 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc59898-534f-4fd8-ba37-05a15a0ebe00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:50.736536 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc59898-534f-4fd8-ba37-05a15a0ebe00 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:50.736794 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc59898-534f-4fd8-ba37-05a15a0ebe00 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:50.737082 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc59898-534f-4fd8-ba37-05a15a0ebe00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:50.748946 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc59898-534f-4fd8-ba37-05a15a0ebe00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:43:50.753791 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-5fc59898-534f-4fd8-ba37-05a15a0ebe00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:43:50.753791 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:43:50.753791 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:43:50.753791 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:43:50.753791 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:43:50.753791 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:43:50.753791 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:43:50.753791 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:43:50.753791 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:43:50.753791 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:43:50.753791 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:43:50.753791 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:43:50.753791 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:43:50.753791 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:43:50.753791 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:43:50.753791 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:43:50.754874 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:43:50.754874 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:43:50.754874 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:43:50.754874 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:43:50.754874 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:43:50.754874 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:43:50.754874 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:43:50.754874 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:43:50.754874 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:43:50.754874 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:43:50.754874 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:43:50.754874 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:43:50.754874 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:43:50.754874 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:43:50.754874 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:43:50.754874 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:43:50.755871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:43:50.755871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:43:50.755871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:43:50.755871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:43:50.755871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:43:50.755871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:43:50.755871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:43:50.755871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:43:50.755871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:43:50.755871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:43:50.755871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:43:50.755871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:43:50.755871 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 603/1195] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:43:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:43:50.761719 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793784c-11de-471e-baf5-1f274c3775a9 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:50.874175 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793784c-11de-471e-baf5-1f274c3775a9 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:50.887165 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:50.908802 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833508b-c5b2-42eb-9e44-e2dd9101f39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:50.909402 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833508b-c5b2-42eb-9e44-e2dd9101f39e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:50.909678 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833508b-c5b2-42eb-9e44-e2dd9101f39e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:50.909985 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833508b-c5b2-42eb-9e44-e2dd9101f39e None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:50.910646 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833508b-c5b2-42eb-9e44-e2dd9101f39e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:43:50.910945 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833508b-c5b2-42eb-9e44-e2dd9101f39e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:50.912329 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833508b-c5b2-42eb-9e44-e2dd9101f39e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:50.920231 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 593/1196] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:43:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:50.926595 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc59898-534f-4fd8-ba37-05a15a0ebe00 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:51.037059 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:51.042140 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc59898-534f-4fd8-ba37-05a15a0ebe00 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:51.082282 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1743ce8-cd28-4657-859d-68b2ae8c01a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:51.082835 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1743ce8-cd28-4657-859d-68b2ae8c01a4 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:51.083119 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1743ce8-cd28-4657-859d-68b2ae8c01a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:51.083387 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1743ce8-cd28-4657-859d-68b2ae8c01a4 None admin] PATH_INFO: `/v3/users/eea34d7ba94a4be8a44cc34828022e98` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:51.084531 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1743ce8-cd28-4657-859d-68b2ae8c01a4 None admin] RBAC: Authorizing `identity:get_user(user_id=eea34d7ba94a4be8a44cc34828022e98)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:51.086008 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1743ce8-cd28-4657-859d-68b2ae8c01a4 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:51.087657 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 604/1197] 10.222.0.52 () {56 vars in 1177 bytes} [Sun Aug 28 00:43:50 2022] GET /identity/v3/users/eea34d7ba94a4be8a44cc34828022e98 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:51.097526 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833508b-c5b2-42eb-9e44-e2dd9101f39e None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:51.206874 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833508b-c5b2-42eb-9e44-e2dd9101f39e None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:51.243286 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3e79c-e9b1-416e-8edc-29ce6a5dd409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:51.243909 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3e79c-e9b1-416e-8edc-29ce6a5dd409 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:51.244147 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3e79c-e9b1-416e-8edc-29ce6a5dd409 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:51.244389 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3e79c-e9b1-416e-8edc-29ce6a5dd409 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:51.289872 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:51.318454 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3e79c-e9b1-416e-8edc-29ce6a5dd409 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:51.319908 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3e79c-e9b1-416e-8edc-29ce6a5dd409 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:51.446578 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 594/1198] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:43:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:43:51.452950 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1743ce8-cd28-4657-859d-68b2ae8c01a4 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:51.559285 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1743ce8-cd28-4657-859d-68b2ae8c01a4 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:51.593973 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc3b8f-9ff4-452d-9801-580eb1b866a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:51.594588 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc3b8f-9ff4-452d-9801-580eb1b866a6 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:51.594863 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc3b8f-9ff4-452d-9801-580eb1b866a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:51.595127 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc3b8f-9ff4-452d-9801-580eb1b866a6 None admin] PATH_INFO: `/v3/projects/ae56ed2702414243a4485df287f07fbe` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:51.596303 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc3b8f-9ff4-452d-9801-580eb1b866a6 None admin] RBAC: Authorizing `identity:get_project(project_id=ae56ed2702414243a4485df287f07fbe)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:51.598095 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc3b8f-9ff4-452d-9801-580eb1b866a6 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:51.599722 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 605/1199] 10.222.0.52 () {56 vars in 1186 bytes} [Sun Aug 28 00:43:51 2022] GET /identity/v3/projects/ae56ed2702414243a4485df287f07fbe => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:51.606335 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3e79c-e9b1-416e-8edc-29ce6a5dd409 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:51.692262 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:51.717957 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3e79c-e9b1-416e-8edc-29ce6a5dd409 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:51.751873 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50685ec3-b732-4b18-86ee-98d1801da68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:51.752465 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50685ec3-b732-4b18-86ee-98d1801da68e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:51.752739 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50685ec3-b732-4b18-86ee-98d1801da68e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:51.753008 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50685ec3-b732-4b18-86ee-98d1801da68e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:51.753736 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50685ec3-b732-4b18-86ee-98d1801da68e None admin] RBAC: Adding query filter params (role.id=cc013581bb07418d9ec6a3a1d282ea53, scope.project.id=ae56ed2702414243a4485df287f07fbe, user.id=eea34d7ba94a4be8a44cc34828022e98) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:43:51.754073 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50685ec3-b732-4b18-86ee-98d1801da68e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:51.755511 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50685ec3-b732-4b18-86ee-98d1801da68e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:51.761309 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 595/1200] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:43:51 2022] GET /identity/v3/role_assignments?user.id=eea34d7ba94a4be8a44cc34828022e98&scope.project.id=ae56ed2702414243a4485df287f07fbe&role.id=cc013581bb07418d9ec6a3a1d282ea53 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:01.588707 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=83 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:01.758604 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=31 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:47.901769 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3a000-c12e-43c4-bbdf-aa9345f6e2e6 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:47.901769 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3a000-c12e-43c4-bbdf-aa9345f6e2e6 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:47.901769 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3a000-c12e-43c4-bbdf-aa9345f6e2e6 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:47.904033 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 606/1201] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:44:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:47.910084 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed477b6-6237-4db5-9e51-61add5a8b32e None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:47.910578 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed477b6-6237-4db5-9e51-61add5a8b32e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:47.910670 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed477b6-6237-4db5-9e51-61add5a8b32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:47.931911 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-bed477b6-6237-4db5-9e51-61add5a8b32e None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:47.933435 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bed477b6-6237-4db5-9e51-61add5a8b32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:48.016487 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 596/1202] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:44:48.309799 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3a000-c12e-43c4-bbdf-aa9345f6e2e6 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:48.461586 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3a000-c12e-43c4-bbdf-aa9345f6e2e6 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:48.510247 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef7fe3-34d8-4411-a841-ec69a5d0c104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:48.510890 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef7fe3-34d8-4411-a841-ec69a5d0c104 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:48.511192 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef7fe3-34d8-4411-a841-ec69a5d0c104 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:48.511466 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef7fe3-34d8-4411-a841-ec69a5d0c104 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:48.527920 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef7fe3-34d8-4411-a841-ec69a5d0c104 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:48.529881 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef7fe3-34d8-4411-a841-ec69a5d0c104 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:48.553288 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-adef7fe3-34d8-4411-a841-ec69a5d0c104 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:44:48.553288 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:48.553288 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:48.553288 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:48.553288 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:48.553288 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:48.553288 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:48.553288 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:48.553288 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:48.553288 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:48.553288 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:48.553288 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:48.553288 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:44:48.553288 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:44:48.553288 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:44:48.553288 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:44:48.554444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:48.554444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:48.554444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:48.554444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:48.554444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:48.554444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:48.554444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:48.554444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:48.554444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:48.554444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:48.554444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:48.554444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:48.554444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:48.554444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:48.554444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:48.554444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:48.554444 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:44:48.555601 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:44:48.555601 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:44:48.555601 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:44:48.555601 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 607/1203] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:44:48.561688 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed477b6-6237-4db5-9e51-61add5a8b32e None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:48.693440 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed477b6-6237-4db5-9e51-61add5a8b32e None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:48.724933 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:48.731026 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121d1f1-171c-4581-92ab-8f1f7e7e6a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:48.731667 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121d1f1-171c-4581-92ab-8f1f7e7e6a70 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:48.731913 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121d1f1-171c-4581-92ab-8f1f7e7e6a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:48.732312 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121d1f1-171c-4581-92ab-8f1f7e7e6a70 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:48.733075 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121d1f1-171c-4581-92ab-8f1f7e7e6a70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:48.733372 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121d1f1-171c-4581-92ab-8f1f7e7e6a70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:48.734942 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121d1f1-171c-4581-92ab-8f1f7e7e6a70 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:48.751900 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 597/1204] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:48.758693 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef7fe3-34d8-4411-a841-ec69a5d0c104 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:48.816763 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:48.874155 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef7fe3-34d8-4411-a841-ec69a5d0c104 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:48.917151 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37905d-3e48-415f-a389-9f0b6cf68310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:48.917905 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37905d-3e48-415f-a389-9f0b6cf68310 None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:48.918189 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37905d-3e48-415f-a389-9f0b6cf68310 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:48.918465 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37905d-3e48-415f-a389-9f0b6cf68310 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:48.919231 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37905d-3e48-415f-a389-9f0b6cf68310 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:48.920973 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37905d-3e48-415f-a389-9f0b6cf68310 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:48.948646 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 608/1205] 10.222.0.52 () {60 vars in 1132 bytes} [Sun Aug 28 00:44:48 2022] POST /identity/v3/users => generated 251 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:44:51.118234 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30944f5c-d3dd-4475-8aa6-511ce2d9459f None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:51.118829 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30944f5c-d3dd-4475-8aa6-511ce2d9459f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:51.118829 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30944f5c-d3dd-4475-8aa6-511ce2d9459f None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:51.120220 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 598/1206] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:51.126418 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94e037-f379-4418-b1fc-c5b97a66cd71 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:51.126863 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94e037-f379-4418-b1fc-c5b97a66cd71 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:51.126955 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94e037-f379-4418-b1fc-c5b97a66cd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:51.147496 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-2d94e037-f379-4418-b1fc-c5b97a66cd71 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:51.148691 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-2d94e037-f379-4418-b1fc-c5b97a66cd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:51.228158 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 609/1207] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:44:51.537571 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30944f5c-d3dd-4475-8aa6-511ce2d9459f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:51.668663 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30944f5c-d3dd-4475-8aa6-511ce2d9459f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:51.712647 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319381ec-2187-41ed-af6d-77eef5bb7032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:51.713368 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319381ec-2187-41ed-af6d-77eef5bb7032 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:51.713802 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319381ec-2187-41ed-af6d-77eef5bb7032 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:51.714115 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319381ec-2187-41ed-af6d-77eef5bb7032 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:51.729613 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319381ec-2187-41ed-af6d-77eef5bb7032 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:51.734868 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-319381ec-2187-41ed-af6d-77eef5bb7032 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:44:51.734868 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:51.734868 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:51.734868 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:51.734868 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:51.734868 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:51.734868 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:51.734868 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:51.734868 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:51.734868 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:51.734868 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:51.734868 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:51.734868 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:51.734868 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:51.734868 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:51.734868 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:51.736067 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:51.736067 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:51.736067 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:51.736067 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:51.736067 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:51.736067 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:51.736067 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:51.736067 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:51.736067 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:51.736067 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:51.736067 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:51.736067 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:51.736067 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:51.736067 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:51.736067 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:51.736067 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:51.736977 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:51.736977 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:51.736977 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:51.736977 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:51.736977 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:51.736977 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:51.736977 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:51.736977 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:51.736977 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:51.736977 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:51.736977 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:44:51.736977 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:44:51.736977 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 599/1208] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Aug 28 00:44:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:51.742390 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94e037-f379-4418-b1fc-c5b97a66cd71 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:51.798279 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:51.877352 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94e037-f379-4418-b1fc-c5b97a66cd71 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:51.921568 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e194131-d0fe-484a-b588-de9b547945de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:51.922452 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e194131-d0fe-484a-b588-de9b547945de None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:51.922811 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e194131-d0fe-484a-b588-de9b547945de None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:51.923126 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e194131-d0fe-484a-b588-de9b547945de None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:51.923921 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e194131-d0fe-484a-b588-de9b547945de None admin] RBAC: Adding query filter params (name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:51.924326 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e194131-d0fe-484a-b588-de9b547945de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:51.925909 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e194131-d0fe-484a-b588-de9b547945de None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:51.934773 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 610/1209] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Aug 28 00:44:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:44:51.940662 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319381ec-2187-41ed-af6d-77eef5bb7032 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:51.998142 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:52.053662 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319381ec-2187-41ed-af6d-77eef5bb7032 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:52.094550 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a907c74-4e41-4755-9bf3-ef28f188cf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:52.095185 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a907c74-4e41-4755-9bf3-ef28f188cf8a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:52.095477 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a907c74-4e41-4755-9bf3-ef28f188cf8a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:52.095742 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a907c74-4e41-4755-9bf3-ef28f188cf8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:52.108584 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a907c74-4e41-4755-9bf3-ef28f188cf8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:52.110107 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a907c74-4e41-4755-9bf3-ef28f188cf8a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:52.126501 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-5a907c74-4e41-4755-9bf3-ef28f188cf8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:44:52.126501 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:52.126501 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:52.126501 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:52.126501 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:52.126501 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:52.126501 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:52.126501 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:52.126501 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:52.126501 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:52.126501 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:52.126501 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:52.126501 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:44:52.126501 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:44:52.126501 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:44:52.126501 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:44:52.127898 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:52.127898 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:52.127898 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:52.127898 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:52.127898 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:52.127898 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:52.127898 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:52.127898 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:52.127898 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:52.127898 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:52.127898 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:52.127898 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:52.127898 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:52.127898 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:52.127898 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:52.127898 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:52.127898 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:44:52.128799 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:44:52.128799 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:44:52.128799 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:44:52.130011 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 600/1210] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:52.134002 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e194131-d0fe-484a-b588-de9b547945de None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:52.244726 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:52.247935 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e194131-d0fe-484a-b588-de9b547945de None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:52.287097 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875d8ac-2e57-418a-9b06-d29886dd74e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:52.287743 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875d8ac-2e57-418a-9b06-d29886dd74e1 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:52.288017 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875d8ac-2e57-418a-9b06-d29886dd74e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:52.288291 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875d8ac-2e57-418a-9b06-d29886dd74e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:52.288967 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875d8ac-2e57-418a-9b06-d29886dd74e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:52.289288 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875d8ac-2e57-418a-9b06-d29886dd74e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:52.290696 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875d8ac-2e57-418a-9b06-d29886dd74e1 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:52.304369 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 611/1211] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:52.309228 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a907c74-4e41-4755-9bf3-ef28f188cf8a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:52.427090 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a907c74-4e41-4755-9bf3-ef28f188cf8a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:52.428992 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:52.469914 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850900d3-367d-4fb8-b181-63287a05ffa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:52.472073 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850900d3-367d-4fb8-b181-63287a05ffa2 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:52.472073 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850900d3-367d-4fb8-b181-63287a05ffa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:52.472073 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850900d3-367d-4fb8-b181-63287a05ffa2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:52.480307 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850900d3-367d-4fb8-b181-63287a05ffa2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:52.482049 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850900d3-367d-4fb8-b181-63287a05ffa2 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:52.496991 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-850900d3-367d-4fb8-b181-63287a05ffa2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:44:52.496991 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:52.496991 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:52.496991 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:52.496991 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:52.496991 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:52.496991 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:52.496991 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:52.496991 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:52.496991 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:52.496991 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:52.496991 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:52.496991 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:44:52.496991 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:44:52.496991 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:44:52.496991 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:44:52.498841 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:52.498841 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:52.498841 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:44:52.498841 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:44:52.498841 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:44:52.498841 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:44:52.498841 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:52.498841 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:52.498841 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:52.498841 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:52.498841 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:52.498841 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:52.498841 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:52.498841 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:52.498841 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:52.498841 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:52.498841 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:52.498841 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:52.500162 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:52.500162 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:52.500162 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:44:52.500162 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:44:52.500162 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:44:52.500162 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:44:52.500162 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:44:52.500162 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:44:52.500162 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:44:52.500162 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:44:52.500162 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 601/1212] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:44:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:52.506194 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875d8ac-2e57-418a-9b06-d29886dd74e1 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:52.629665 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875d8ac-2e57-418a-9b06-d29886dd74e1 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:52.664974 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec1d2d-5cf3-49d1-97a9-72a644369734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:52.665549 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec1d2d-5cf3-49d1-97a9-72a644369734 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:52.665823 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec1d2d-5cf3-49d1-97a9-72a644369734 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:52.666119 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec1d2d-5cf3-49d1-97a9-72a644369734 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:52.666842 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec1d2d-5cf3-49d1-97a9-72a644369734 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:52.667247 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec1d2d-5cf3-49d1-97a9-72a644369734 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:52.668625 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec1d2d-5cf3-49d1-97a9-72a644369734 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:52.687155 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 612/1213] 10.222.0.52 () {56 vars in 1143 bytes} [Sun Aug 28 00:44:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:52.694224 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850900d3-367d-4fb8-b181-63287a05ffa2 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:52.812969 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850900d3-367d-4fb8-b181-63287a05ffa2 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:52.861043 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a185277-0953-421b-ad8f-4c024da615ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:52.861781 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a185277-0953-421b-ad8f-4c024da615ab None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:52.862123 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a185277-0953-421b-ad8f-4c024da615ab None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:52.862503 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a185277-0953-421b-ad8f-4c024da615ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:52.903381 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:52.958407 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a185277-0953-421b-ad8f-4c024da615ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:52.959987 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a185277-0953-421b-ad8f-4c024da615ab None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:53.106309 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 602/1214] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:44:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:44:53.112625 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec1d2d-5cf3-49d1-97a9-72a644369734 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:53.135083 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:53.231487 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec1d2d-5cf3-49d1-97a9-72a644369734 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:53.269892 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d8aa1-d196-4745-875f-481690715e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:53.269892 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d8aa1-d196-4745-875f-481690715e27 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:53.270200 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d8aa1-d196-4745-875f-481690715e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:53.270280 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d8aa1-d196-4745-875f-481690715e27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:53.282573 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d8aa1-d196-4745-875f-481690715e27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:53.284300 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d8aa1-d196-4745-875f-481690715e27 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:53.302086 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-209d8aa1-d196-4745-875f-481690715e27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:44:53.302086 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:53.302086 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:53.302086 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:53.302086 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:53.302086 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:53.302086 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:53.302086 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:53.302086 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:53.302086 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:53.302086 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:53.302086 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:53.302086 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:44:53.302086 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:44:53.302086 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:44:53.302086 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:44:53.303304 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:53.303304 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:53.303304 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:53.303304 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:53.303304 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:53.303304 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:53.303304 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:53.303304 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:53.303304 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:53.303304 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:53.303304 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:53.303304 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:53.303304 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:53.303304 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:53.303304 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:53.303304 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:53.303304 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:44:53.304417 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:44:53.304417 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:44:53.304417 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:44:53.304417 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 613/1215] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:53.309607 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a185277-0953-421b-ad8f-4c024da615ab None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:53.381971 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:53.424796 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a185277-0953-421b-ad8f-4c024da615ab None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:53.462436 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef11ce-85d7-41aa-85be-9cae83cd4f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:53.463042 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef11ce-85d7-41aa-85be-9cae83cd4f6f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:53.463389 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef11ce-85d7-41aa-85be-9cae83cd4f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:53.463638 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef11ce-85d7-41aa-85be-9cae83cd4f6f None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:53.464304 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef11ce-85d7-41aa-85be-9cae83cd4f6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:53.464728 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef11ce-85d7-41aa-85be-9cae83cd4f6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:53.466167 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef11ce-85d7-41aa-85be-9cae83cd4f6f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:53.479433 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 603/1216] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:53.484463 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d8aa1-d196-4745-875f-481690715e27 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:53.597672 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:53.634523 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d8aa1-d196-4745-875f-481690715e27 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:53.670810 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ab133-41da-4028-adf1-82d0337865b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:53.671733 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ab133-41da-4028-adf1-82d0337865b7 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:53.672106 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ab133-41da-4028-adf1-82d0337865b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:53.672494 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ab133-41da-4028-adf1-82d0337865b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:53.680529 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ab133-41da-4028-adf1-82d0337865b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:53.682335 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ab133-41da-4028-adf1-82d0337865b7 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:53.695898 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-cb2ab133-41da-4028-adf1-82d0337865b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:44:53.695898 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:53.695898 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:53.695898 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:53.695898 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:53.695898 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:53.695898 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:53.695898 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:53.695898 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:53.695898 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:53.695898 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:53.695898 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:53.695898 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:44:53.695898 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:44:53.695898 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:44:53.697081 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:44:53.697081 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:53.697081 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:53.697081 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:53.697081 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:53.697081 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:53.697081 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:53.697081 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:53.697081 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:53.697081 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:53.697081 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:53.697081 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:53.697081 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:53.697081 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:53.697081 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:53.697081 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:53.697081 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:53.698227 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:44:53.698227 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:44:53.698227 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:44:53.698227 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:44:53.698227 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:44:53.698227 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:44:53.698227 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:44:53.698227 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:44:53.704946 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 614/1217] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:44:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:53.706402 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef11ce-85d7-41aa-85be-9cae83cd4f6f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:53.847360 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef11ce-85d7-41aa-85be-9cae83cd4f6f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:53.880377 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:53.898280 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531e788-fea6-405f-9e05-e19972b9f61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:53.899268 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531e788-fea6-405f-9e05-e19972b9f61c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:53.899783 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531e788-fea6-405f-9e05-e19972b9f61c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:53.900258 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531e788-fea6-405f-9e05-e19972b9f61c None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:53.901177 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531e788-fea6-405f-9e05-e19972b9f61c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:53.901617 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531e788-fea6-405f-9e05-e19972b9f61c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:53.903369 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531e788-fea6-405f-9e05-e19972b9f61c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:53.929086 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 604/1218] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:44:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:44:53.931613 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ab133-41da-4028-adf1-82d0337865b7 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:54.049362 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ab133-41da-4028-adf1-82d0337865b7 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:54.084857 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:54.091770 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949553c-a905-40ca-97f4-9470fc36cac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:54.093007 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949553c-a905-40ca-97f4-9470fc36cac2 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:54.093287 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949553c-a905-40ca-97f4-9470fc36cac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:54.093560 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949553c-a905-40ca-97f4-9470fc36cac2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:54.094347 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949553c-a905-40ca-97f4-9470fc36cac2 None admin] RBAC: Adding query filter params (role.id=ce8c7035b6004d2f84c02ebc4a05f17b, scope.project.id=45c69e3e973c449895457bb610103a43, user.id=ae87149f6ab04a9997263598737ae27e) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:54.094658 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949553c-a905-40ca-97f4-9470fc36cac2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:54.096290 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949553c-a905-40ca-97f4-9470fc36cac2 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:54.113996 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 615/1219] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:44:53 2022] GET /identity/v3/role_assignments?user.id=ae87149f6ab04a9997263598737ae27e&scope.project.id=45c69e3e973c449895457bb610103a43&role.id=ce8c7035b6004d2f84c02ebc4a05f17b => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:56.164698 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e481bb2-0718-4e7c-93b9-db7e735c3a37 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:56.165243 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e481bb2-0718-4e7c-93b9-db7e735c3a37 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:56.165355 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e481bb2-0718-4e7c-93b9-db7e735c3a37 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:56.167058 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 605/1220] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:44:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:56.176299 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356f640-a2d1-459e-878a-866faf4d9b11 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:56.176299 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356f640-a2d1-459e-878a-866faf4d9b11 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:56.176299 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356f640-a2d1-459e-878a-866faf4d9b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:56.193963 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-8356f640-a2d1-459e-878a-866faf4d9b11 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:56.195346 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8356f640-a2d1-459e-878a-866faf4d9b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:56.278902 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 616/1221] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:44:56.554071 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e481bb2-0718-4e7c-93b9-db7e735c3a37 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:56.673328 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e481bb2-0718-4e7c-93b9-db7e735c3a37 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:56.711064 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f808f33-1213-4f2d-b455-df108c6bac86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:56.711696 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f808f33-1213-4f2d-b455-df108c6bac86 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:56.711995 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f808f33-1213-4f2d-b455-df108c6bac86 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:56.713590 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f808f33-1213-4f2d-b455-df108c6bac86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:56.725464 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f808f33-1213-4f2d-b455-df108c6bac86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:56.730680 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-8f808f33-1213-4f2d-b455-df108c6bac86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:44:56.730680 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:56.730680 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:56.730680 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:56.730680 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:56.730680 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:56.730680 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:56.730680 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:56.730680 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:56.730680 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:56.730680 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:56.730680 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:56.730680 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:56.730680 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:56.730680 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:56.730680 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:56.731867 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:56.731867 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:56.731867 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:56.731867 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:56.731867 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:56.731867 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:56.731867 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:56.731867 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:56.731867 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:56.731867 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:56.731867 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:56.731867 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:56.731867 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:56.731867 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:56.731867 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:56.731867 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:56.732930 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:56.732930 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:56.732930 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:56.732930 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:56.732930 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:56.732930 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:56.732930 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:56.732930 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:56.732930 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:56.732930 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:56.732930 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:44:56.732930 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:44:56.732930 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 606/1222] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Aug 28 00:44:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:56.738309 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356f640-a2d1-459e-878a-866faf4d9b11 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:56.850012 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356f640-a2d1-459e-878a-866faf4d9b11 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:56.875022 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:56.887756 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ec50c-19a0-4f06-b5dc-25a4d39d7646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:56.888708 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ec50c-19a0-4f06-b5dc-25a4d39d7646 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:56.889374 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ec50c-19a0-4f06-b5dc-25a4d39d7646 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:56.889778 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ec50c-19a0-4f06-b5dc-25a4d39d7646 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:56.890485 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ec50c-19a0-4f06-b5dc-25a4d39d7646 None admin] RBAC: Adding query filter params (name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:56.890828 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ec50c-19a0-4f06-b5dc-25a4d39d7646 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:56.892554 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ec50c-19a0-4f06-b5dc-25a4d39d7646 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:56.901955 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 617/1223] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Aug 28 00:44:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:56.908092 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f808f33-1213-4f2d-b455-df108c6bac86 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:56.959708 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:57.023933 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f808f33-1213-4f2d-b455-df108c6bac86 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:57.063606 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fd9f7-707f-4836-9f68-ff25b7a38194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:57.064369 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fd9f7-707f-4836-9f68-ff25b7a38194 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:57.064724 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fd9f7-707f-4836-9f68-ff25b7a38194 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:57.065073 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fd9f7-707f-4836-9f68-ff25b7a38194 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:57.082558 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2fd9f7-707f-4836-9f68-ff25b7a38194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:57.085568 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2fd9f7-707f-4836-9f68-ff25b7a38194 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:57.106929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-0d2fd9f7-707f-4836-9f68-ff25b7a38194 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:44:57.106929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:57.106929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:57.106929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:57.106929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:57.106929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:57.106929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:57.106929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:57.106929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:57.106929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:57.106929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:57.106929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:57.106929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:44:57.106929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:44:57.106929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:44:57.106929 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:44:57.114268 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:57.114268 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:57.114268 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:57.114268 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:57.114268 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:57.114268 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:57.114268 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:57.114268 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:57.114268 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:57.114268 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:57.114268 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:57.114268 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:57.114268 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:57.114268 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:57.114268 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:57.114268 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:57.114268 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:44:57.115489 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:44:57.115489 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:44:57.115489 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:44:57.115489 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 607/1224] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:57.115798 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ec50c-19a0-4f06-b5dc-25a4d39d7646 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:57.227854 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ec50c-19a0-4f06-b5dc-25a4d39d7646 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:57.263610 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ea9c3-cfdd-41ab-a7e7-7fc65a9c68cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:57.264947 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ea9c3-cfdd-41ab-a7e7-7fc65a9c68cd None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:57.265355 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ea9c3-cfdd-41ab-a7e7-7fc65a9c68cd None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:57.265631 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ea9c3-cfdd-41ab-a7e7-7fc65a9c68cd None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:57.266338 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ea9c3-cfdd-41ab-a7e7-7fc65a9c68cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:57.266625 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ea9c3-cfdd-41ab-a7e7-7fc65a9c68cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:57.268293 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ea9c3-cfdd-41ab-a7e7-7fc65a9c68cd None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:57.284109 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 618/1225] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:57.290968 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fd9f7-707f-4836-9f68-ff25b7a38194 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:57.397907 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:57.406086 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fd9f7-707f-4836-9f68-ff25b7a38194 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:57.446689 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bbfe5-686a-4aec-9c74-06837d06b806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:57.447502 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bbfe5-686a-4aec-9c74-06837d06b806 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:57.447784 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bbfe5-686a-4aec-9c74-06837d06b806 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:57.448079 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bbfe5-686a-4aec-9c74-06837d06b806 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:57.456221 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1bbfe5-686a-4aec-9c74-06837d06b806 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:57.458203 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1bbfe5-686a-4aec-9c74-06837d06b806 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:57.473915 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-ab1bbfe5-686a-4aec-9c74-06837d06b806 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:44:57.473915 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:57.473915 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:57.473915 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:57.473915 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:57.473915 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:57.473915 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:57.473915 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:57.473915 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:57.473915 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:57.473915 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:57.473915 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:57.473915 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:44:57.473915 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:44:57.473915 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:44:57.473915 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:44:57.475172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:57.475172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:57.475172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:44:57.475172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:44:57.475172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:44:57.475172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:44:57.475172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:57.475172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:57.475172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:57.475172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:57.475172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:57.475172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:57.475172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:57.475172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:57.475172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:57.475172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:57.475172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:57.475172 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:57.476548 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:57.476548 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:57.476548 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:44:57.476548 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:44:57.476548 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:44:57.476548 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:44:57.476548 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:44:57.476548 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:44:57.476548 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:44:57.476548 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:44:57.478604 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 608/1226] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:44:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:57.485366 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ea9c3-cfdd-41ab-a7e7-7fc65a9c68cd None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:57.538366 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:57.605299 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ea9c3-cfdd-41ab-a7e7-7fc65a9c68cd None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:57.643211 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13967d6-c26d-47dd-9c94-fd2eff79e9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:57.643828 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13967d6-c26d-47dd-9c94-fd2eff79e9e8 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:57.644113 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13967d6-c26d-47dd-9c94-fd2eff79e9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:57.644346 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13967d6-c26d-47dd-9c94-fd2eff79e9e8 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:57.645090 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13967d6-c26d-47dd-9c94-fd2eff79e9e8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:57.645385 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13967d6-c26d-47dd-9c94-fd2eff79e9e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:57.648982 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13967d6-c26d-47dd-9c94-fd2eff79e9e8 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:57.669952 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 619/1227] 10.222.0.52 () {56 vars in 1143 bytes} [Sun Aug 28 00:44:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:57.672561 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bbfe5-686a-4aec-9c74-06837d06b806 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:57.781868 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bbfe5-686a-4aec-9c74-06837d06b806 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:57.820839 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e3566-fa68-4707-8d29-31065d0da7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:57.821577 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e3566-fa68-4707-8d29-31065d0da7b7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:57.821874 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e3566-fa68-4707-8d29-31065d0da7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:57.822221 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e3566-fa68-4707-8d29-31065d0da7b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:57.834837 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e3566-fa68-4707-8d29-31065d0da7b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:57.836406 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e3566-fa68-4707-8d29-31065d0da7b7 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:57.852989 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-ad2e3566-fa68-4707-8d29-31065d0da7b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:44:57.852989 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:57.852989 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:57.852989 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:57.852989 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:57.852989 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:57.852989 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:57.852989 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:57.852989 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:57.852989 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:57.852989 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:57.852989 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:57.852989 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:44:57.852989 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:44:57.852989 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:44:57.852989 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:44:57.854134 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:57.854134 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:57.854134 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:57.854134 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:57.854134 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:57.854134 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:57.854134 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:57.854134 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:57.854134 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:57.854134 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:57.854134 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:57.854134 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:57.854134 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:57.854134 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:57.854134 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:57.854134 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:57.854134 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:44:57.855041 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:44:57.855041 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:44:57.855041 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:44:57.855041 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 609/1228] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:57.860613 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13967d6-c26d-47dd-9c94-fd2eff79e9e8 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:57.976030 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13967d6-c26d-47dd-9c94-fd2eff79e9e8 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:57.978567 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:58.015423 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046c1c2-d4c9-4cd9-9233-69c530c8b238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:58.016040 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046c1c2-d4c9-4cd9-9233-69c530c8b238 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:58.016362 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046c1c2-d4c9-4cd9-9233-69c530c8b238 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:58.016612 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046c1c2-d4c9-4cd9-9233-69c530c8b238 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:58.017364 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f046c1c2-d4c9-4cd9-9233-69c530c8b238 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:58.017727 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f046c1c2-d4c9-4cd9-9233-69c530c8b238 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:58.020907 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f046c1c2-d4c9-4cd9-9233-69c530c8b238 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:58.034302 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 620/1229] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:44:58.040213 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e3566-fa68-4707-8d29-31065d0da7b7 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:58.050689 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:58.156220 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e3566-fa68-4707-8d29-31065d0da7b7 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:58.195200 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd633f2-4bd4-41cd-bb4a-e2920807fed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:58.195885 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd633f2-4bd4-41cd-bb4a-e2920807fed6 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:58.196223 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd633f2-4bd4-41cd-bb4a-e2920807fed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:58.196495 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd633f2-4bd4-41cd-bb4a-e2920807fed6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:58.204273 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd633f2-4bd4-41cd-bb4a-e2920807fed6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:58.205778 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd633f2-4bd4-41cd-bb4a-e2920807fed6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:58.218197 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-0dd633f2-4bd4-41cd-bb4a-e2920807fed6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:44:58.218197 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:58.218197 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:58.218197 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:58.218197 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:58.218197 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:58.218197 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:58.218197 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:58.218197 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:58.218197 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:58.218197 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:58.218197 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:58.218197 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:44:58.218197 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:44:58.218197 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:44:58.219285 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:44:58.219285 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:58.219285 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:58.219285 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:58.219285 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:58.219285 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:58.219285 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:58.219285 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:58.219285 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:58.219285 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:58.219285 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:58.219285 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:58.219285 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:58.219285 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:58.219285 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:58.219285 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:58.219285 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:58.225659 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:44:58.225659 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:44:58.225659 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:44:58.225659 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:44:58.225659 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:44:58.225659 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:44:58.225659 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:44:58.225659 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:44:58.225659 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 610/1230] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:44:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:58.226471 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046c1c2-d4c9-4cd9-9233-69c530c8b238 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:58.346587 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046c1c2-d4c9-4cd9-9233-69c530c8b238 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:58.395355 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ee347-1005-447d-b284-94c2b28be483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:58.395948 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ee347-1005-447d-b284-94c2b28be483 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:58.396222 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ee347-1005-447d-b284-94c2b28be483 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:58.396541 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ee347-1005-447d-b284-94c2b28be483 None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:58.397353 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ee347-1005-447d-b284-94c2b28be483 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:58.397723 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ee347-1005-447d-b284-94c2b28be483 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:58.399535 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ee347-1005-447d-b284-94c2b28be483 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:58.412044 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 621/1231] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:44:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:58.419114 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd633f2-4bd4-41cd-bb4a-e2920807fed6 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:58.499415 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:58.540626 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd633f2-4bd4-41cd-bb4a-e2920807fed6 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:58.580609 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6d456-f894-4bc8-b9b0-c192bbd772b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:58.581273 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6d456-f894-4bc8-b9b0-c192bbd772b6 None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:58.581554 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6d456-f894-4bc8-b9b0-c192bbd772b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:58.581832 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6d456-f894-4bc8-b9b0-c192bbd772b6 None admin] PATH_INFO: `/v3/projects/45c69e3e973c449895457bb610103a43/users/ae87149f6ab04a9997263598737ae27e/roles/ce8c7035b6004d2f84c02ebc4a05f17b` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:58.597925 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6d456-f894-4bc8-b9b0-c192bbd772b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=45c69e3e973c449895457bb610103a43, user_id=ae87149f6ab04a9997263598737ae27e, role_id=ce8c7035b6004d2f84c02ebc4a05f17b)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:58.599869 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6d456-f894-4bc8-b9b0-c192bbd772b6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:58.614640 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 611/1232] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Aug 28 00:44:58 2022] PUT /identity/v3/projects/45c69e3e973c449895457bb610103a43/users/ae87149f6ab04a9997263598737ae27e/roles/ce8c7035b6004d2f84c02ebc4a05f17b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:45:00.619665 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb21d61-85cf-4533-bee6-af36c46de27a None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:00.620247 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb21d61-85cf-4533-bee6-af36c46de27a None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:00.620247 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb21d61-85cf-4533-bee6-af36c46de27a None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:00.621822 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 622/1233] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:00.627715 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00eac14-5823-4510-9cc7-145387b8daeb None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:00.628324 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00eac14-5823-4510-9cc7-145387b8daeb None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:00.628417 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00eac14-5823-4510-9cc7-145387b8daeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:00.652852 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e00eac14-5823-4510-9cc7-145387b8daeb None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:00.655400 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e00eac14-5823-4510-9cc7-145387b8daeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:00.746177 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 612/1234] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:45:01.024287 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb21d61-85cf-4533-bee6-af36c46de27a None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:01.053441 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:01.141196 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb21d61-85cf-4533-bee6-af36c46de27a None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:01.181459 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f66535-946c-42cd-9cd8-465625d2debe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:01.182125 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f66535-946c-42cd-9cd8-465625d2debe None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:01.182403 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f66535-946c-42cd-9cd8-465625d2debe None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:01.182667 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f66535-946c-42cd-9cd8-465625d2debe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:01.194982 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f66535-946c-42cd-9cd8-465625d2debe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:01.201765 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-41f66535-946c-42cd-9cd8-465625d2debe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:01.201765 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:01.201765 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:01.201765 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:01.201765 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:01.201765 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:01.201765 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:01.201765 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:01.201765 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:01.201765 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:01.201765 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:01.201765 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:01.201765 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:01.201765 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:01.201765 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:01.201765 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:01.202965 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:01.202965 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:01.202965 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:01.202965 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:01.202965 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:01.202965 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:01.202965 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:01.202965 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:01.202965 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:01.202965 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:01.202965 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:01.202965 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:01.202965 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:01.202965 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:01.202965 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:01.202965 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:01.203825 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:01.203825 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:01.203825 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:01.203825 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:01.203825 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:01.203825 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:01.203825 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:01.203825 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:01.203825 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:01.203825 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:01.203825 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:01.203825 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:45:01.203825 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 623/1235] 10.222.0.52 () {56 vars in 1102 bytes} [Sun Aug 28 00:45:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:01.209490 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00eac14-5823-4510-9cc7-145387b8daeb None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:01.285890 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:01.354691 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00eac14-5823-4510-9cc7-145387b8daeb None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:01.395048 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4472723-52d2-4a6d-a7c9-4da44a12f636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:01.395660 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4472723-52d2-4a6d-a7c9-4da44a12f636 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:01.395930 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4472723-52d2-4a6d-a7c9-4da44a12f636 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:01.396188 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4472723-52d2-4a6d-a7c9-4da44a12f636 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:01.396858 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4472723-52d2-4a6d-a7c9-4da44a12f636 None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:01.397164 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4472723-52d2-4a6d-a7c9-4da44a12f636 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:01.398574 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4472723-52d2-4a6d-a7c9-4da44a12f636 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:01.407642 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 613/1236] 10.222.0.52 () {56 vars in 1103 bytes} [Sun Aug 28 00:45:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:01.413630 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f66535-946c-42cd-9cd8-465625d2debe None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:01.509765 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:01.527675 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f66535-946c-42cd-9cd8-465625d2debe None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:01.565622 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26589f28-bae6-46f5-8793-501732343760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:01.566375 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26589f28-bae6-46f5-8793-501732343760 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:01.566659 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26589f28-bae6-46f5-8793-501732343760 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:01.566927 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26589f28-bae6-46f5-8793-501732343760 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:01.578629 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26589f28-bae6-46f5-8793-501732343760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:01.580368 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26589f28-bae6-46f5-8793-501732343760 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:01.599621 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-26589f28-bae6-46f5-8793-501732343760 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:01.599621 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:01.599621 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:01.599621 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:01.599621 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:01.599621 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:01.599621 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:01.599621 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:01.599621 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:01.599621 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:01.599621 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:01.599621 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:01.599621 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:01.599621 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:01.599621 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:01.599621 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:01.600871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:01.600871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:01.600871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:01.600871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:01.600871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:01.600871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:01.600871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:01.600871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:01.600871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:01.600871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:01.600871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:01.600871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:01.600871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:01.600871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:01.600871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:01.600871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:01.600871 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:01.601995 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:01.601995 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:01.601995 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:45:01.601995 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 624/1237] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:45:01.607905 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4472723-52d2-4a6d-a7c9-4da44a12f636 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:01.735112 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4472723-52d2-4a6d-a7c9-4da44a12f636 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:01.752025 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:01.790663 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668be92-dcda-4e78-b461-1ff789e89529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:01.791168 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668be92-dcda-4e78-b461-1ff789e89529 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:01.791476 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668be92-dcda-4e78-b461-1ff789e89529 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:01.791739 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668be92-dcda-4e78-b461-1ff789e89529 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:01.792386 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668be92-dcda-4e78-b461-1ff789e89529 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:01.792684 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668be92-dcda-4e78-b461-1ff789e89529 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:01.794147 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668be92-dcda-4e78-b461-1ff789e89529 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:01.808830 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 614/1238] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:01.814895 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26589f28-bae6-46f5-8793-501732343760 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:01.930999 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26589f28-bae6-46f5-8793-501732343760 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:01.968376 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b9787-574c-4741-a807-1307a66f797b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:01.969075 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b9787-574c-4741-a807-1307a66f797b None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:01.969354 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b9787-574c-4741-a807-1307a66f797b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:01.969624 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b9787-574c-4741-a807-1307a66f797b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:01.972399 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:01.978295 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b9787-574c-4741-a807-1307a66f797b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:01.979881 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b9787-574c-4741-a807-1307a66f797b None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:01.992830 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-7b5b9787-574c-4741-a807-1307a66f797b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:45:01.992830 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:01.992830 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:01.992830 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:01.992830 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:01.992830 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:01.992830 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:01.992830 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:01.992830 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:01.992830 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:01.992830 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:01.992830 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:01.992830 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:45:01.992830 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:45:01.992830 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:45:01.992830 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:45:01.994064 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:01.994064 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:01.994064 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:45:01.994064 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:01.994064 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:45:01.994064 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:01.994064 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:01.994064 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:01.994064 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:01.994064 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:01.994064 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:01.994064 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:01.994064 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:01.994064 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:01.994064 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:01.994064 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:01.994064 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:01.994064 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:02.000181 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:02.000181 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:02.000181 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:45:02.000181 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:45:02.000181 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:45:02.000181 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:45:02.000181 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:45:02.000181 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:45:02.000181 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:45:02.000181 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:45:02.000181 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 625/1239] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:02.000937 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668be92-dcda-4e78-b461-1ff789e89529 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:02.117134 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668be92-dcda-4e78-b461-1ff789e89529 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:02.155580 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01d8c0-5502-4999-b063-12e539c300be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:02.156281 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01d8c0-5502-4999-b063-12e539c300be None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:02.156558 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01d8c0-5502-4999-b063-12e539c300be None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:02.156829 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01d8c0-5502-4999-b063-12e539c300be None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:02.157634 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01d8c0-5502-4999-b063-12e539c300be None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:02.157977 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01d8c0-5502-4999-b063-12e539c300be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:02.159749 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01d8c0-5502-4999-b063-12e539c300be None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:02.179830 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 615/1240] 10.222.0.52 () {56 vars in 1143 bytes} [Sun Aug 28 00:45:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:02.185802 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b9787-574c-4741-a807-1307a66f797b None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:02.304565 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b9787-574c-4741-a807-1307a66f797b None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:02.347860 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43010dc-c340-41da-937e-45d037976e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:02.348922 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43010dc-c340-41da-937e-45d037976e44 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:02.349210 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43010dc-c340-41da-937e-45d037976e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:02.349484 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43010dc-c340-41da-937e-45d037976e44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:02.419565 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:02.433123 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43010dc-c340-41da-937e-45d037976e44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:02.434764 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43010dc-c340-41da-937e-45d037976e44 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:02.554374 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 626/1241] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:45:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:45:02.560131 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01d8c0-5502-4999-b063-12e539c300be None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:02.592550 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:02.681129 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01d8c0-5502-4999-b063-12e539c300be None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:02.723738 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189be3a-f854-4ee7-be4b-6e6418b1d508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:02.724371 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189be3a-f854-4ee7-be4b-6e6418b1d508 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:02.724626 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189be3a-f854-4ee7-be4b-6e6418b1d508 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:02.725045 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189be3a-f854-4ee7-be4b-6e6418b1d508 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:02.737185 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189be3a-f854-4ee7-be4b-6e6418b1d508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:02.738857 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189be3a-f854-4ee7-be4b-6e6418b1d508 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:02.756000 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-b189be3a-f854-4ee7-be4b-6e6418b1d508 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:02.756000 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:02.756000 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:02.756000 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:02.756000 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:02.756000 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:02.756000 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:02.756000 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:02.756000 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:02.756000 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:02.756000 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:02.756000 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:02.756000 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:02.756000 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:02.756000 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:02.756000 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:02.758142 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:02.758142 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:02.758142 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:02.758142 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:02.758142 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:02.758142 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:02.758142 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:02.758142 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:02.758142 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:02.758142 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:02.758142 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:02.758142 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:02.758142 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:02.758142 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:02.758142 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:02.758142 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:02.758142 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:02.760006 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:02.760006 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:02.760006 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:45:02.760006 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 616/1242] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:45:02.764056 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43010dc-c340-41da-937e-45d037976e44 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:02.873315 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:02.881125 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43010dc-c340-41da-937e-45d037976e44 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:02.923487 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852fa3f-0e89-4c6f-ba2b-58761488c8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:02.924102 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852fa3f-0e89-4c6f-ba2b-58761488c8c6 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:02.924391 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852fa3f-0e89-4c6f-ba2b-58761488c8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:02.924689 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852fa3f-0e89-4c6f-ba2b-58761488c8c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:02.925697 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852fa3f-0e89-4c6f-ba2b-58761488c8c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:02.926041 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852fa3f-0e89-4c6f-ba2b-58761488c8c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:02.927428 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852fa3f-0e89-4c6f-ba2b-58761488c8c6 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:02.939603 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 627/1243] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:02.945935 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189be3a-f854-4ee7-be4b-6e6418b1d508 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:03.030737 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:03.054223 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189be3a-f854-4ee7-be4b-6e6418b1d508 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:03.093590 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5d86e-43ae-442b-9d1d-05026c215908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:03.094465 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5d86e-43ae-442b-9d1d-05026c215908 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:03.094695 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5d86e-43ae-442b-9d1d-05026c215908 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:03.095008 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5d86e-43ae-442b-9d1d-05026c215908 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:03.105258 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5d86e-43ae-442b-9d1d-05026c215908 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:03.107160 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5d86e-43ae-442b-9d1d-05026c215908 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:03.125379 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-80d5d86e-43ae-442b-9d1d-05026c215908 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:03.125379 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:03.125379 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:03.125379 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:03.125379 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:03.125379 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:03.125379 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:03.125379 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:03.125379 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:03.125379 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:03.125379 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:03.125379 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:03.125379 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:45:03.125379 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:45:03.125379 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:45:03.126511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:45:03.126511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:03.126511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:03.126511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:03.126511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:03.126511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:03.126511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:03.126511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:03.126511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:03.126511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:03.126511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:03.126511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:03.126511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:03.126511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:03.126511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:03.126511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:03.126511 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:03.127751 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:45:03.127751 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:45:03.127751 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:45:03.127751 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:45:03.127751 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:45:03.127751 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:45:03.127751 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:03.127751 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:45:03.127751 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 617/1244] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:03.134358 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852fa3f-0e89-4c6f-ba2b-58761488c8c6 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:03.248206 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852fa3f-0e89-4c6f-ba2b-58761488c8c6 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:03.284839 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd14f3-5aef-4d26-b336-8572619247f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:03.285446 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd14f3-5aef-4d26-b336-8572619247f0 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:03.285722 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd14f3-5aef-4d26-b336-8572619247f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:03.286025 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd14f3-5aef-4d26-b336-8572619247f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:03.286727 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd14f3-5aef-4d26-b336-8572619247f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:03.287049 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd14f3-5aef-4d26-b336-8572619247f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:03.288510 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd14f3-5aef-4d26-b336-8572619247f0 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:03.302933 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 628/1245] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:45:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:03.308992 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5d86e-43ae-442b-9d1d-05026c215908 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:03.422571 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5d86e-43ae-442b-9d1d-05026c215908 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:03.458730 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112a31c-d7e1-4d6e-af68-3bc70c3922a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:03.459500 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112a31c-d7e1-4d6e-af68-3bc70c3922a2 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:03.459846 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112a31c-d7e1-4d6e-af68-3bc70c3922a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:03.460126 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112a31c-d7e1-4d6e-af68-3bc70c3922a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:03.461004 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112a31c-d7e1-4d6e-af68-3bc70c3922a2 None admin] RBAC: Adding query filter params (role.id=ce8c7035b6004d2f84c02ebc4a05f17b, scope.project.id=45c69e3e973c449895457bb610103a43, user.id=ae87149f6ab04a9997263598737ae27e) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:03.461313 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112a31c-d7e1-4d6e-af68-3bc70c3922a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:03.462816 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112a31c-d7e1-4d6e-af68-3bc70c3922a2 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:03.469071 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 618/1246] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:45:03 2022] GET /identity/v3/role_assignments?user.id=ae87149f6ab04a9997263598737ae27e&scope.project.id=45c69e3e973c449895457bb610103a43&role.id=ce8c7035b6004d2f84c02ebc4a05f17b => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:05.569939 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d6e7c-aa5a-4c2f-b939-2293b018ab3b None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:05.570481 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d6e7c-aa5a-4c2f-b939-2293b018ab3b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:05.570481 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d6e7c-aa5a-4c2f-b939-2293b018ab3b None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:05.571854 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 629/1247] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:05.577772 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19800576-133a-48f2-a6dd-8a3c81bf9c19 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:05.578245 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19800576-133a-48f2-a6dd-8a3c81bf9c19 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:05.578438 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19800576-133a-48f2-a6dd-8a3c81bf9c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:05.585201 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:05.600076 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-19800576-133a-48f2-a6dd-8a3c81bf9c19 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:05.601307 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-19800576-133a-48f2-a6dd-8a3c81bf9c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:05.686602 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 619/1248] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:45:06.008588 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d6e7c-aa5a-4c2f-b939-2293b018ab3b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:06.031229 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:06.134690 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d6e7c-aa5a-4c2f-b939-2293b018ab3b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:06.175050 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f30c3-da2b-4c3f-b27b-3aa7a0a512c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:06.175817 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f30c3-da2b-4c3f-b27b-3aa7a0a512c7 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:06.176191 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f30c3-da2b-4c3f-b27b-3aa7a0a512c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:06.176566 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f30c3-da2b-4c3f-b27b-3aa7a0a512c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:06.188151 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f30c3-da2b-4c3f-b27b-3aa7a0a512c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:06.193138 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-c13f30c3-da2b-4c3f-b27b-3aa7a0a512c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:45:06.193138 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:06.193138 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:06.193138 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:06.193138 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:06.193138 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:06.193138 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:06.193138 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:06.193138 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:06.193138 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:06.193138 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:06.193138 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:06.193138 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:06.193138 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:06.193138 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:06.193138 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:06.194525 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:06.194525 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:06.194525 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:06.194525 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:06.194525 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:06.194525 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:06.194525 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:06.194525 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:06.194525 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:06.194525 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:06.194525 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:06.194525 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:06.194525 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:06.194525 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:06.194525 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:06.194525 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:06.195688 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:06.195688 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:06.195688 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:06.195688 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:06.195688 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:06.195688 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:06.195688 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:06.195688 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:06.195688 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:06.195688 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:06.195688 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:45:06.195688 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:45:06.195688 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 630/1249] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:45:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:06.200534 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19800576-133a-48f2-a6dd-8a3c81bf9c19 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:06.318580 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19800576-133a-48f2-a6dd-8a3c81bf9c19 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:06.355446 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:06.362424 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900b69b-2edf-432a-861f-ef7a32fe97a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:06.363312 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900b69b-2edf-432a-861f-ef7a32fe97a8 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:06.363723 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900b69b-2edf-432a-861f-ef7a32fe97a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:06.364005 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900b69b-2edf-432a-861f-ef7a32fe97a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:06.364706 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900b69b-2edf-432a-861f-ef7a32fe97a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:06.365012 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900b69b-2edf-432a-861f-ef7a32fe97a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:06.366449 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900b69b-2edf-432a-861f-ef7a32fe97a8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:06.376410 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 620/1250] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:45:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:06.382343 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f30c3-da2b-4c3f-b27b-3aa7a0a512c7 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:06.472210 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:06.502344 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f30c3-da2b-4c3f-b27b-3aa7a0a512c7 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:06.545426 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee2520-c014-4f02-bac4-0ba1652d62a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:06.546094 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee2520-c014-4f02-bac4-0ba1652d62a8 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:06.546397 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee2520-c014-4f02-bac4-0ba1652d62a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:06.546635 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee2520-c014-4f02-bac4-0ba1652d62a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:06.557387 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee2520-c014-4f02-bac4-0ba1652d62a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:06.558966 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee2520-c014-4f02-bac4-0ba1652d62a8 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:06.576904 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-24ee2520-c014-4f02-bac4-0ba1652d62a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:06.576904 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:06.576904 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:06.576904 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:06.576904 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:06.576904 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:06.576904 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:06.576904 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:06.576904 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:06.576904 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:06.576904 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:06.576904 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:06.576904 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:06.576904 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:06.576904 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:06.576904 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:06.579004 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:06.579004 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:06.579004 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:06.579004 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:06.579004 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:06.579004 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:06.579004 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:06.579004 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:06.579004 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:06.579004 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:06.579004 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:06.579004 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:06.579004 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:06.579004 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:06.579004 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:06.579004 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:06.579004 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:06.580541 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:06.580541 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:06.580541 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:45:06.582890 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 631/1251] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:06.584101 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900b69b-2edf-432a-861f-ef7a32fe97a8 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:06.706828 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900b69b-2edf-432a-861f-ef7a32fe97a8 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:06.747225 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14e474-4671-4b65-b232-5ea2eb2f9d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:06.748019 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14e474-4671-4b65-b232-5ea2eb2f9d9a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:06.748338 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14e474-4671-4b65-b232-5ea2eb2f9d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:06.748752 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14e474-4671-4b65-b232-5ea2eb2f9d9a None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:06.749867 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee14e474-4671-4b65-b232-5ea2eb2f9d9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:06.750299 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee14e474-4671-4b65-b232-5ea2eb2f9d9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:06.751930 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee14e474-4671-4b65-b232-5ea2eb2f9d9a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:06.767599 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 621/1252] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:06.773807 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee2520-c014-4f02-bac4-0ba1652d62a8 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:06.893299 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee2520-c014-4f02-bac4-0ba1652d62a8 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:06.921496 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:06.931858 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8219124-c434-420a-8973-209b78628975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:06.932926 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8219124-c434-420a-8973-209b78628975 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:06.933306 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8219124-c434-420a-8973-209b78628975 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:06.933813 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8219124-c434-420a-8973-209b78628975 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:06.944063 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8219124-c434-420a-8973-209b78628975 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:06.945589 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8219124-c434-420a-8973-209b78628975 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:06.957183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-e8219124-c434-420a-8973-209b78628975 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:45:06.957183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:06.957183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:06.957183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:06.957183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:06.957183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:06.957183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:06.957183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:06.957183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:06.957183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:06.957183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:06.957183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:06.957183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:45:06.957183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:45:06.957183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:45:06.957183 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:45:06.958338 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:06.958338 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:06.958338 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:45:06.958338 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:06.958338 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:45:06.958338 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:06.958338 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:06.958338 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:06.958338 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:06.958338 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:06.958338 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:06.958338 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:06.958338 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:06.958338 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:06.958338 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:06.958338 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:06.958338 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:06.958338 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:06.959343 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:06.959343 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:06.959343 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:45:06.959343 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:45:06.959343 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:45:06.959343 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:45:06.959343 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:45:06.959343 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:45:06.959343 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:45:06.959343 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:45:06.959343 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 632/1253] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:06.964394 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14e474-4671-4b65-b232-5ea2eb2f9d9a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:07.035232 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:07.092353 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14e474-4671-4b65-b232-5ea2eb2f9d9a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:07.137125 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66cd6a-6af2-432e-9924-409daa536fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:07.137883 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66cd6a-6af2-432e-9924-409daa536fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:07.138112 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66cd6a-6af2-432e-9924-409daa536fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:07.138513 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66cd6a-6af2-432e-9924-409daa536fa0 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:07.139832 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66cd6a-6af2-432e-9924-409daa536fa0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:07.140251 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66cd6a-6af2-432e-9924-409daa536fa0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:07.141905 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66cd6a-6af2-432e-9924-409daa536fa0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:07.160524 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 622/1254] 10.222.0.52 () {56 vars in 1143 bytes} [Sun Aug 28 00:45:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:07.166295 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8219124-c434-420a-8973-209b78628975 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:07.292942 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8219124-c434-420a-8973-209b78628975 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:07.338972 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87607519-7910-417c-8878-fd91ef9d22bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:07.339561 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87607519-7910-417c-8878-fd91ef9d22bc None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:07.339839 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87607519-7910-417c-8878-fd91ef9d22bc None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:07.340107 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87607519-7910-417c-8878-fd91ef9d22bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:07.406049 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:07.422665 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87607519-7910-417c-8878-fd91ef9d22bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:07.424073 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87607519-7910-417c-8878-fd91ef9d22bc None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:07.541049 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 633/1255] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:45:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:45:07.548133 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66cd6a-6af2-432e-9924-409daa536fa0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:07.658340 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66cd6a-6af2-432e-9924-409daa536fa0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:07.671870 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:07.692965 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b380619-d196-46a8-b27f-50ec5db0726f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:07.693599 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b380619-d196-46a8-b27f-50ec5db0726f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:07.693900 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b380619-d196-46a8-b27f-50ec5db0726f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:07.694169 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b380619-d196-46a8-b27f-50ec5db0726f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:07.704417 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b380619-d196-46a8-b27f-50ec5db0726f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:07.706203 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b380619-d196-46a8-b27f-50ec5db0726f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:07.722008 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-0b380619-d196-46a8-b27f-50ec5db0726f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:07.722008 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:07.722008 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:07.722008 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:07.722008 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:07.722008 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:07.722008 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:07.722008 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:07.722008 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:07.722008 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:07.722008 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:07.722008 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:07.722008 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:07.722008 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:07.722008 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:07.722008 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:07.723159 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:07.723159 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:07.723159 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:07.723159 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:07.723159 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:07.723159 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:07.723159 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:07.723159 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:07.723159 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:07.723159 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:07.723159 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:07.723159 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:07.723159 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:07.723159 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:07.723159 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:07.723159 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:07.723159 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:07.724658 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:07.724658 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:07.724658 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:45:07.724658 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 623/1256] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:07.730573 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87607519-7910-417c-8878-fd91ef9d22bc None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:07.820111 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:07.837476 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87607519-7910-417c-8878-fd91ef9d22bc None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:07.878057 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301ce59-558e-4e17-812b-d0974c34a3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:07.878760 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301ce59-558e-4e17-812b-d0974c34a3ef None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:07.879104 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301ce59-558e-4e17-812b-d0974c34a3ef None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:07.879442 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301ce59-558e-4e17-812b-d0974c34a3ef None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:07.880148 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301ce59-558e-4e17-812b-d0974c34a3ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:07.880512 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301ce59-558e-4e17-812b-d0974c34a3ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:07.881979 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301ce59-558e-4e17-812b-d0974c34a3ef None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:07.893337 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 634/1257] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:07.899068 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b380619-d196-46a8-b27f-50ec5db0726f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:08.024434 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b380619-d196-46a8-b27f-50ec5db0726f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:08.063271 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34eca8c-525f-47c9-a5df-175e837d4be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:08.063934 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34eca8c-525f-47c9-a5df-175e837d4be5 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:08.064210 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34eca8c-525f-47c9-a5df-175e837d4be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:08.064475 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34eca8c-525f-47c9-a5df-175e837d4be5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:08.073090 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34eca8c-525f-47c9-a5df-175e837d4be5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:08.074967 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34eca8c-525f-47c9-a5df-175e837d4be5 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:08.093042 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-c34eca8c-525f-47c9-a5df-175e837d4be5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:08.093042 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:08.093042 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:08.093042 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:08.093042 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:08.093042 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:08.093042 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:08.093042 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:08.093042 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:08.093042 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:08.093042 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:08.093042 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:08.093042 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:45:08.093042 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:45:08.093042 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:45:08.094315 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:45:08.094315 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:08.094315 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:08.094315 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:08.094315 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:08.094315 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:08.094315 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:08.094315 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:08.094315 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:08.094315 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:08.094315 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:08.094315 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:08.094315 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:08.094315 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:08.094315 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:08.094315 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:08.094315 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:08.095453 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:45:08.095453 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:45:08.095453 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:45:08.095453 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:45:08.095453 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:45:08.095453 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:45:08.095453 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:08.095453 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:45:08.095453 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 624/1258] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:08.101649 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301ce59-558e-4e17-812b-d0974c34a3ef None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:08.216273 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301ce59-558e-4e17-812b-d0974c34a3ef None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:08.252645 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f115e8c-2a83-4705-981c-c1c1b70b087d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:08.253254 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f115e8c-2a83-4705-981c-c1c1b70b087d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:08.253551 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f115e8c-2a83-4705-981c-c1c1b70b087d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:08.253804 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f115e8c-2a83-4705-981c-c1c1b70b087d None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:08.254594 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f115e8c-2a83-4705-981c-c1c1b70b087d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:08.254964 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f115e8c-2a83-4705-981c-c1c1b70b087d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:08.256711 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f115e8c-2a83-4705-981c-c1c1b70b087d None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:08.271680 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 635/1259] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:45:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:08.279027 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34eca8c-525f-47c9-a5df-175e837d4be5 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:08.308455 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:08.391204 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34eca8c-525f-47c9-a5df-175e837d4be5 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:08.440254 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc15a0-2c3f-4f71-8bbf-1eccd8da4ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:08.440902 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc15a0-2c3f-4f71-8bbf-1eccd8da4ccc None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:08.441183 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc15a0-2c3f-4f71-8bbf-1eccd8da4ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:08.441476 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc15a0-2c3f-4f71-8bbf-1eccd8da4ccc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:08.442332 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc15a0-2c3f-4f71-8bbf-1eccd8da4ccc None admin] RBAC: Adding query filter params (role.id=cc013581bb07418d9ec6a3a1d282ea53, scope.project.id=45c69e3e973c449895457bb610103a43, user.id=ae87149f6ab04a9997263598737ae27e) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:08.442677 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc15a0-2c3f-4f71-8bbf-1eccd8da4ccc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:08.444242 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc15a0-2c3f-4f71-8bbf-1eccd8da4ccc None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:08.451393 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 625/1260] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:45:08 2022] GET /identity/v3/role_assignments?user.id=ae87149f6ab04a9997263598737ae27e&scope.project.id=45c69e3e973c449895457bb610103a43&role.id=cc013581bb07418d9ec6a3a1d282ea53 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:10.516777 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516ec9c-4dc3-4482-a1d6-2eaf3ed9e3db None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:10.517333 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516ec9c-4dc3-4482-a1d6-2eaf3ed9e3db None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:10.517333 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516ec9c-4dc3-4482-a1d6-2eaf3ed9e3db None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:10.518686 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 636/1261] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:10.524662 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d7f18-3d32-4114-9732-248ca54edc18 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:10.525345 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d7f18-3d32-4114-9732-248ca54edc18 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:10.525524 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d7f18-3d32-4114-9732-248ca54edc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:10.554757 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-451d7f18-3d32-4114-9732-248ca54edc18 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:10.556791 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-451d7f18-3d32-4114-9732-248ca54edc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:10.633617 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 626/1262] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:45:10.907102 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516ec9c-4dc3-4482-a1d6-2eaf3ed9e3db None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:10.920484 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:11.021484 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516ec9c-4dc3-4482-a1d6-2eaf3ed9e3db None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:11.058525 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51163298-0f3d-4778-bcbf-55ef3a30eae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:11.059146 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51163298-0f3d-4778-bcbf-55ef3a30eae6 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:11.059424 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51163298-0f3d-4778-bcbf-55ef3a30eae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:11.059693 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51163298-0f3d-4778-bcbf-55ef3a30eae6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:11.071312 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51163298-0f3d-4778-bcbf-55ef3a30eae6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:11.076949 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-51163298-0f3d-4778-bcbf-55ef3a30eae6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:45:11.076949 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:11.076949 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:11.076949 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:11.076949 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:11.076949 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:11.076949 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:11.076949 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:11.076949 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:11.076949 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:11.076949 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:11.076949 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:11.076949 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:11.076949 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:11.076949 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:11.076949 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:11.078069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:11.078069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:11.078069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:11.078069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:11.078069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:11.078069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:11.078069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:11.078069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:11.078069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:11.078069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:11.078069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:11.078069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:11.078069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:11.078069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:11.078069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:11.078069 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:11.079100 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:11.079100 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:11.079100 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:11.079100 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:11.079100 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:11.079100 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:11.079100 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:11.079100 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:11.079100 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:11.079100 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:11.079100 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:45:11.079100 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:45:11.079100 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 637/1263] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:45:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:11.084956 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d7f18-3d32-4114-9732-248ca54edc18 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:11.109899 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:11.212301 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d7f18-3d32-4114-9732-248ca54edc18 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:11.248710 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62627e14-0475-4282-9587-531dc3631d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:11.249305 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62627e14-0475-4282-9587-531dc3631d76 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:11.249581 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62627e14-0475-4282-9587-531dc3631d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:11.249886 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62627e14-0475-4282-9587-531dc3631d76 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:11.250536 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62627e14-0475-4282-9587-531dc3631d76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:11.250842 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62627e14-0475-4282-9587-531dc3631d76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:11.252222 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62627e14-0475-4282-9587-531dc3631d76 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:11.260357 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 627/1264] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:45:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:11.267023 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51163298-0f3d-4778-bcbf-55ef3a30eae6 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:11.337152 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:11.373456 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51163298-0f3d-4778-bcbf-55ef3a30eae6 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:11.412892 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c864f5-7789-4df4-9941-0273f96dcea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:11.413510 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c864f5-7789-4df4-9941-0273f96dcea1 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:11.413783 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c864f5-7789-4df4-9941-0273f96dcea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:11.414065 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c864f5-7789-4df4-9941-0273f96dcea1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:11.426139 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c864f5-7789-4df4-9941-0273f96dcea1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:11.427577 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c864f5-7789-4df4-9941-0273f96dcea1 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:11.442494 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-99c864f5-7789-4df4-9941-0273f96dcea1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:11.442494 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:11.442494 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:11.442494 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:11.442494 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:11.442494 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:11.442494 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:11.442494 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:11.442494 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:11.442494 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:11.442494 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:11.442494 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:11.442494 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:11.442494 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:11.442494 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:11.442494 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:11.443591 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:11.443591 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:11.443591 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:11.443591 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:11.443591 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:11.443591 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:11.443591 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:11.443591 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:11.443591 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:11.443591 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:11.443591 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:11.443591 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:11.443591 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:11.443591 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:11.443591 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:11.443591 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:11.443591 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:11.444818 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:11.444818 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:11.444818 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:45:11.444818 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 638/1265] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:11.449556 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62627e14-0475-4282-9587-531dc3631d76 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:11.537893 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:11.567080 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62627e14-0475-4282-9587-531dc3631d76 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:11.601225 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d0fe2-b7d9-4888-af10-7f25ef3bdd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:11.601826 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d0fe2-b7d9-4888-af10-7f25ef3bdd56 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:11.602139 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d0fe2-b7d9-4888-af10-7f25ef3bdd56 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:11.602414 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d0fe2-b7d9-4888-af10-7f25ef3bdd56 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:11.603059 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d0fe2-b7d9-4888-af10-7f25ef3bdd56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:11.603364 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d0fe2-b7d9-4888-af10-7f25ef3bdd56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:11.604749 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d0fe2-b7d9-4888-af10-7f25ef3bdd56 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:11.616768 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 628/1266] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:11.622736 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c864f5-7789-4df4-9941-0273f96dcea1 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:11.746047 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c864f5-7789-4df4-9941-0273f96dcea1 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:11.767871 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:11.784743 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f937b8-573c-42b8-9e1c-6cb810a9ab21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:11.785365 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f937b8-573c-42b8-9e1c-6cb810a9ab21 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:11.785641 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f937b8-573c-42b8-9e1c-6cb810a9ab21 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:11.785937 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f937b8-573c-42b8-9e1c-6cb810a9ab21 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:11.793822 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f937b8-573c-42b8-9e1c-6cb810a9ab21 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:11.795859 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f937b8-573c-42b8-9e1c-6cb810a9ab21 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:11.806689 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-70f937b8-573c-42b8-9e1c-6cb810a9ab21 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:45:11.806689 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:11.806689 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:11.806689 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:11.806689 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:11.806689 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:11.806689 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:11.806689 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:11.806689 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:11.806689 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:11.806689 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:11.806689 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:11.806689 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:45:11.806689 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:45:11.806689 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:45:11.806689 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:45:11.807752 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:11.807752 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:11.807752 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:45:11.807752 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:11.807752 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:45:11.807752 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:11.807752 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:11.807752 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:11.807752 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:11.807752 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:11.807752 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:11.807752 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:11.807752 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:11.807752 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:11.807752 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:11.807752 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:11.807752 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:11.807752 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:11.808692 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:11.808692 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:11.808692 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:45:11.808692 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:45:11.808692 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:45:11.808692 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:45:11.808692 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:45:11.808692 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:45:11.808692 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:45:11.808692 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:45:11.808692 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 639/1267] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:11.814142 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d0fe2-b7d9-4888-af10-7f25ef3bdd56 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:11.921592 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d0fe2-b7d9-4888-af10-7f25ef3bdd56 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:11.958111 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65c67a-685e-4ae5-bb4a-6fda773a6a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:11.958702 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65c67a-685e-4ae5-bb4a-6fda773a6a36 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:11.958979 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65c67a-685e-4ae5-bb4a-6fda773a6a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:11.959246 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65c67a-685e-4ae5-bb4a-6fda773a6a36 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:11.960018 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65c67a-685e-4ae5-bb4a-6fda773a6a36 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:11.960380 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65c67a-685e-4ae5-bb4a-6fda773a6a36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:11.962030 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65c67a-685e-4ae5-bb4a-6fda773a6a36 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:11.971414 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:11.988133 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 629/1268] 10.222.0.52 () {56 vars in 1143 bytes} [Sun Aug 28 00:45:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:11.999698 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f937b8-573c-42b8-9e1c-6cb810a9ab21 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:12.130323 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f937b8-573c-42b8-9e1c-6cb810a9ab21 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:12.166000 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b60f7-3ebc-4671-bd36-bc0235ef2b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:12.166619 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b60f7-3ebc-4671-bd36-bc0235ef2b42 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:12.166896 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b60f7-3ebc-4671-bd36-bc0235ef2b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:12.167169 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b60f7-3ebc-4671-bd36-bc0235ef2b42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:12.179581 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b60f7-3ebc-4671-bd36-bc0235ef2b42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:12.181031 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b60f7-3ebc-4671-bd36-bc0235ef2b42 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:12.195628 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-b38b60f7-3ebc-4671-bd36-bc0235ef2b42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:12.195628 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:12.195628 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:12.195628 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:12.195628 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:12.195628 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:12.195628 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:12.195628 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:12.195628 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:12.195628 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:12.195628 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:12.195628 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:12.195628 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:12.195628 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:12.195628 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:12.195628 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:12.196600 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:12.196600 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:12.196600 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:12.196600 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:12.196600 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:12.196600 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:12.196600 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:12.196600 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:12.196600 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:12.196600 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:12.196600 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:12.196600 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:12.196600 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:12.196600 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:12.196600 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:12.196600 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:12.196600 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:12.197648 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:12.197648 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:12.197648 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:45:12.197648 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 640/1269] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:12.203519 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65c67a-685e-4ae5-bb4a-6fda773a6a36 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:12.306370 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65c67a-685e-4ae5-bb4a-6fda773a6a36 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:12.339680 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06486c39-b77f-4722-8aa9-580338406b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:12.340305 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06486c39-b77f-4722-8aa9-580338406b62 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:12.340580 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06486c39-b77f-4722-8aa9-580338406b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:12.340851 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06486c39-b77f-4722-8aa9-580338406b62 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:12.341494 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06486c39-b77f-4722-8aa9-580338406b62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:12.341942 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06486c39-b77f-4722-8aa9-580338406b62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:12.343327 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06486c39-b77f-4722-8aa9-580338406b62 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:12.355642 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 630/1270] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:12.365441 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b60f7-3ebc-4671-bd36-bc0235ef2b42 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:12.405305 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:12.492066 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b60f7-3ebc-4671-bd36-bc0235ef2b42 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:12.524454 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1e110-7a35-4a5a-b70d-3802807257ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:12.525063 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1e110-7a35-4a5a-b70d-3802807257ba None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:12.525337 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1e110-7a35-4a5a-b70d-3802807257ba None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:12.525604 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1e110-7a35-4a5a-b70d-3802807257ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:12.532451 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1e110-7a35-4a5a-b70d-3802807257ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:12.533950 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1e110-7a35-4a5a-b70d-3802807257ba None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:12.546169 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-48c1e110-7a35-4a5a-b70d-3802807257ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:12.546169 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:12.546169 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:12.546169 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:12.546169 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:12.546169 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:12.546169 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:12.546169 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:12.546169 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:12.546169 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:12.546169 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:12.546169 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:12.546169 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:45:12.546169 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:45:12.546169 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:45:12.547209 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:45:12.547209 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:12.547209 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:12.547209 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:12.547209 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:12.547209 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:12.547209 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:12.547209 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:12.547209 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:12.547209 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:12.547209 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:12.547209 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:12.547209 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:12.547209 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:12.547209 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:12.547209 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:12.547209 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:12.548496 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:45:12.548496 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:45:12.548496 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:45:12.548496 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:45:12.548496 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:45:12.548496 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:45:12.548496 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:12.548496 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:45:12.548496 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 641/1271] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:12.553311 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06486c39-b77f-4722-8aa9-580338406b62 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:12.611841 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:12.652573 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06486c39-b77f-4722-8aa9-580338406b62 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:12.684752 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7919a3-acfa-4b50-8a09-d59d65af6f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:12.685349 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7919a3-acfa-4b50-8a09-d59d65af6f81 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:12.685627 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7919a3-acfa-4b50-8a09-d59d65af6f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:12.686027 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7919a3-acfa-4b50-8a09-d59d65af6f81 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:12.686721 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7919a3-acfa-4b50-8a09-d59d65af6f81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:12.687043 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7919a3-acfa-4b50-8a09-d59d65af6f81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:12.688462 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7919a3-acfa-4b50-8a09-d59d65af6f81 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:12.700023 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 631/1272] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:45:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:12.706672 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1e110-7a35-4a5a-b70d-3802807257ba None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:12.813748 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:12.825959 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1e110-7a35-4a5a-b70d-3802807257ba None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:12.864916 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6901ba0-8f71-4c6a-8ff2-3bc134b486ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:12.865562 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6901ba0-8f71-4c6a-8ff2-3bc134b486ee None admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:12.865834 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6901ba0-8f71-4c6a-8ff2-3bc134b486ee None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:12.866140 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6901ba0-8f71-4c6a-8ff2-3bc134b486ee None admin] PATH_INFO: `/v3/projects/45c69e3e973c449895457bb610103a43/users/ae87149f6ab04a9997263598737ae27e/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:12.868239 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6901ba0-8f71-4c6a-8ff2-3bc134b486ee None admin] RBAC: Authorizing `identity:create_grant(project_id=45c69e3e973c449895457bb610103a43, user_id=ae87149f6ab04a9997263598737ae27e, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:12.869678 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6901ba0-8f71-4c6a-8ff2-3bc134b486ee None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:12.885681 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 642/1273] 10.222.0.52 () {58 vars in 1439 bytes} [Sun Aug 28 00:45:12 2022] PUT /identity/v3/projects/45c69e3e973c449895457bb610103a43/users/ae87149f6ab04a9997263598737ae27e/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:45:14.810666 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c078ae1-4c8f-4746-8ddd-87feac5c7091 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:14.811510 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c078ae1-4c8f-4746-8ddd-87feac5c7091 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:14.811510 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c078ae1-4c8f-4746-8ddd-87feac5c7091 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:14.813714 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 632/1274] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:45:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:14.819093 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1273d7-ffe8-4717-9183-d6ac2b7af356 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:14.819528 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1273d7-ffe8-4717-9183-d6ac2b7af356 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:14.819627 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1273d7-ffe8-4717-9183-d6ac2b7af356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:14.839041 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-9a1273d7-ffe8-4717-9183-d6ac2b7af356 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:14.840219 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9a1273d7-ffe8-4717-9183-d6ac2b7af356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:14.915997 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 643/1275] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:45:15.180606 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c078ae1-4c8f-4746-8ddd-87feac5c7091 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:15.292954 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c078ae1-4c8f-4746-8ddd-87feac5c7091 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:15.318989 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:15.345942 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02c00f-d9f8-466a-9ab9-98b2b7fe571a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:15.346595 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02c00f-d9f8-466a-9ab9-98b2b7fe571a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:15.346871 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02c00f-d9f8-466a-9ab9-98b2b7fe571a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:15.347222 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02c00f-d9f8-466a-9ab9-98b2b7fe571a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:15.359752 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02c00f-d9f8-466a-9ab9-98b2b7fe571a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:15.365047 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-bd02c00f-d9f8-466a-9ab9-98b2b7fe571a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:45:15.365047 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:15.365047 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:15.365047 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:15.365047 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:15.365047 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:15.365047 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:15.365047 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:15.365047 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:15.365047 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:15.365047 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:15.365047 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:15.365047 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:15.365047 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:15.365047 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:15.365047 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:15.366275 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:15.366275 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:15.366275 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:15.366275 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:15.366275 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:15.366275 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:15.366275 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:15.366275 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:15.366275 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:15.366275 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:15.366275 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:15.366275 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:15.366275 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:15.366275 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:15.366275 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:15.366275 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:15.367195 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:15.367195 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:15.367195 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:15.367195 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:15.367195 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:15.367195 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:15.367195 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:15.367195 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:15.367195 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:15.367195 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:15.367195 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:45:15.367195 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:45:15.367195 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 633/1276] 10.222.0.52 () {56 vars in 1096 bytes} [Sun Aug 28 00:45:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:15.372450 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1273d7-ffe8-4717-9183-d6ac2b7af356 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:15.459534 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:15.485562 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1273d7-ffe8-4717-9183-d6ac2b7af356 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:15.519715 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490f429-85c4-44af-a42a-361754956aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:15.520305 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490f429-85c4-44af-a42a-361754956aee None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:15.520581 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490f429-85c4-44af-a42a-361754956aee None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:15.520868 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490f429-85c4-44af-a42a-361754956aee None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:15.521542 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f490f429-85c4-44af-a42a-361754956aee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:15.521825 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f490f429-85c4-44af-a42a-361754956aee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:15.523207 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f490f429-85c4-44af-a42a-361754956aee None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:15.533607 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 644/1277] 10.222.0.52 () {56 vars in 1099 bytes} [Sun Aug 28 00:45:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:15.539411 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02c00f-d9f8-466a-9ab9-98b2b7fe571a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:15.639272 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02c00f-d9f8-466a-9ab9-98b2b7fe571a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:15.675754 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148bbb63-644e-4173-9143-baec6b3cdcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:15.676362 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bbb63-644e-4173-9143-baec6b3cdcf5 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:15.676631 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bbb63-644e-4173-9143-baec6b3cdcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:15.676904 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bbb63-644e-4173-9143-baec6b3cdcf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:15.687223 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148bbb63-644e-4173-9143-baec6b3cdcf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:15.688719 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148bbb63-644e-4173-9143-baec6b3cdcf5 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:15.703917 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-148bbb63-644e-4173-9143-baec6b3cdcf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:15.703917 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:15.703917 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:15.703917 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:15.703917 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:15.703917 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:15.703917 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:15.703917 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:15.703917 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:15.703917 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:15.703917 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:15.703917 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:15.703917 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:15.703917 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:15.703917 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:15.703917 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:15.705034 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:15.705034 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:15.705034 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:15.705034 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:15.705034 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:15.705034 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:15.705034 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:15.705034 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:15.705034 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:15.705034 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:15.705034 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:15.705034 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:15.705034 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:15.705034 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:15.705034 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:15.705034 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:15.705034 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:15.706384 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:15.706384 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:15.706384 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:45:15.706384 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 634/1278] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:15.711174 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490f429-85c4-44af-a42a-361754956aee None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:15.816224 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490f429-85c4-44af-a42a-361754956aee None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:15.849953 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e110973-877a-42bf-863a-6f371cc3c2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:15.850539 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e110973-877a-42bf-863a-6f371cc3c2ff None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:15.850811 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e110973-877a-42bf-863a-6f371cc3c2ff None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:15.851079 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e110973-877a-42bf-863a-6f371cc3c2ff None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:15.851743 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e110973-877a-42bf-863a-6f371cc3c2ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:15.852047 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e110973-877a-42bf-863a-6f371cc3c2ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:15.853455 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e110973-877a-42bf-863a-6f371cc3c2ff None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:15.865088 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 645/1279] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:15.870884 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148bbb63-644e-4173-9143-baec6b3cdcf5 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:15.905907 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:16.001815 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148bbb63-644e-4173-9143-baec6b3cdcf5 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:16.034570 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a499e9-b1c3-46dd-92f8-3f79b6fd4d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:16.035180 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a499e9-b1c3-46dd-92f8-3f79b6fd4d02 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:16.035458 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a499e9-b1c3-46dd-92f8-3f79b6fd4d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:16.035728 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a499e9-b1c3-46dd-92f8-3f79b6fd4d02 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:16.042945 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a499e9-b1c3-46dd-92f8-3f79b6fd4d02 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:16.044402 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a499e9-b1c3-46dd-92f8-3f79b6fd4d02 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:16.055360 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-22a499e9-b1c3-46dd-92f8-3f79b6fd4d02 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:45:16.055360 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:16.055360 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:16.055360 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:16.055360 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:16.055360 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:16.055360 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:16.055360 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:16.055360 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:16.055360 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:16.055360 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:16.055360 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:16.055360 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:45:16.055360 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:45:16.055360 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:45:16.055360 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:45:16.056499 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:16.056499 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:16.056499 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:45:16.056499 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:16.056499 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:45:16.056499 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:16.056499 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:16.056499 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:16.056499 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:16.056499 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:16.056499 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:16.056499 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:16.056499 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:16.056499 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:16.056499 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:16.056499 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:16.056499 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:16.056499 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:16.058106 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:16.058106 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:16.058106 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:45:16.058106 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:45:16.058106 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:45:16.058106 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:45:16.058106 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:45:16.058106 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:45:16.058106 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:45:16.058106 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:45:16.058106 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 635/1280] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:16.063860 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e110973-877a-42bf-863a-6f371cc3c2ff None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:16.067716 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:16.171417 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e110973-877a-42bf-863a-6f371cc3c2ff None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:16.214173 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bb9fe-61a7-4f00-95cc-f7bd4319b3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:16.215024 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bb9fe-61a7-4f00-95cc-f7bd4319b3c8 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:16.215385 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bb9fe-61a7-4f00-95cc-f7bd4319b3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:16.215733 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bb9fe-61a7-4f00-95cc-f7bd4319b3c8 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:16.217097 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040bb9fe-61a7-4f00-95cc-f7bd4319b3c8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:16.217380 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040bb9fe-61a7-4f00-95cc-f7bd4319b3c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:16.219314 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040bb9fe-61a7-4f00-95cc-f7bd4319b3c8 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:16.243459 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 646/1281] 10.222.0.52 () {56 vars in 1143 bytes} [Sun Aug 28 00:45:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:16.250135 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a499e9-b1c3-46dd-92f8-3f79b6fd4d02 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:16.358481 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:16.375282 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a499e9-b1c3-46dd-92f8-3f79b6fd4d02 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:16.419770 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6f253-9cd8-4446-857f-7ab00334f2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:16.420374 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6f253-9cd8-4446-857f-7ab00334f2d2 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:16.420650 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6f253-9cd8-4446-857f-7ab00334f2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:16.420913 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6f253-9cd8-4446-857f-7ab00334f2d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:16.489979 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d6f253-9cd8-4446-857f-7ab00334f2d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:16.491433 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d6f253-9cd8-4446-857f-7ab00334f2d2 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:16.606761 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:16.626322 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 636/1282] 10.222.0.52 () {58 vars in 1282 bytes} [Sun Aug 28 00:45:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:45:16.632699 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bb9fe-61a7-4f00-95cc-f7bd4319b3c8 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:16.705047 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:16.751152 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bb9fe-61a7-4f00-95cc-f7bd4319b3c8 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:16.790115 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef70e79-dfa1-43d2-92e2-bde83d9e1989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:16.790721 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef70e79-dfa1-43d2-92e2-bde83d9e1989 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:16.790995 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef70e79-dfa1-43d2-92e2-bde83d9e1989 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:16.791255 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef70e79-dfa1-43d2-92e2-bde83d9e1989 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:16.801884 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef70e79-dfa1-43d2-92e2-bde83d9e1989 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:16.803351 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef70e79-dfa1-43d2-92e2-bde83d9e1989 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:16.818032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-8ef70e79-dfa1-43d2-92e2-bde83d9e1989 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:16.818032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:16.818032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:16.818032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:16.818032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:16.818032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:16.818032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:16.818032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:16.818032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:16.818032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:16.818032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:16.818032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:16.818032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:16.818032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:16.818032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:16.818032 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:16.819370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:16.819370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:16.819370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:16.819370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:16.819370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:16.819370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:16.819370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:16.819370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:16.819370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:16.819370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:16.819370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:16.819370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:16.819370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:16.819370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:16.819370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:16.819370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:16.819370 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:16.820921 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:16.820921 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:16.820921 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:45:16.820921 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 647/1283] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:16.828488 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6f253-9cd8-4446-857f-7ab00334f2d2 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:16.948633 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6f253-9cd8-4446-857f-7ab00334f2d2 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:16.986172 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff935581-5649-4220-b091-309294d7e359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:16.986770 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff935581-5649-4220-b091-309294d7e359 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:16.987047 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff935581-5649-4220-b091-309294d7e359 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:16.987316 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff935581-5649-4220-b091-309294d7e359 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:16.987963 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff935581-5649-4220-b091-309294d7e359 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:16.988258 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff935581-5649-4220-b091-309294d7e359 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:16.989641 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff935581-5649-4220-b091-309294d7e359 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:17.000901 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 637/1284] 10.222.0.52 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:17.006894 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef70e79-dfa1-43d2-92e2-bde83d9e1989 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:17.121428 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef70e79-dfa1-43d2-92e2-bde83d9e1989 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:17.134578 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:17.154595 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06e197-4b7a-41cd-9b4b-6cda1fd89b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:17.155210 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06e197-4b7a-41cd-9b4b-6cda1fd89b0e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:17.155493 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06e197-4b7a-41cd-9b4b-6cda1fd89b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:17.155764 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06e197-4b7a-41cd-9b4b-6cda1fd89b0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:17.162397 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06e197-4b7a-41cd-9b4b-6cda1fd89b0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:17.163839 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06e197-4b7a-41cd-9b4b-6cda1fd89b0e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:17.174982 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-3c06e197-4b7a-41cd-9b4b-6cda1fd89b0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:17.174982 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:17.174982 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:17.174982 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:17.174982 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:17.174982 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:17.174982 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:17.174982 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:17.174982 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:17.174982 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:17.174982 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:17.174982 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:17.174982 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:45:17.174982 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:45:17.174982 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:45:17.176050 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:45:17.176050 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:17.176050 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:17.176050 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:17.176050 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:17.176050 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:17.176050 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:17.176050 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:17.176050 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:17.176050 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:17.176050 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:17.176050 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:17.176050 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:17.176050 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:17.176050 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:17.176050 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:17.176050 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:17.177439 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:45:17.177439 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:45:17.177439 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:45:17.177439 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:45:17.177439 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:45:17.177439 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:45:17.177439 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:17.177439 dv-cinder-master-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Aug 28 00:45:17.177439 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 648/1285] 10.222.0.52 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:17.185258 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff935581-5649-4220-b091-309294d7e359 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:17.243832 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:17.295238 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff935581-5649-4220-b091-309294d7e359 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:17.330303 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f0225-4757-41c8-914b-2dc98cb17d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:17.330893 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f0225-4757-41c8-914b-2dc98cb17d99 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:17.331168 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f0225-4757-41c8-914b-2dc98cb17d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:17.331437 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f0225-4757-41c8-914b-2dc98cb17d99 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:17.332125 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f0225-4757-41c8-914b-2dc98cb17d99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:17.332425 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f0225-4757-41c8-914b-2dc98cb17d99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:17.333882 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f0225-4757-41c8-914b-2dc98cb17d99 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:17.346029 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 638/1286] 10.222.0.52 () {56 vars in 1148 bytes} [Sun Aug 28 00:45:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:17.352662 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06e197-4b7a-41cd-9b4b-6cda1fd89b0e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:17.457821 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06e197-4b7a-41cd-9b4b-6cda1fd89b0e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:17.492282 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab44ecf-8e7d-4912-83b8-e9e2e5ab5599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:17.492861 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab44ecf-8e7d-4912-83b8-e9e2e5ab5599 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:17.493133 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab44ecf-8e7d-4912-83b8-e9e2e5ab5599 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:17.493402 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab44ecf-8e7d-4912-83b8-e9e2e5ab5599 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:17.494209 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab44ecf-8e7d-4912-83b8-e9e2e5ab5599 None admin] RBAC: Adding query filter params (role.id=cc013581bb07418d9ec6a3a1d282ea53, scope.project.id=45c69e3e973c449895457bb610103a43, user.id=ae87149f6ab04a9997263598737ae27e) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:17.494450 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab44ecf-8e7d-4912-83b8-e9e2e5ab5599 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:17.495864 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab44ecf-8e7d-4912-83b8-e9e2e5ab5599 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:17.501686 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 649/1287] 10.222.0.52 () {56 vars in 1374 bytes} [Sun Aug 28 00:45:17 2022] GET /identity/v3/role_assignments?user.id=ae87149f6ab04a9997263598737ae27e&scope.project.id=45c69e3e973c449895457bb610103a43&role.id=cc013581bb07418d9ec6a3a1d282ea53 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:19.399385 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc8723-f181-4a54-8668-ec2f49871371 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:19.400225 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc8723-f181-4a54-8668-ec2f49871371 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:19.400225 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc8723-f181-4a54-8668-ec2f49871371 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:19.402357 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 639/1288] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:45:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:19.408037 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c33483-0c77-4410-b140-a0c8d3a87b23 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:19.408473 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c33483-0c77-4410-b140-a0c8d3a87b23 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:19.408665 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c33483-0c77-4410-b140-a0c8d3a87b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:19.430438 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-48c33483-0c77-4410-b140-a0c8d3a87b23 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:19.431648 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-48c33483-0c77-4410-b140-a0c8d3a87b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:19.465709 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:19.511018 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 650/1289] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:45:19.773793 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc8723-f181-4a54-8668-ec2f49871371 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:19.894627 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc8723-f181-4a54-8668-ec2f49871371 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:19.912284 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:19.941273 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f21220-df61-4381-ae53-8742d197e438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:19.941959 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f21220-df61-4381-ae53-8742d197e438 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:19.942241 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f21220-df61-4381-ae53-8742d197e438 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:19.942517 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f21220-df61-4381-ae53-8742d197e438 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:19.943186 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f21220-df61-4381-ae53-8742d197e438 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:19.944581 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f21220-df61-4381-ae53-8742d197e438 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:19.953721 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-b7f21220-df61-4381-ae53-8742d197e438 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:45:19.953721 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:19.953721 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:45:19.953721 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:45:19.953721 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:45:19.953721 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:45:19.953721 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:45:19.953721 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:45:19.953721 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:45:19.953721 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:45:19.953721 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:45:19.953721 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:45:19.953721 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:19.953721 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:19.953721 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:19.953721 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:19.953721 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:19.955002 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:19.955002 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:19.955002 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:19.955002 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:19.955002 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:19.955002 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:19.955002 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:45:19.955002 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:45:19.955002 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:45:19.955002 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:45:19.955002 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:19.955002 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:19.955002 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:19.955002 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:19.955002 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:19.955002 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:19.957060 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:19.957060 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:19.957060 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:19.957060 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:19.957060 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:19.957060 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:19.957060 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:19.957060 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:19.957060 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:19.957060 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:19.957060 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:45:19.957060 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:45:19.957060 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:45:19.957060 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:45:19.957060 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 640/1290] 10.222.0.52 () {56 vars in 1117 bytes} [Sun Aug 28 00:45:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:19.963868 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c33483-0c77-4410-b140-a0c8d3a87b23 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:20.072310 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c33483-0c77-4410-b140-a0c8d3a87b23 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:20.117396 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0a3e3-163f-433f-931e-28fc4fd8d3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:20.118075 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0a3e3-163f-433f-931e-28fc4fd8d3b9 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:20.118356 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0a3e3-163f-433f-931e-28fc4fd8d3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:20.118622 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0a3e3-163f-433f-931e-28fc4fd8d3b9 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:20.119305 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0a3e3-163f-433f-931e-28fc4fd8d3b9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:20.119575 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0a3e3-163f-433f-931e-28fc4fd8d3b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:20.121184 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0a3e3-163f-433f-931e-28fc4fd8d3b9 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:20.126632 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 651/1291] 10.222.0.52 () {56 vars in 1116 bytes} [Sun Aug 28 00:45:19 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:20.134316 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f21220-df61-4381-ae53-8742d197e438 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:20.243539 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f21220-df61-4381-ae53-8742d197e438 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:20.275653 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586f3dd-6b36-4e7e-b1d0-3efd478dc296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:20.276238 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586f3dd-6b36-4e7e-b1d0-3efd478dc296 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:20.276503 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586f3dd-6b36-4e7e-b1d0-3efd478dc296 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:20.276763 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586f3dd-6b36-4e7e-b1d0-3efd478dc296 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:20.277380 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1586f3dd-6b36-4e7e-b1d0-3efd478dc296 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:20.277670 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1586f3dd-6b36-4e7e-b1d0-3efd478dc296 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:20.279079 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1586f3dd-6b36-4e7e-b1d0-3efd478dc296 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:20.285539 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 641/1292] 10.222.0.52 () {56 vars in 1116 bytes} [Sun Aug 28 00:45:20 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:22.244034 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8825db-84a2-4407-b7f5-9d2b2c7670c6 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:22.244608 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8825db-84a2-4407-b7f5-9d2b2c7670c6 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:22.244608 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8825db-84a2-4407-b7f5-9d2b2c7670c6 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:22.246784 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 652/1293] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:45:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:22.255871 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0708bb4-fad0-4e43-b229-870756dd359f None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:22.256606 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0708bb4-fad0-4e43-b229-870756dd359f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:22.256754 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0708bb4-fad0-4e43-b229-870756dd359f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:22.278166 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a0708bb4-fad0-4e43-b229-870756dd359f None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:22.279632 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a0708bb4-fad0-4e43-b229-870756dd359f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:22.311551 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:22.353971 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 642/1294] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:45:22.624332 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8825db-84a2-4407-b7f5-9d2b2c7670c6 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:22.670337 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:22.744505 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8825db-84a2-4407-b7f5-9d2b2c7670c6 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:22.780655 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3443ca2-cb71-4252-8836-56765dcc5893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:22.781242 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3443ca2-cb71-4252-8836-56765dcc5893 None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:22.781520 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3443ca2-cb71-4252-8836-56765dcc5893 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:22.781789 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3443ca2-cb71-4252-8836-56765dcc5893 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:22.782458 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3443ca2-cb71-4252-8836-56765dcc5893 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:22.783827 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3443ca2-cb71-4252-8836-56765dcc5893 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:22.803265 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 653/1295] 10.222.0.52 () {60 vars in 1141 bytes} [Sun Aug 28 00:45:22 2022] POST /identity/v3/services => generated 246 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:45:24.729039 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a9b4c-0264-45b6-b296-1cbb71576a8a None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:24.729908 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a9b4c-0264-45b6-b296-1cbb71576a8a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:24.729908 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a9b4c-0264-45b6-b296-1cbb71576a8a None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:24.732040 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 643/1296] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:45:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:24.738655 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effae5a-8f84-4b4f-abaf-f14b6762317c None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:24.739101 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effae5a-8f84-4b4f-abaf-f14b6762317c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:24.739206 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effae5a-8f84-4b4f-abaf-f14b6762317c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:24.761742 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-1effae5a-8f84-4b4f-abaf-f14b6762317c None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:24.762958 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1effae5a-8f84-4b4f-abaf-f14b6762317c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:24.839607 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 654/1297] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:24 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:45:25.113880 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a9b4c-0264-45b6-b296-1cbb71576a8a None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:25.222218 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a9b4c-0264-45b6-b296-1cbb71576a8a None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:25.258231 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e45b5-dde2-42cb-86c2-45b22932a54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:25.258851 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e45b5-dde2-42cb-86c2-45b22932a54e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:25.259128 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e45b5-dde2-42cb-86c2-45b22932a54e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:25.259399 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e45b5-dde2-42cb-86c2-45b22932a54e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:25.259974 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e45b5-dde2-42cb-86c2-45b22932a54e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:25.261357 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e45b5-dde2-42cb-86c2-45b22932a54e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:25.270612 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-fe7e45b5-dde2-42cb-86c2-45b22932a54e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:45:25.270612 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:25.270612 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:45:25.270612 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:45:25.270612 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:45:25.270612 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:45:25.270612 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:45:25.270612 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:45:25.270612 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:45:25.270612 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:45:25.270612 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:45:25.270612 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:45:25.270612 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:25.270612 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:25.270612 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:25.270612 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:25.270612 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:25.271727 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:25.271727 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:25.271727 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:25.271727 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:25.271727 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:25.271727 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:25.271727 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:45:25.271727 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:45:25.271727 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:45:25.271727 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:45:25.271727 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:25.271727 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:25.271727 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:25.271727 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:25.271727 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:25.271727 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:25.272810 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:25.272810 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:25.272810 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:25.272810 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:25.272810 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:25.272810 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:25.272810 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:25.272810 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:25.272810 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:25.272810 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:25.272810 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:45:25.272810 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:45:25.272810 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:45:25.272810 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:45:25.272810 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 644/1298] 10.222.0.52 () {56 vars in 1117 bytes} [Sun Aug 28 00:45:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:25.278807 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effae5a-8f84-4b4f-abaf-f14b6762317c None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:25.304149 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:25.391207 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effae5a-8f84-4b4f-abaf-f14b6762317c None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:25.426649 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e535529-fceb-488c-a51d-132db1e995a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:25.427248 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e535529-fceb-488c-a51d-132db1e995a6 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:25.427526 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e535529-fceb-488c-a51d-132db1e995a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:25.427797 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e535529-fceb-488c-a51d-132db1e995a6 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:25.428424 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e535529-fceb-488c-a51d-132db1e995a6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:25.428722 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e535529-fceb-488c-a51d-132db1e995a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:25.430131 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e535529-fceb-488c-a51d-132db1e995a6 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:25.436511 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 655/1299] 10.222.0.52 () {56 vars in 1116 bytes} [Sun Aug 28 00:45:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:25.448310 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e45b5-dde2-42cb-86c2-45b22932a54e None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:25.484755 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:25.559654 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e45b5-dde2-42cb-86c2-45b22932a54e None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:25.595133 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bca44a-d032-4235-99f5-c3d57fc642b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:25.595724 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bca44a-d032-4235-99f5-c3d57fc642b0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:25.595994 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bca44a-d032-4235-99f5-c3d57fc642b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:25.596374 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bca44a-d032-4235-99f5-c3d57fc642b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:25.597075 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bca44a-d032-4235-99f5-c3d57fc642b0 None admin] RBAC: Adding query filter params (interface=public, service_id=2d3caa838708487f83c678503ac6b9a9, region_id=RegionOne) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:25.597376 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bca44a-d032-4235-99f5-c3d57fc642b0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:25.598772 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bca44a-d032-4235-99f5-c3d57fc642b0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:25.604178 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 645/1300] 10.222.0.52 () {56 vars in 1251 bytes} [Sun Aug 28 00:45:25 2022] GET /identity/v3/endpoints?service_id=2d3caa838708487f83c678503ac6b9a9&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:25.610938 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e535529-fceb-488c-a51d-132db1e995a6 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:25.699397 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:25.725315 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e535529-fceb-488c-a51d-132db1e995a6 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:25.761142 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0005d-4f6a-45cb-861b-65431de82648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:25.761728 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0005d-4f6a-45cb-861b-65431de82648 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:25.762043 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0005d-4f6a-45cb-861b-65431de82648 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:25.762317 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0005d-4f6a-45cb-861b-65431de82648 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:25.762953 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0005d-4f6a-45cb-861b-65431de82648 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:25.764723 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0005d-4f6a-45cb-861b-65431de82648 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:25.771564 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 656/1301] 10.222.0.52 () {56 vars in 1087 bytes} [Sun Aug 28 00:45:25 2022] GET /identity/v3/services => generated 2191 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:45:27.649122 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7957288-ff8a-4efd-9fa6-ec3a7fa83cca None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:27.649691 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7957288-ff8a-4efd-9fa6-ec3a7fa83cca None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:27.649691 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7957288-ff8a-4efd-9fa6-ec3a7fa83cca None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:27.651062 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 646/1302] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:27.657648 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c284d0d-2954-4e6f-a763-c7d589a10549 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:27.658470 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c284d0d-2954-4e6f-a763-c7d589a10549 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:27.658594 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c284d0d-2954-4e6f-a763-c7d589a10549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:27.682055 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-3c284d0d-2954-4e6f-a763-c7d589a10549 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:27.683249 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3c284d0d-2954-4e6f-a763-c7d589a10549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:27.763836 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 657/1303] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:27 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:45:28.028948 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7957288-ff8a-4efd-9fa6-ec3a7fa83cca None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:28.139421 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:28.148027 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7957288-ff8a-4efd-9fa6-ec3a7fa83cca None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:28.189171 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c8f4d-a404-4afa-bdca-92545cb02395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:28.189787 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c8f4d-a404-4afa-bdca-92545cb02395 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:28.190085 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c8f4d-a404-4afa-bdca-92545cb02395 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:28.190350 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c8f4d-a404-4afa-bdca-92545cb02395 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:28.190926 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c8f4d-a404-4afa-bdca-92545cb02395 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:28.192311 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c8f4d-a404-4afa-bdca-92545cb02395 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:28.201476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-ed7c8f4d-a404-4afa-bdca-92545cb02395 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:45:28.201476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:28.201476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:45:28.201476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:45:28.201476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:45:28.201476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:45:28.201476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:45:28.201476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:45:28.201476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:45:28.201476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:45:28.201476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:45:28.201476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:45:28.201476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:28.201476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:28.201476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:28.201476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:28.201476 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:28.202677 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:28.202677 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:28.202677 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:28.202677 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:28.202677 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:28.202677 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:28.202677 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:45:28.202677 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:45:28.202677 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:45:28.202677 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:45:28.202677 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:28.202677 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:28.202677 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:28.202677 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:28.202677 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:28.202677 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:28.203554 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:28.203554 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:28.203554 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:28.203554 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:28.203554 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:28.203554 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:28.203554 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:28.203554 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:28.203554 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:28.203554 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:28.203554 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:45:28.203554 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:45:28.203554 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:45:28.203554 dv-cinder-master-3-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 28 00:45:28.203554 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 647/1304] 10.222.0.52 () {56 vars in 1117 bytes} [Sun Aug 28 00:45:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:28.208771 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c284d0d-2954-4e6f-a763-c7d589a10549 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:28.288036 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:28.313157 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c284d0d-2954-4e6f-a763-c7d589a10549 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:28.349242 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e582fe-267a-474e-bea6-f16300fd4814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:28.349888 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e582fe-267a-474e-bea6-f16300fd4814 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:28.350162 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e582fe-267a-474e-bea6-f16300fd4814 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:28.350411 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e582fe-267a-474e-bea6-f16300fd4814 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:28.351041 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e582fe-267a-474e-bea6-f16300fd4814 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:28.351336 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e582fe-267a-474e-bea6-f16300fd4814 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:28.352703 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e582fe-267a-474e-bea6-f16300fd4814 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:28.358552 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 658/1305] 10.222.0.52 () {56 vars in 1116 bytes} [Sun Aug 28 00:45:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:28.368205 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c8f4d-a404-4afa-bdca-92545cb02395 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:28.493315 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c8f4d-a404-4afa-bdca-92545cb02395 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:28.532593 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da31c67-b169-4eeb-ace9-5608be575afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:28.533204 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da31c67-b169-4eeb-ace9-5608be575afa None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:28.533445 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da31c67-b169-4eeb-ace9-5608be575afa None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:28.533728 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da31c67-b169-4eeb-ace9-5608be575afa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:28.534418 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da31c67-b169-4eeb-ace9-5608be575afa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:28.535770 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da31c67-b169-4eeb-ace9-5608be575afa None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:28.561408 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 648/1306] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:45:28 2022] POST /identity/v3/endpoints => generated 331 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:45:38.355065 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=30 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:38.553876 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:33.197542 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3b9dc-49e7-4d07-b45c-c9aed6c6761d None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:33.198656 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3b9dc-49e7-4d07-b45c-c9aed6c6761d None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:33.199182 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3b9dc-49e7-4d07-b45c-c9aed6c6761d None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:33.200775 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 659/1307] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:46:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:33.206426 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12030d-7e8f-453c-a8fe-edf678866c6d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:33.206850 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12030d-7e8f-453c-a8fe-edf678866c6d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:33.207062 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12030d-7e8f-453c-a8fe-edf678866c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:33.291501 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-1d12030d-7e8f-453c-a8fe-edf678866c6d None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:33.293224 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1d12030d-7e8f-453c-a8fe-edf678866c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:33.422430 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 649/1308] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:46:33.722641 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f84591-0829-4df4-b4ae-f1c5ee6e079c None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:33.723210 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f84591-0829-4df4-b4ae-f1c5ee6e079c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:33.723484 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f84591-0829-4df4-b4ae-f1c5ee6e079c None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:33.724847 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 660/1309] 10.222.0.52 () {54 vars in 965 bytes} [Sun Aug 28 00:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:33.731600 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057747d1-8739-4690-b381-9dc72f47ba3a None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:33.732074 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057747d1-8739-4690-b381-9dc72f47ba3a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:33.732453 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057747d1-8739-4690-b381-9dc72f47ba3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:33.815554 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-057747d1-8739-4690-b381-9dc72f47ba3a None None] MFA Rules not processed for user `0ca94d8693c64e388bd0d15db07f5fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:33.816778 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-057747d1-8739-4690-b381-9dc72f47ba3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:33.839007 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:33.902395 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 650/1310] 10.222.0.52 () {58 vars in 1062 bytes} [Sun Aug 28 00:46:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:46:33.911600 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f84591-0829-4df4-b4ae-f1c5ee6e079c None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:33.913588 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-89f84591-0829-4df4-b4ae-f1c5ee6e079c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:34.033362 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f84591-0829-4df4-b4ae-f1c5ee6e079c None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:34.112297 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07a532-45a7-4d6c-b923-3bd8cf20aed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:34.112984 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07a532-45a7-4d6c-b923-3bd8cf20aed7 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:34.113379 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07a532-45a7-4d6c-b923-3bd8cf20aed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:34.113783 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07a532-45a7-4d6c-b923-3bd8cf20aed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:34.115509 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6e07a532-45a7-4d6c-b923-3bd8cf20aed7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:34.172965 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:34.240429 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e07a532-45a7-4d6c-b923-3bd8cf20aed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:34.242105 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e07a532-45a7-4d6c-b923-3bd8cf20aed7 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:34.263691 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 661/1311] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:46:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:46:36.436067 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907674cb-0452-4936-8b7d-6a3f694c86e8 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:36.436825 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907674cb-0452-4936-8b7d-6a3f694c86e8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:36.436825 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907674cb-0452-4936-8b7d-6a3f694c86e8 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:36.438971 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 651/1312] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:36.443468 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae36036-e0af-4828-a311-5e41316e7d0b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:36.443870 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae36036-e0af-4828-a311-5e41316e7d0b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:36.444064 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae36036-e0af-4828-a311-5e41316e7d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:36.533293 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-0ae36036-e0af-4828-a311-5e41316e7d0b None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:36.534881 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-0ae36036-e0af-4828-a311-5e41316e7d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:36.642817 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 662/1313] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:46:36.920574 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907674cb-0452-4936-8b7d-6a3f694c86e8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:36.922018 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-907674cb-0452-4936-8b7d-6a3f694c86e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:37.024263 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907674cb-0452-4936-8b7d-6a3f694c86e8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:37.094851 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:37.097881 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4c0cd-d9c2-4bd1-8617-e03d6bcbdfb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:37.098492 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4c0cd-d9c2-4bd1-8617-e03d6bcbdfb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:37.098770 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4c0cd-d9c2-4bd1-8617-e03d6bcbdfb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:37.099041 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4c0cd-d9c2-4bd1-8617-e03d6bcbdfb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:37.101871 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4bd4c0cd-d9c2-4bd1-8617-e03d6bcbdfb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:37.219627 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4c0cd-d9c2-4bd1-8617-e03d6bcbdfb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:37.220979 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4c0cd-d9c2-4bd1-8617-e03d6bcbdfb6 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:37.239370 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 652/1314] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:46:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:46:39.495360 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f201228-7925-49b4-b713-347fd8426013 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:39.495939 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f201228-7925-49b4-b713-347fd8426013 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:39.496036 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f201228-7925-49b4-b713-347fd8426013 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:39.497393 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 663/1315] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:39.503443 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b8608-584e-4457-8877-3ddc6cbe9fa1 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:39.503881 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b8608-584e-4457-8877-3ddc6cbe9fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:39.504000 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b8608-584e-4457-8877-3ddc6cbe9fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:39.579273 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e60b8608-584e-4457-8877-3ddc6cbe9fa1 None None] MFA Rules not processed for user `aa5b6bfda63641828423fc56bb44215c`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:39.581063 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e60b8608-584e-4457-8877-3ddc6cbe9fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:39.638451 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:39.684694 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 653/1316] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:39 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:46:39.971251 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f201228-7925-49b4-b713-347fd8426013 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:39.973613 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1f201228-7925-49b4-b713-347fd8426013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:39.988723 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:40.090562 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f201228-7925-49b4-b713-347fd8426013 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:40.164843 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ea1e4-2d61-4305-9cb4-4f6dff7271dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:40.165440 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ea1e4-2d61-4305-9cb4-4f6dff7271dc service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:40.165709 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ea1e4-2d61-4305-9cb4-4f6dff7271dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:40.165978 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ea1e4-2d61-4305-9cb4-4f6dff7271dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:40.167595 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-cb6ea1e4-2d61-4305-9cb4-4f6dff7271dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:40.230839 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:40.288464 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ea1e4-2d61-4305-9cb4-4f6dff7271dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:40.289913 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ea1e4-2d61-4305-9cb4-4f6dff7271dc service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:40.311374 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 664/1317] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:46:39 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:46:42.827346 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccef0a3-4ef8-4344-b9d0-75338a9d7163 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:42.827872 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccef0a3-4ef8-4344-b9d0-75338a9d7163 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:42.827872 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccef0a3-4ef8-4344-b9d0-75338a9d7163 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:42.829158 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 654/1318] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:42.835577 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55077b79-afd5-4ab5-9ff8-b130e7173435 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:42.836311 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55077b79-afd5-4ab5-9ff8-b130e7173435 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:42.836441 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55077b79-afd5-4ab5-9ff8-b130e7173435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:42.909723 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-55077b79-afd5-4ab5-9ff8-b130e7173435 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:42.910983 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-55077b79-afd5-4ab5-9ff8-b130e7173435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:43.011399 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 665/1319] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:46:43.317464 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccef0a3-4ef8-4344-b9d0-75338a9d7163 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:43.319951 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bccef0a3-4ef8-4344-b9d0-75338a9d7163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:43.441111 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccef0a3-4ef8-4344-b9d0-75338a9d7163 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:43.528028 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab1d36-e8ac-402c-a030-dfd6413189f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:43.528624 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab1d36-e8ac-402c-a030-dfd6413189f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:43.528899 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab1d36-e8ac-402c-a030-dfd6413189f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:43.529164 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab1d36-e8ac-402c-a030-dfd6413189f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:43.530866 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b0ab1d36-e8ac-402c-a030-dfd6413189f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:43.540031 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:43.652836 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab1d36-e8ac-402c-a030-dfd6413189f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:43.654248 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab1d36-e8ac-402c-a030-dfd6413189f2 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:43.673528 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 655/1320] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:46:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:46:46.298031 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed3581-fad0-4dee-bce6-d2e3325bf2f0 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:46.298618 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed3581-fad0-4dee-bce6-d2e3325bf2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:46.298618 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed3581-fad0-4dee-bce6-d2e3325bf2f0 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:46.300751 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 666/1321] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:46:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:46.307476 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a72cc-2d68-470b-810d-57bbef435496 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:46.307958 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a72cc-2d68-470b-810d-57bbef435496 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:46.308038 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a72cc-2d68-470b-810d-57bbef435496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:46.390727 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-505a72cc-2d68-470b-810d-57bbef435496 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:46.392725 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-505a72cc-2d68-470b-810d-57bbef435496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:46.470733 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:46.515294 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 656/1322] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:46:46.853229 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cdfaa-8aed-4be0-9497-9e9d22de7639 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:46.853600 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cdfaa-8aed-4be0-9497-9e9d22de7639 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:46.854081 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cdfaa-8aed-4be0-9497-9e9d22de7639 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:46.856511 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 667/1323] 10.222.0.52 () {54 vars in 965 bytes} [Sun Aug 28 00:46:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:46.863175 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfb8b5-de34-497f-965c-e77480a485d7 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:46.863739 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfb8b5-de34-497f-965c-e77480a485d7 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:46.864020 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfb8b5-de34-497f-965c-e77480a485d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:46.961216 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-fcbfb8b5-de34-497f-965c-e77480a485d7 None None] MFA Rules not processed for user `0ca94d8693c64e388bd0d15db07f5fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:46.962460 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-fcbfb8b5-de34-497f-965c-e77480a485d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:47.058103 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 657/1324] 10.222.0.52 () {58 vars in 1062 bytes} [Sun Aug 28 00:46:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:46:47.071040 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cdfaa-8aed-4be0-9497-9e9d22de7639 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:47.072732 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9a5cdfaa-8aed-4be0-9497-9e9d22de7639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:47.101525 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:47.197774 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cdfaa-8aed-4be0-9497-9e9d22de7639 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:47.273770 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553b4a6-715b-441b-a5a4-8f1ae97dacbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:47.274408 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553b4a6-715b-441b-a5a4-8f1ae97dacbe service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:47.274680 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553b4a6-715b-441b-a5a4-8f1ae97dacbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:47.274942 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553b4a6-715b-441b-a5a4-8f1ae97dacbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:47.276505 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d553b4a6-715b-441b-a5a4-8f1ae97dacbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:47.363997 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:47.405001 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d553b4a6-715b-441b-a5a4-8f1ae97dacbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:47.406551 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d553b4a6-715b-441b-a5a4-8f1ae97dacbe service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:47.425619 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 668/1325] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:46:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:46:49.641237 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f3507-97b8-4639-846b-50a3681fb6bc None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:49.641787 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f3507-97b8-4639-846b-50a3681fb6bc None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:49.641925 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f3507-97b8-4639-846b-50a3681fb6bc None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:49.643296 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 658/1326] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:49.648683 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419eea3-77d5-43d5-bf65-605f3201c14e None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:49.649146 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419eea3-77d5-43d5-bf65-605f3201c14e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:49.649250 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419eea3-77d5-43d5-bf65-605f3201c14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:49.727288 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-c419eea3-77d5-43d5-bf65-605f3201c14e None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:49.728516 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c419eea3-77d5-43d5-bf65-605f3201c14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:49.829575 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 669/1327] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:46:50.114259 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f3507-97b8-4639-846b-50a3681fb6bc None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:50.115790 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a55f3507-97b8-4639-846b-50a3681fb6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:50.179595 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:50.223924 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f3507-97b8-4639-846b-50a3681fb6bc None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:50.300332 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a28f5e-b067-4b9b-9ae8-29048787f388 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:50.300934 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a28f5e-b067-4b9b-9ae8-29048787f388 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:50.301204 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a28f5e-b067-4b9b-9ae8-29048787f388 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:50.301454 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a28f5e-b067-4b9b-9ae8-29048787f388 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:50.303087 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-97a28f5e-b067-4b9b-9ae8-29048787f388 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:50.416699 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:50.419019 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a28f5e-b067-4b9b-9ae8-29048787f388 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:50.421680 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a28f5e-b067-4b9b-9ae8-29048787f388 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:50.440196 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 659/1328] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:46:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:46:52.397110 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9655be4-c687-4122-b1ce-235f421ec6f3 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:52.397758 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9655be4-c687-4122-b1ce-235f421ec6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:52.397758 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9655be4-c687-4122-b1ce-235f421ec6f3 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:52.399920 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 670/1329] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:46:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:52.405562 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3027fc-da79-4749-9ef3-5cc8a1511641 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:52.406026 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3027fc-da79-4749-9ef3-5cc8a1511641 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:52.406137 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3027fc-da79-4749-9ef3-5cc8a1511641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:52.477059 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-aa3027fc-da79-4749-9ef3-5cc8a1511641 None None] MFA Rules not processed for user `aa5b6bfda63641828423fc56bb44215c`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:52.478299 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-aa3027fc-da79-4749-9ef3-5cc8a1511641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:52.578192 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 660/1330] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:52 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:46:52.860950 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9655be4-c687-4122-b1ce-235f421ec6f3 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:52.862523 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f9655be4-c687-4122-b1ce-235f421ec6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:52.898416 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:52.984511 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9655be4-c687-4122-b1ce-235f421ec6f3 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:53.068526 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1512618-7622-4a3f-b055-3d13bd9985f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:53.069145 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1512618-7622-4a3f-b055-3d13bd9985f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:53.069424 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1512618-7622-4a3f-b055-3d13bd9985f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:53.069693 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1512618-7622-4a3f-b055-3d13bd9985f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:53.071383 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f1512618-7622-4a3f-b055-3d13bd9985f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:53.155423 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:53.191049 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1512618-7622-4a3f-b055-3d13bd9985f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:53.192737 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1512618-7622-4a3f-b055-3d13bd9985f4 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:53.212214 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 671/1331] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:46:52 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:46:55.391544 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8885aed-e3d9-47bd-af77-14d80516705d None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:55.392445 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8885aed-e3d9-47bd-af77-14d80516705d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:55.392445 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8885aed-e3d9-47bd-af77-14d80516705d None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:55.394561 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 661/1332] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:46:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:55.400050 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea86ff-b85e-432b-8974-2a470108e22f None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:55.400470 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea86ff-b85e-432b-8974-2a470108e22f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:55.400562 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea86ff-b85e-432b-8974-2a470108e22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:55.469281 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-21ea86ff-b85e-432b-8974-2a470108e22f None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:55.470519 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-21ea86ff-b85e-432b-8974-2a470108e22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:55.581992 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 672/1333] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:46:55.864230 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8885aed-e3d9-47bd-af77-14d80516705d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:55.866754 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b8885aed-e3d9-47bd-af77-14d80516705d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:55.946704 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:55.986427 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8885aed-e3d9-47bd-af77-14d80516705d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:56.065319 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01ee53-2966-47fd-813b-f68029636561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:56.065946 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01ee53-2966-47fd-813b-f68029636561 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:56.066215 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01ee53-2966-47fd-813b-f68029636561 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:56.066477 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01ee53-2966-47fd-813b-f68029636561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:56.068061 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5b01ee53-2966-47fd-813b-f68029636561 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:56.187935 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01ee53-2966-47fd-813b-f68029636561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:56.189283 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01ee53-2966-47fd-813b-f68029636561 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:56.200171 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:56.208977 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 662/1334] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:46:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:46:58.139401 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbaf59f-7b01-497b-adb6-14e6e0c70bfc None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:58.140152 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbaf59f-7b01-497b-adb6-14e6e0c70bfc None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:58.140152 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbaf59f-7b01-497b-adb6-14e6e0c70bfc None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:58.141279 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 673/1335] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:58.146741 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad276bc-6460-4706-82ef-dc1bd6414451 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:58.147183 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad276bc-6460-4706-82ef-dc1bd6414451 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:58.147291 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad276bc-6460-4706-82ef-dc1bd6414451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:58.224549 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-8ad276bc-6460-4706-82ef-dc1bd6414451 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:58.225798 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8ad276bc-6460-4706-82ef-dc1bd6414451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:58.340859 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 663/1336] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:46:58.648914 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbaf59f-7b01-497b-adb6-14e6e0c70bfc None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:58.650487 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-2bbaf59f-7b01-497b-adb6-14e6e0c70bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:58.696758 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:58.783760 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbaf59f-7b01-497b-adb6-14e6e0c70bfc None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:58.865946 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c21172-95df-4a48-a961-7d49292c325e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:58.866507 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c21172-95df-4a48-a961-7d49292c325e service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:58.866781 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c21172-95df-4a48-a961-7d49292c325e service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:58.867049 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c21172-95df-4a48-a961-7d49292c325e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:58.868746 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f5c21172-95df-4a48-a961-7d49292c325e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:58.960094 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:58.995717 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c21172-95df-4a48-a961-7d49292c325e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:58.997173 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c21172-95df-4a48-a961-7d49292c325e service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:59.016593 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 674/1337] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:46:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:47:01.277479 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d2539-0838-406c-9167-62dd9a7bdec4 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:01.278422 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d2539-0838-406c-9167-62dd9a7bdec4 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:01.278422 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d2539-0838-406c-9167-62dd9a7bdec4 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:01.280518 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 664/1338] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:47:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:01.286809 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733c099-363f-4679-8ca3-a2985aaae3c1 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:01.287237 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733c099-363f-4679-8ca3-a2985aaae3c1 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:01.287421 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733c099-363f-4679-8ca3-a2985aaae3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:01.359051 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-3733c099-363f-4679-8ca3-a2985aaae3c1 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:01.360243 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3733c099-363f-4679-8ca3-a2985aaae3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:01.459634 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 675/1339] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:47:01.744893 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d2539-0838-406c-9167-62dd9a7bdec4 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:01.747303 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2e8d2539-0838-406c-9167-62dd9a7bdec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:01.837255 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:01.869315 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d2539-0838-406c-9167-62dd9a7bdec4 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:01.953520 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787353f-f8cc-469b-b184-a80a2e46e70e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:01.954176 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787353f-f8cc-469b-b184-a80a2e46e70e service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:01.954456 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787353f-f8cc-469b-b184-a80a2e46e70e service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:01.954700 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787353f-f8cc-469b-b184-a80a2e46e70e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:01.956329 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8787353f-f8cc-469b-b184-a80a2e46e70e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:02.074665 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787353f-f8cc-469b-b184-a80a2e46e70e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:02.076115 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787353f-f8cc-469b-b184-a80a2e46e70e service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:02.096059 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 665/1340] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:47:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:47:05.987122 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31572be-8d65-4768-ae87-dc0eb83bad3a None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:05.987666 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31572be-8d65-4768-ae87-dc0eb83bad3a None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:05.987666 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31572be-8d65-4768-ae87-dc0eb83bad3a None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:05.989016 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 676/1341] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:05.996227 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f4363-0724-428f-a58d-f44624e9a743 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:05.996763 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f4363-0724-428f-a58d-f44624e9a743 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:05.996763 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f4363-0724-428f-a58d-f44624e9a743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:06.002488 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:06.064311 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e84f4363-0724-428f-a58d-f44624e9a743 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:06.065505 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e84f4363-0724-428f-a58d-f44624e9a743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:06.168120 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 666/1342] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:47:06.452554 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31572be-8d65-4768-ae87-dc0eb83bad3a None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:06.454255 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d31572be-8d65-4768-ae87-dc0eb83bad3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:06.503712 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:06.563002 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31572be-8d65-4768-ae87-dc0eb83bad3a None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:06.639214 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735a9b6-0e88-4766-bd9c-8a0e6666997f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:06.639920 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735a9b6-0e88-4766-bd9c-8a0e6666997f service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:06.640056 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735a9b6-0e88-4766-bd9c-8a0e6666997f service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:06.640357 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735a9b6-0e88-4766-bd9c-8a0e6666997f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:06.642001 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9735a9b6-0e88-4766-bd9c-8a0e6666997f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:06.737269 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:06.754604 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735a9b6-0e88-4766-bd9c-8a0e6666997f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:06.756055 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735a9b6-0e88-4766-bd9c-8a0e6666997f service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:06.775728 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 677/1343] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:47:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:47:09.642157 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c936d5-50e9-4397-a336-05f47d74d6c9 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:09.642735 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c936d5-50e9-4397-a336-05f47d74d6c9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:09.642735 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c936d5-50e9-4397-a336-05f47d74d6c9 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:09.643909 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 667/1344] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:09.649357 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c22bb3-809b-416c-8982-3752c9a33f1d None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:09.649810 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c22bb3-809b-416c-8982-3752c9a33f1d None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:09.649935 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c22bb3-809b-416c-8982-3752c9a33f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:09.720598 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-98c22bb3-809b-416c-8982-3752c9a33f1d None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:09.721810 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-98c22bb3-809b-416c-8982-3752c9a33f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:09.826903 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 678/1345] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:47:10.117501 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c936d5-50e9-4397-a336-05f47d74d6c9 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:10.119130 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-30c936d5-50e9-4397-a336-05f47d74d6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:10.209398 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:10.228713 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c936d5-50e9-4397-a336-05f47d74d6c9 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:10.307623 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f074d-e3b8-441d-9bc5-097e515872a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:10.308242 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f074d-e3b8-441d-9bc5-097e515872a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:10.308513 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f074d-e3b8-441d-9bc5-097e515872a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:10.308780 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f074d-e3b8-441d-9bc5-097e515872a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:10.310898 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-488f074d-e3b8-441d-9bc5-097e515872a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:10.430045 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f074d-e3b8-441d-9bc5-097e515872a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:10.431516 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f074d-e3b8-441d-9bc5-097e515872a6 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:10.450358 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 668/1346] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:47:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:47:14.572459 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9883b8-2ae6-4012-abe7-21dcd7caa283 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:14.573006 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9883b8-2ae6-4012-abe7-21dcd7caa283 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:14.573006 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9883b8-2ae6-4012-abe7-21dcd7caa283 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:14.574435 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 679/1347] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:14.580091 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e2576-5c20-40db-a1b9-80c8a7d51e1e None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:14.580571 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e2576-5c20-40db-a1b9-80c8a7d51e1e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:14.580678 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e2576-5c20-40db-a1b9-80c8a7d51e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:14.597927 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:14.657542 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-9c4e2576-5c20-40db-a1b9-80c8a7d51e1e None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:14.658805 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9c4e2576-5c20-40db-a1b9-80c8a7d51e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:14.762868 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 669/1348] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:47:15.042520 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9883b8-2ae6-4012-abe7-21dcd7caa283 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:15.044062 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8c9883b8-2ae6-4012-abe7-21dcd7caa283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:15.105997 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:15.157136 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9883b8-2ae6-4012-abe7-21dcd7caa283 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:15.247574 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdca052-2365-4772-b44e-78fe73291b8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:15.248191 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdca052-2365-4772-b44e-78fe73291b8d service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:15.248491 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdca052-2365-4772-b44e-78fe73291b8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:15.248907 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdca052-2365-4772-b44e-78fe73291b8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:15.250584 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ebdca052-2365-4772-b44e-78fe73291b8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:15.376657 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:15.380615 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdca052-2365-4772-b44e-78fe73291b8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:15.382832 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdca052-2365-4772-b44e-78fe73291b8d service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:15.401751 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 680/1349] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:47:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:47:20.350658 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf7d96-b107-49bc-be97-7636122be6ac None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:20.351234 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf7d96-b107-49bc-be97-7636122be6ac None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:20.351234 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf7d96-b107-49bc-be97-7636122be6ac None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:20.352923 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 670/1350] 10.222.0.52 () {54 vars in 921 bytes} [Sun Aug 28 00:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:20.362139 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a315bd-fa9b-437d-bdb2-298f8fb0f1ef None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:20.362139 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a315bd-fa9b-437d-bdb2-298f8fb0f1ef None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:20.362139 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a315bd-fa9b-437d-bdb2-298f8fb0f1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:20.498214 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-46a315bd-fa9b-437d-bdb2-298f8fb0f1ef None None] MFA Rules not processed for user `ae87149f6ab04a9997263598737ae27e`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:20.509998 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-46a315bd-fa9b-437d-bdb2-298f8fb0f1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:20.676036 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 681/1351] 10.222.0.52 () {58 vars in 1018 bytes} [Sun Aug 28 00:47:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:47:24.761013 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=59 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:24.816080 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed3cbc-d8f8-45b3-939b-5b2f13a7a680 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:24.816268 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed3cbc-d8f8-45b3-939b-5b2f13a7a680 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:24.816522 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed3cbc-d8f8-45b3-939b-5b2f13a7a680 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:24.819679 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 671/1352] 10.222.0.52 () {54 vars in 921 bytes} [Sun Aug 28 00:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:24.825588 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899432c-8876-49bc-9e0f-8c4e63b489cf None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:24.826132 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899432c-8876-49bc-9e0f-8c4e63b489cf None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:24.826132 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899432c-8876-49bc-9e0f-8c4e63b489cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:24.883491 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:24.907097 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-e899432c-8876-49bc-9e0f-8c4e63b489cf None None] MFA Rules not processed for user `ae87149f6ab04a9997263598737ae27e`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:24.908319 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e899432c-8876-49bc-9e0f-8c4e63b489cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:25.020621 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 682/1353] 10.222.0.52 () {58 vars in 1018 bytes} [Sun Aug 28 00:47:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:47:26.336890 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa0800-7da1-4e18-88bd-cbd1c9b495f0 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:26.337435 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa0800-7da1-4e18-88bd-cbd1c9b495f0 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:26.337435 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa0800-7da1-4e18-88bd-cbd1c9b495f0 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:26.338806 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 672/1354] 10.222.0.52 () {54 vars in 921 bytes} [Sun Aug 28 00:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:26.344061 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff3c2e-b0aa-41a7-be82-05fd1af71cf3 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:26.344510 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff3c2e-b0aa-41a7-be82-05fd1af71cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:26.344757 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff3c2e-b0aa-41a7-be82-05fd1af71cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:26.424435 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-06ff3c2e-b0aa-41a7-be82-05fd1af71cf3 None None] MFA Rules not processed for user `ae87149f6ab04a9997263598737ae27e`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:26.425650 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-06ff3c2e-b0aa-41a7-be82-05fd1af71cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:26.471416 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:26.544021 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 683/1355] 10.222.0.52 () {58 vars in 1018 bytes} [Sun Aug 28 00:47:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:47:29.841370 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627c954-2821-42fc-9579-278ffa32a2de None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:29.841943 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627c954-2821-42fc-9579-278ffa32a2de None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:29.841943 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627c954-2821-42fc-9579-278ffa32a2de None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:29.843239 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 673/1356] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:29.848726 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6ab02-820a-4441-8b82-d1cec9c66299 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:29.849164 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6ab02-820a-4441-8b82-d1cec9c66299 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:29.849254 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6ab02-820a-4441-8b82-d1cec9c66299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:29.934353 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-54a6ab02-820a-4441-8b82-d1cec9c66299 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:29.935565 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-54a6ab02-820a-4441-8b82-d1cec9c66299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:30.066725 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 684/1357] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:47:30.391105 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecb5fd-3f5a-44f4-b756-cda38229b83b None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:30.391622 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecb5fd-3f5a-44f4-b756-cda38229b83b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:30.392009 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecb5fd-3f5a-44f4-b756-cda38229b83b None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:30.393501 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 674/1358] 10.222.0.52 () {54 vars in 962 bytes} [Sun Aug 28 00:47:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:30.401351 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f880b-646b-4506-ad4e-6d153f0f13df None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:30.401685 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f880b-646b-4506-ad4e-6d153f0f13df None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:30.401939 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f880b-646b-4506-ad4e-6d153f0f13df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:30.419350 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:30.491378 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-fc1f880b-646b-4506-ad4e-6d153f0f13df None None] MFA Rules not processed for user `f890ff4e7807477db7f17c2f6434dce8`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:30.492718 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-fc1f880b-646b-4506-ad4e-6d153f0f13df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:30.638525 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 685/1359] 10.222.0.52 () {58 vars in 1059 bytes} [Sun Aug 28 00:47:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:47:30.646947 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecb5fd-3f5a-44f4-b756-cda38229b83b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:30.648484 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3eecb5fd-3f5a-44f4-b756-cda38229b83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:30.810319 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecb5fd-3f5a-44f4-b756-cda38229b83b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:30.891550 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:30.934190 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2d531-6ea1-4259-a59e-8ae059bd583d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:30.934819 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2d531-6ea1-4259-a59e-8ae059bd583d service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:30.935203 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2d531-6ea1-4259-a59e-8ae059bd583d service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:30.935475 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2d531-6ea1-4259-a59e-8ae059bd583d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:30.937627 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-41f2d531-6ea1-4259-a59e-8ae059bd583d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:31.029127 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2d531-6ea1-4259-a59e-8ae059bd583d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:31.030919 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2d531-6ea1-4259-a59e-8ae059bd583d service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:31.049480 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 675/1360] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:47:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:47:33.190723 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e780c3d-4020-4263-91d9-ceac309e3a19 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:33.191256 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e780c3d-4020-4263-91d9-ceac309e3a19 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:33.191477 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e780c3d-4020-4263-91d9-ceac309e3a19 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:33.193096 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 686/1361] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:33.198825 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e29d1-e4d7-42a4-93d9-14c3a03550b7 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:33.199272 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e29d1-e4d7-42a4-93d9-14c3a03550b7 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:33.199567 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e29d1-e4d7-42a4-93d9-14c3a03550b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:33.271723 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-693e29d1-e4d7-42a4-93d9-14c3a03550b7 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:33.273133 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-693e29d1-e4d7-42a4-93d9-14c3a03550b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:33.315644 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:33.388134 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 676/1362] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:47:33.688709 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e780c3d-4020-4263-91d9-ceac309e3a19 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:33.690253 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-0e780c3d-4020-4263-91d9-ceac309e3a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:33.760708 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:33.846950 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e780c3d-4020-4263-91d9-ceac309e3a19 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:33.967831 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a60f88-ec03-42ed-8a1c-8534391cd0b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:33.968479 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a60f88-ec03-42ed-8a1c-8534391cd0b0 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:33.968823 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a60f88-ec03-42ed-8a1c-8534391cd0b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:33.968942 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a60f88-ec03-42ed-8a1c-8534391cd0b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:33.970498 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-73a60f88-ec03-42ed-8a1c-8534391cd0b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:33.995885 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:34.071047 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a60f88-ec03-42ed-8a1c-8534391cd0b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:34.072656 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a60f88-ec03-42ed-8a1c-8534391cd0b0 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:34.092903 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 687/1363] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:47:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:47:36.332053 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71510b1-0077-45ba-880b-7fbe76a97e4f None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:36.332904 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71510b1-0077-45ba-880b-7fbe76a97e4f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:36.333325 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71510b1-0077-45ba-880b-7fbe76a97e4f None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:36.334893 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 677/1364] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:47:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:36.340509 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde23a28-9d11-480b-b1b4-2f4e1572ac1d None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:36.340972 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde23a28-9d11-480b-b1b4-2f4e1572ac1d None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:36.341059 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde23a28-9d11-480b-b1b4-2f4e1572ac1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:36.409281 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-fde23a28-9d11-480b-b1b4-2f4e1572ac1d None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:36.410527 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-fde23a28-9d11-480b-b1b4-2f4e1572ac1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:36.506863 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:36.509594 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 688/1365] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:47:36.797347 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3e4c7-137d-4139-a0c7-263709c9ff20 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:36.797797 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3e4c7-137d-4139-a0c7-263709c9ff20 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:36.798222 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3e4c7-137d-4139-a0c7-263709c9ff20 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:36.799914 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 678/1366] 10.222.0.52 () {54 vars in 962 bytes} [Sun Aug 28 00:47:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:36.805815 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7d867-2982-4ba1-bf37-4ee28d9a8e0a None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:36.806217 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7d867-2982-4ba1-bf37-4ee28d9a8e0a None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:36.806556 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7d867-2982-4ba1-bf37-4ee28d9a8e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:36.886847 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-f3c7d867-2982-4ba1-bf37-4ee28d9a8e0a None None] MFA Rules not processed for user `f890ff4e7807477db7f17c2f6434dce8`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:36.888063 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f3c7d867-2982-4ba1-bf37-4ee28d9a8e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:37.013519 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 689/1367] 10.222.0.52 () {58 vars in 1059 bytes} [Sun Aug 28 00:47:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:47:37.021737 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3e4c7-137d-4139-a0c7-263709c9ff20 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:37.023280 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e3f3e4c7-137d-4139-a0c7-263709c9ff20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:37.183340 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3e4c7-137d-4139-a0c7-263709c9ff20 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:37.207792 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:37.318982 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aed6d0-0bf7-4a15-b1b4-f94f43ecbb21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:37.319748 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aed6d0-0bf7-4a15-b1b4-f94f43ecbb21 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:37.320039 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aed6d0-0bf7-4a15-b1b4-f94f43ecbb21 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:37.320306 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aed6d0-0bf7-4a15-b1b4-f94f43ecbb21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:37.322351 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f9aed6d0-0bf7-4a15-b1b4-f94f43ecbb21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:37.419233 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aed6d0-0bf7-4a15-b1b4-f94f43ecbb21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:37.421053 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aed6d0-0bf7-4a15-b1b4-f94f43ecbb21 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:37.441941 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 679/1368] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:47:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:47:38.052438 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add90cb9-4a70-4430-98e5-cfcb53c05dcd None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:38.053029 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add90cb9-4a70-4430-98e5-cfcb53c05dcd None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:38.053029 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add90cb9-4a70-4430-98e5-cfcb53c05dcd None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:38.054433 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 690/1369] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:38.060016 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706041f-5d5c-46f5-8a40-f73225efb72a None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:38.060411 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706041f-5d5c-46f5-8a40-f73225efb72a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:38.060808 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706041f-5d5c-46f5-8a40-f73225efb72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:38.096005 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:38.133361 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-0706041f-5d5c-46f5-8a40-f73225efb72a None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:38.134753 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0706041f-5d5c-46f5-8a40-f73225efb72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:38.237880 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 680/1370] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:47:38.792343 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba2eb1-f5b9-4458-b253-a5eda7135d59 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:38.792595 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba2eb1-f5b9-4458-b253-a5eda7135d59 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:38.792801 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba2eb1-f5b9-4458-b253-a5eda7135d59 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:38.794371 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 691/1371] 10.222.0.52 () {54 vars in 964 bytes} [Sun Aug 28 00:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:38.799387 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e49e8-5f18-4abc-8a76-f805fc904671 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:38.799881 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e49e8-5f18-4abc-8a76-f805fc904671 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:38.799881 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e49e8-5f18-4abc-8a76-f805fc904671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:38.878539 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-547e49e8-5f18-4abc-8a76-f805fc904671 None None] MFA Rules not processed for user `3fbafa16c1ce4402ae4086e51767c05b`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:38.879746 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-547e49e8-5f18-4abc-8a76-f805fc904671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:38.943900 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:38.975064 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 681/1372] 10.222.0.52 () {58 vars in 1061 bytes} [Sun Aug 28 00:47:38 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:47:38.982801 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba2eb1-f5b9-4458-b253-a5eda7135d59 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:38.984372 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b6ba2eb1-f5b9-4458-b253-a5eda7135d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:39.037429 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:39.094509 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba2eb1-f5b9-4458-b253-a5eda7135d59 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:39.171657 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff8061-81e0-41c8-b340-e61cf4969dd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:39.172240 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff8061-81e0-41c8-b340-e61cf4969dd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:39.172523 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff8061-81e0-41c8-b340-e61cf4969dd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:39.172970 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff8061-81e0-41c8-b340-e61cf4969dd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:39.174810 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-09ff8061-81e0-41c8-b340-e61cf4969dd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:39.284307 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:39.301535 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff8061-81e0-41c8-b340-e61cf4969dd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:39.303296 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff8061-81e0-41c8-b340-e61cf4969dd2 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:39.325608 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 692/1373] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:47:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:47:39.464547 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c123c7b-a21a-48a1-aabc-e39308ac9bbb None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:39.464837 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c123c7b-a21a-48a1-aabc-e39308ac9bbb None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:39.465005 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c123c7b-a21a-48a1-aabc-e39308ac9bbb None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:39.470387 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 682/1374] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:47:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:39.479744 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c77845-3941-4dd8-80d1-170d5ccae19c None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:39.479744 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c77845-3941-4dd8-80d1-170d5ccae19c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:39.479744 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c77845-3941-4dd8-80d1-170d5ccae19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:39.552964 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-c4c77845-3941-4dd8-80d1-170d5ccae19c None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:39.554220 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c4c77845-3941-4dd8-80d1-170d5ccae19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:39.663118 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 693/1375] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:47:39.966810 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c123c7b-a21a-48a1-aabc-e39308ac9bbb None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:39.968480 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5c123c7b-a21a-48a1-aabc-e39308ac9bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:40.122751 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c123c7b-a21a-48a1-aabc-e39308ac9bbb None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:40.174461 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:40.238628 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275f117-254b-4b65-9c89-68b67844b8bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:40.239164 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275f117-254b-4b65-9c89-68b67844b8bf service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:40.239440 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275f117-254b-4b65-9c89-68b67844b8bf service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:40.239706 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275f117-254b-4b65-9c89-68b67844b8bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:40.241320 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0275f117-254b-4b65-9c89-68b67844b8bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:40.334602 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275f117-254b-4b65-9c89-68b67844b8bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:40.336223 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275f117-254b-4b65-9c89-68b67844b8bf service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:40.355587 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 683/1376] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:47:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:47:42.290741 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fbdf6-f3e5-43f2-86ab-c1d71197e550 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:42.291252 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fbdf6-f3e5-43f2-86ab-c1d71197e550 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:42.291252 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fbdf6-f3e5-43f2-86ab-c1d71197e550 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:42.292627 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 694/1377] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:42.298195 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57b5cb-4df7-484e-a715-ab8fc8bf68bd None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:42.298603 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57b5cb-4df7-484e-a715-ab8fc8bf68bd None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:42.298842 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57b5cb-4df7-484e-a715-ab8fc8bf68bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:42.383245 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-6c57b5cb-4df7-484e-a715-ab8fc8bf68bd None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:42.384469 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6c57b5cb-4df7-484e-a715-ab8fc8bf68bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:42.392451 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:42.506555 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 684/1378] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:47:42.803670 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fbdf6-f3e5-43f2-86ab-c1d71197e550 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:42.805821 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a88fbdf6-f3e5-43f2-86ab-c1d71197e550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:42.883511 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:43.007123 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fbdf6-f3e5-43f2-86ab-c1d71197e550 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:43.131652 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a95da-41c6-49ec-82c5-0d96e3fcb208 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:43.132188 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a95da-41c6-49ec-82c5-0d96e3fcb208 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:43.132474 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a95da-41c6-49ec-82c5-0d96e3fcb208 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:43.132743 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a95da-41c6-49ec-82c5-0d96e3fcb208 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:43.134355 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-378a95da-41c6-49ec-82c5-0d96e3fcb208 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:43.155020 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:43.232004 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a95da-41c6-49ec-82c5-0d96e3fcb208 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:43.233747 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a95da-41c6-49ec-82c5-0d96e3fcb208 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:43.253127 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 695/1379] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:47:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:47:45.177920 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099f28c-5d51-4190-bedb-c9445265386d None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:45.178433 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099f28c-5d51-4190-bedb-c9445265386d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:45.178433 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099f28c-5d51-4190-bedb-c9445265386d None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:45.179972 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 685/1380] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:45.185387 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81201b69-255a-4b49-a23d-f416d219908b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:45.185834 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81201b69-255a-4b49-a23d-f416d219908b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:45.186013 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81201b69-255a-4b49-a23d-f416d219908b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:45.260399 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-81201b69-255a-4b49-a23d-f416d219908b None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:45.261528 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-81201b69-255a-4b49-a23d-f416d219908b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:45.362352 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:45.374388 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 696/1381] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:47:45.671421 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099f28c-5d51-4190-bedb-c9445265386d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:45.673248 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3099f28c-5d51-4190-bedb-c9445265386d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:45.834196 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:45.847039 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099f28c-5d51-4190-bedb-c9445265386d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:45.976790 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247e60b-2b75-41bd-a1b8-b84c535cb507 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:45.977799 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247e60b-2b75-41bd-a1b8-b84c535cb507 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:45.978652 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247e60b-2b75-41bd-a1b8-b84c535cb507 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:45.978937 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247e60b-2b75-41bd-a1b8-b84c535cb507 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:45.980560 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7247e60b-2b75-41bd-a1b8-b84c535cb507 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:46.082467 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247e60b-2b75-41bd-a1b8-b84c535cb507 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:46.084144 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247e60b-2b75-41bd-a1b8-b84c535cb507 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:46.100906 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:46.107281 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 686/1382] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:47:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:47:48.323537 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db1919-5768-4e04-911c-504880867eb4 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:48.324214 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db1919-5768-4e04-911c-504880867eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:48.324318 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db1919-5768-4e04-911c-504880867eb4 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:48.326475 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 697/1383] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:47:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:48.334176 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daf6e5-a830-4d49-a716-8884ee8dabdd None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:48.334878 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daf6e5-a830-4d49-a716-8884ee8dabdd None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:48.334878 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daf6e5-a830-4d49-a716-8884ee8dabdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:48.407260 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-84daf6e5-a830-4d49-a716-8884ee8dabdd None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:48.408709 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-84daf6e5-a830-4d49-a716-8884ee8dabdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:48.522563 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 687/1384] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:47:48.818290 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db1919-5768-4e04-911c-504880867eb4 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:48.820373 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-69db1919-5768-4e04-911c-504880867eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:48.989205 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db1919-5768-4e04-911c-504880867eb4 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:49.058610 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:49.110551 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db2d44-ac6b-41b6-99ac-74bb4fdc635f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:49.111518 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db2d44-ac6b-41b6-99ac-74bb4fdc635f service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:49.111881 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db2d44-ac6b-41b6-99ac-74bb4fdc635f service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:49.112331 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db2d44-ac6b-41b6-99ac-74bb4fdc635f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:49.114524 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-18db2d44-ac6b-41b6-99ac-74bb4fdc635f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:49.232591 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db2d44-ac6b-41b6-99ac-74bb4fdc635f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:49.234340 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db2d44-ac6b-41b6-99ac-74bb4fdc635f service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:49.252791 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 698/1385] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:47:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:47:51.158178 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea0f38-6fda-45a0-aa81-4c32028db3e7 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:51.158864 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea0f38-6fda-45a0-aa81-4c32028db3e7 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:51.158864 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea0f38-6fda-45a0-aa81-4c32028db3e7 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:51.159936 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 688/1386] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:51.165884 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26256def-b1aa-425f-8494-6c397cc8a538 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:51.166361 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26256def-b1aa-425f-8494-6c397cc8a538 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:51.166644 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26256def-b1aa-425f-8494-6c397cc8a538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:51.246530 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-26256def-b1aa-425f-8494-6c397cc8a538 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:51.248184 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-26256def-b1aa-425f-8494-6c397cc8a538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:51.284417 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:51.369038 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 699/1387] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:47:51.659815 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea0f38-6fda-45a0-aa81-4c32028db3e7 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:51.661796 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1dea0f38-6fda-45a0-aa81-4c32028db3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:51.760850 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:51.845565 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea0f38-6fda-45a0-aa81-4c32028db3e7 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:51.985515 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31322095-a3b8-431d-9cb8-8af2f065545c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:51.986161 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31322095-a3b8-431d-9cb8-8af2f065545c service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:51.986454 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31322095-a3b8-431d-9cb8-8af2f065545c service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:51.986699 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31322095-a3b8-431d-9cb8-8af2f065545c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:51.988302 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-31322095-a3b8-431d-9cb8-8af2f065545c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:52.031322 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:52.095287 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31322095-a3b8-431d-9cb8-8af2f065545c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:52.096937 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31322095-a3b8-431d-9cb8-8af2f065545c service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:52.115132 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 689/1388] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:47:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:47:54.025418 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4328c-9799-4b4f-abfa-bc88583106ef None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:54.026055 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4328c-9799-4b4f-abfa-bc88583106ef None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:54.026055 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4328c-9799-4b4f-abfa-bc88583106ef None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:54.027238 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 700/1389] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:54.032982 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee1532-cec6-4326-a72a-2e93f799e254 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:54.033449 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee1532-cec6-4326-a72a-2e93f799e254 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:54.033552 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee1532-cec6-4326-a72a-2e93f799e254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:54.110630 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-d1ee1532-cec6-4326-a72a-2e93f799e254 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:54.111849 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d1ee1532-cec6-4326-a72a-2e93f799e254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:54.214728 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 690/1390] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:47:54.505866 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e4328c-9799-4b4f-abfa-bc88583106ef None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:54.505866 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-70e4328c-9799-4b4f-abfa-bc88583106ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:54.566511 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda46e6-07bf-480e-bad4-99000ce8c28f None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:54.566822 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda46e6-07bf-480e-bad4-99000ce8c28f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:54.567097 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda46e6-07bf-480e-bad4-99000ce8c28f None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:54.568457 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 691/1391] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:47:54.573448 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5a3d6-1125-4bd1-9f8f-20aad3ff0c31 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:54.573793 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5a3d6-1125-4bd1-9f8f-20aad3ff0c31 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:54.574359 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5a3d6-1125-4bd1-9f8f-20aad3ff0c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:54.591036 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:54.650095 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-5bd5a3d6-1125-4bd1-9f8f-20aad3ff0c31 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:54.651743 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5bd5a3d6-1125-4bd1-9f8f-20aad3ff0c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:54.683311 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e4328c-9799-4b4f-abfa-bc88583106ef None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:54.704012 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:54.759168 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 692/1392] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:47:54.810232 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2110a13-80d0-422d-8036-ca681608c065 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:54.811201 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2110a13-80d0-422d-8036-ca681608c065 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:54.811601 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2110a13-80d0-422d-8036-ca681608c065 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:54.811861 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2110a13-80d0-422d-8036-ca681608c065 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:54.813825 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c2110a13-80d0-422d-8036-ca681608c065 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:54.910139 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2110a13-80d0-422d-8036-ca681608c065 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:54.911760 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2110a13-80d0-422d-8036-ca681608c065 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:54.930080 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 701/1393] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:47:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:47:55.068515 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce39415-f300-44a3-8072-224004d30ae1 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:55.069082 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce39415-f300-44a3-8072-224004d30ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:55.069082 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce39415-f300-44a3-8072-224004d30ae1 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:55.071044 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 693/1394] 10.222.0.52 () {54 vars in 967 bytes} [Sun Aug 28 00:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:55.076600 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de955620-64a5-474a-894f-7bdc62432f17 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:55.077343 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de955620-64a5-474a-894f-7bdc62432f17 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:55.077343 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de955620-64a5-474a-894f-7bdc62432f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:55.106441 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:55.162125 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-de955620-64a5-474a-894f-7bdc62432f17 None None] MFA Rules not processed for user `34fd9f7932e14a409d7668d40ff6680e`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:55.163317 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-de955620-64a5-474a-894f-7bdc62432f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:55.240542 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 702/1395] 10.222.0.52 () {58 vars in 1064 bytes} [Sun Aug 28 00:47:55 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:47:55.248163 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce39415-f300-44a3-8072-224004d30ae1 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:55.249689 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bce39415-f300-44a3-8072-224004d30ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:55.351547 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:55.359602 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce39415-f300-44a3-8072-224004d30ae1 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:55.446816 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9e9a8-e18f-4b9c-bb82-8fef45211660 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34fd9f7932e14a409d7668d40ff6680e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:55.447413 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9e9a8-e18f-4b9c-bb82-8fef45211660 service glance] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:55.447686 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9e9a8-e18f-4b9c-bb82-8fef45211660 service glance] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:55.447953 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9e9a8-e18f-4b9c-bb82-8fef45211660 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:55.449538 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-fdd9e9a8-e18f-4b9c-bb82-8fef45211660 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:55.572186 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd9e9a8-e18f-4b9c-bb82-8fef45211660 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:55.573744 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd9e9a8-e18f-4b9c-bb82-8fef45211660 service glance] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:55.593775 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 694/1396] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:47:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:47:56.331120 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92a218-37c8-465b-834d-09e4ae8b1cb9 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:56.331608 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92a218-37c8-465b-834d-09e4ae8b1cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:56.331608 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92a218-37c8-465b-834d-09e4ae8b1cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:56.401644 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-db92a218-37c8-465b-834d-09e4ae8b1cb9 None None] MFA Rules not processed for user `3302fdf33b5b4583a10e7c760c577cda`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:56.403033 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-db92a218-37c8-465b-834d-09e4ae8b1cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:56.462844 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:56.492693 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 703/1397] 10.222.0.52 () {58 vars in 1009 bytes} [Sun Aug 28 00:47:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:47:56.537420 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d24717-8657-455c-b672-c840872ae794 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:56.537420 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d24717-8657-455c-b672-c840872ae794 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:56.537420 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d24717-8657-455c-b672-c840872ae794 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:56.537420 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 695/1398] 10.222.0.52 () {54 vars in 943 bytes} [Sun Aug 28 00:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:56.544005 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03016846-7cb2-465e-9da4-bff72c39c410 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:56.544240 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03016846-7cb2-465e-9da4-bff72c39c410 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:56.544524 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03016846-7cb2-465e-9da4-bff72c39c410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:56.626984 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-03016846-7cb2-465e-9da4-bff72c39c410 None None] MFA Rules not processed for user `a80a6019cf424c16a1d461a632cf8568`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:56.628100 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-03016846-7cb2-465e-9da4-bff72c39c410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:56.735410 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 704/1399] 10.222.0.52 () {58 vars in 1040 bytes} [Sun Aug 28 00:47:56 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:47:56.744899 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d24717-8657-455c-b672-c840872ae794 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:56.746508 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e5d24717-8657-455c-b672-c840872ae794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:56.772148 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:56.887937 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d24717-8657-455c-b672-c840872ae794 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:56.900228 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6938f5d-4d84-4b4e-bb63-d48c6c06b395 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:56.900514 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6938f5d-4d84-4b4e-bb63-d48c6c06b395 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:56.900809 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6938f5d-4d84-4b4e-bb63-d48c6c06b395 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:56.902679 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 705/1400] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:56.908469 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09421191-327f-486f-8b66-22c879311de2 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:56.908753 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09421191-327f-486f-8b66-22c879311de2 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:56.909027 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09421191-327f-486f-8b66-22c879311de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:56.956103 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:56.979119 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-09421191-327f-486f-8b66-22c879311de2 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:56.980320 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-09421191-327f-486f-8b66-22c879311de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:56.995816 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee530b01-0375-4b99-b7c2-721be15aa7ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80a6019cf424c16a1d461a632cf8568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:56.996448 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee530b01-0375-4b99-b7c2-721be15aa7ca service swift] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:56.996702 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee530b01-0375-4b99-b7c2-721be15aa7ca service swift] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:56.996975 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee530b01-0375-4b99-b7c2-721be15aa7ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:56.998665 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ee530b01-0375-4b99-b7c2-721be15aa7ca service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:57.006077 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:57.082851 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee530b01-0375-4b99-b7c2-721be15aa7ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:57.083252 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 706/1401] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:47:57.086518 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee530b01-0375-4b99-b7c2-721be15aa7ca service swift] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:57.096076 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 696/1402] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Aug 28 00:47:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 00:47:57.379333 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09421191-327f-486f-8b66-22c879311de2 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:57.380774 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-09421191-327f-486f-8b66-22c879311de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:57.507550 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09421191-327f-486f-8b66-22c879311de2 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:57.511491 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:57.653457 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb80d62-80b7-4551-8b31-c844469dedc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:57.654100 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb80d62-80b7-4551-8b31-c844469dedc2 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:57.654444 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb80d62-80b7-4551-8b31-c844469dedc2 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:57.655368 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb80d62-80b7-4551-8b31-c844469dedc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:57.657007 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-cdb80d62-80b7-4551-8b31-c844469dedc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:57.767051 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb80d62-80b7-4551-8b31-c844469dedc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:57.768615 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb80d62-80b7-4551-8b31-c844469dedc2 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:57.794824 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 707/1403] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:47:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:47:59.745215 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64539fa-82b7-40d4-9b5c-e7a21d0350c9 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:59.745815 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64539fa-82b7-40d4-9b5c-e7a21d0350c9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:59.745815 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64539fa-82b7-40d4-9b5c-e7a21d0350c9 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:59.747568 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 697/1404] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:59.753110 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d169bf3-bde1-4c3c-8488-8eea29a413d1 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:59.753583 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d169bf3-bde1-4c3c-8488-8eea29a413d1 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:59.753679 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d169bf3-bde1-4c3c-8488-8eea29a413d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:59.766788 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:59.829425 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-7d169bf3-bde1-4c3c-8488-8eea29a413d1 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:59.830709 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-7d169bf3-bde1-4c3c-8488-8eea29a413d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:59.949224 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 708/1405] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:48:00.247008 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64539fa-82b7-40d4-9b5c-e7a21d0350c9 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:00.249658 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f64539fa-82b7-40d4-9b5c-e7a21d0350c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:00.421124 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64539fa-82b7-40d4-9b5c-e7a21d0350c9 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:00.424120 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:00.559596 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18337d-f3f5-46f5-809a-363a9dfcc65a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:00.560202 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18337d-f3f5-46f5-809a-363a9dfcc65a service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:00.560630 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18337d-f3f5-46f5-809a-363a9dfcc65a service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:00.560934 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18337d-f3f5-46f5-809a-363a9dfcc65a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:00.562687 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ee18337d-f3f5-46f5-809a-363a9dfcc65a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:00.661860 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18337d-f3f5-46f5-809a-363a9dfcc65a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:00.663504 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18337d-f3f5-46f5-809a-363a9dfcc65a service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:00.687545 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 698/1406] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:48:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:48:02.643089 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750269d-c950-4f1a-8c92-e50583e02675 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:02.643708 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750269d-c950-4f1a-8c92-e50583e02675 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:02.643708 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750269d-c950-4f1a-8c92-e50583e02675 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:02.645053 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 709/1407] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:02.650640 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4c53d-793e-4dba-9c5f-207245bdda96 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:02.651429 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4c53d-793e-4dba-9c5f-207245bdda96 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:02.651707 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4c53d-793e-4dba-9c5f-207245bdda96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:02.662607 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:02.727618 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-54f4c53d-793e-4dba-9c5f-207245bdda96 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:02.728950 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-54f4c53d-793e-4dba-9c5f-207245bdda96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:02.847930 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 699/1408] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:48:03.173119 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750269d-c950-4f1a-8c92-e50583e02675 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:03.174873 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6750269d-c950-4f1a-8c92-e50583e02675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:03.287485 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:03.354117 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750269d-c950-4f1a-8c92-e50583e02675 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:03.478951 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98fe37-6646-48d1-96ac-75b27234ec28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:03.479660 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98fe37-6646-48d1-96ac-75b27234ec28 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:03.479991 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98fe37-6646-48d1-96ac-75b27234ec28 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:03.480314 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98fe37-6646-48d1-96ac-75b27234ec28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:03.482385 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-4c98fe37-6646-48d1-96ac-75b27234ec28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:03.550472 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:03.600903 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98fe37-6646-48d1-96ac-75b27234ec28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:03.603252 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98fe37-6646-48d1-96ac-75b27234ec28 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:03.630039 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 710/1409] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:48:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:48:12.846290 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=62 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:13.623165 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=23 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:19.850043 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bb799-0882-4d91-b08e-f81b4cf6a667 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:19.850575 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bb799-0882-4d91-b08e-f81b4cf6a667 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:19.850575 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bb799-0882-4d91-b08e-f81b4cf6a667 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:19.852254 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 700/1410] 10.222.0.52 () {54 vars in 918 bytes} [Sun Aug 28 00:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:19.857708 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37216c94-b863-4ead-bb20-41b9077b77c3 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:19.858226 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37216c94-b863-4ead-bb20-41b9077b77c3 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:19.858335 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37216c94-b863-4ead-bb20-41b9077b77c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:19.936670 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-37216c94-b863-4ead-bb20-41b9077b77c3 None None] MFA Rules not processed for user `ae87149f6ab04a9997263598737ae27e`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:19.937821 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-37216c94-b863-4ead-bb20-41b9077b77c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:20.050700 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 711/1411] 10.222.0.52 () {58 vars in 1015 bytes} [Sun Aug 28 00:48:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:48:20.065610 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c21f47-b49b-4028-9df8-9b321c6acf92 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:20.065923 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c21f47-b49b-4028-9df8-9b321c6acf92 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:20.066190 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c21f47-b49b-4028-9df8-9b321c6acf92 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:20.067537 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 701/1412] 10.222.0.52 () {54 vars in 918 bytes} [Sun Aug 28 00:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:20.072345 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dcb00-3b64-4da9-851f-3c48b9013578 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:20.072633 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dcb00-3b64-4da9-851f-3c48b9013578 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:20.072908 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dcb00-3b64-4da9-851f-3c48b9013578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:20.147166 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:20.151394 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-803dcb00-3b64-4da9-851f-3c48b9013578 None None] MFA Rules not processed for user `f890ff4e7807477db7f17c2f6434dce8`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:20.152937 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-803dcb00-3b64-4da9-851f-3c48b9013578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:20.280245 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 712/1413] 10.222.0.52 () {58 vars in 1015 bytes} [Sun Aug 28 00:48:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:48:22.666375 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd5427-b324-4038-8549-fc8ab3c91383 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:22.666975 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd5427-b324-4038-8549-fc8ab3c91383 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:22.667131 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd5427-b324-4038-8549-fc8ab3c91383 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:22.669165 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:48:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:22.674838 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538c508-b598-4d8e-96d3-a1330269d2a7 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:22.675314 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538c508-b598-4d8e-96d3-a1330269d2a7 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:22.675436 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538c508-b598-4d8e-96d3-a1330269d2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:22.743650 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-a538c508-b598-4d8e-96d3-a1330269d2a7 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:22.744857 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a538c508-b598-4d8e-96d3-a1330269d2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:22.808583 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:22.859427 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:48:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:48:23.167650 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd5427-b324-4038-8549-fc8ab3c91383 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:23.169866 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8cdd5427-b324-4038-8549-fc8ab3c91383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:23.343428 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd5427-b324-4038-8549-fc8ab3c91383 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:23.427753 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:23.469778 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea821c-edc7-439a-9eee-0edd9b59ad29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:23.470483 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea821c-edc7-439a-9eee-0edd9b59ad29 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:23.470762 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea821c-edc7-439a-9eee-0edd9b59ad29 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:23.471032 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea821c-edc7-439a-9eee-0edd9b59ad29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:23.472632 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b6ea821c-edc7-439a-9eee-0edd9b59ad29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:23.570895 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea821c-edc7-439a-9eee-0edd9b59ad29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:23.572523 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea821c-edc7-439a-9eee-0edd9b59ad29 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:23.594784 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 703/1416] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:48:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:48:24.509749 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aeba2c-2d0b-4b0e-9126-dbd2fb645cbb None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:24.510372 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aeba2c-2d0b-4b0e-9126-dbd2fb645cbb None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:24.510372 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aeba2c-2d0b-4b0e-9126-dbd2fb645cbb None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:24.512426 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 00:48:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:24.519749 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c51a7e-bdd9-4c0e-bcc6-9c6368fa0fec None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:24.520223 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c51a7e-bdd9-4c0e-bcc6-9c6368fa0fec None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:24.520337 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c51a7e-bdd9-4c0e-bcc6-9c6368fa0fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:24.599751 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-84c51a7e-bdd9-4c0e-bcc6-9c6368fa0fec None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:24.600960 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-84c51a7e-bdd9-4c0e-bcc6-9c6368fa0fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:24.630633 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:24.706768 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 00:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:48:24.865535 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aeba2c-2d0b-4b0e-9126-dbd2fb645cbb None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:24.867109 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b7aeba2c-2d0b-4b0e-9126-dbd2fb645cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:25.023298 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aeba2c-2d0b-4b0e-9126-dbd2fb645cbb None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:25.065533 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:25.148343 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d4159-59c1-46c8-87d9-c2c8b8a84223 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:25.148878 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d4159-59c1-46c8-87d9-c2c8b8a84223 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:25.149156 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d4159-59c1-46c8-87d9-c2c8b8a84223 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:25.149402 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d4159-59c1-46c8-87d9-c2c8b8a84223 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:25.151097 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a52d4159-59c1-46c8-87d9-c2c8b8a84223 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:25.255193 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d4159-59c1-46c8-87d9-c2c8b8a84223 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:25.256808 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d4159-59c1-46c8-87d9-c2c8b8a84223 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:25.281774 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 715/1419] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:48:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:48:26.191283 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6d3e6-7eb9-4ca8-8f75-4bdc70516247 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:26.191864 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6d3e6-7eb9-4ca8-8f75-4bdc70516247 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:26.191864 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6d3e6-7eb9-4ca8-8f75-4bdc70516247 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:26.194024 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 00:48:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:26.202047 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6e437-686e-4f54-864b-24831e122019 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:26.202453 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6e437-686e-4f54-864b-24831e122019 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:26.202638 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6e437-686e-4f54-864b-24831e122019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:26.263229 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:26.286106 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-cfa6e437-686e-4f54-864b-24831e122019 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:26.287335 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-cfa6e437-686e-4f54-864b-24831e122019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:26.393057 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 00:48:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:48:26.552473 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6d3e6-7eb9-4ca8-8f75-4bdc70516247 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:26.554027 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b6f6d3e6-7eb9-4ca8-8f75-4bdc70516247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:26.728524 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6d3e6-7eb9-4ca8-8f75-4bdc70516247 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:26.743203 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:26.849575 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afb25e-4de0-4f51-b84d-3b4c0591e1ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:26.850204 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afb25e-4de0-4f51-b84d-3b4c0591e1ae service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:26.850476 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afb25e-4de0-4f51-b84d-3b4c0591e1ae service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:26.850741 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afb25e-4de0-4f51-b84d-3b4c0591e1ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:26.852638 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-64afb25e-4de0-4f51-b84d-3b4c0591e1ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:26.957358 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afb25e-4de0-4f51-b84d-3b4c0591e1ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:26.959061 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afb25e-4de0-4f51-b84d-3b4c0591e1ae service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:26.977480 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 706/1422] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:48:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:48:27.843212 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d9824-8a41-40cf-bbd0-039a8429d070 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:27.843765 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d9824-8a41-40cf-bbd0-039a8429d070 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:27.843765 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d9824-8a41-40cf-bbd0-039a8429d070 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:27.845015 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 00:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:27.851130 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767737a-f72f-43d1-b1e5-9f6f1421431b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:27.852190 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767737a-f72f-43d1-b1e5-9f6f1421431b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:27.852341 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767737a-f72f-43d1-b1e5-9f6f1421431b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:27.876693 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:27.943074 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-4767737a-f72f-43d1-b1e5-9f6f1421431b None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:27.944312 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4767737a-f72f-43d1-b1e5-9f6f1421431b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:28.053861 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 00:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:48:28.212406 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d9824-8a41-40cf-bbd0-039a8429d070 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:28.215107 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-213d9824-8a41-40cf-bbd0-039a8429d070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:28.337380 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:28.377200 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d9824-8a41-40cf-bbd0-039a8429d070 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:28.507360 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9620b-bbdc-4114-9316-80aab00ff01c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:28.507881 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9620b-bbdc-4114-9316-80aab00ff01c service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:28.508157 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9620b-bbdc-4114-9316-80aab00ff01c service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:28.508423 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9620b-bbdc-4114-9316-80aab00ff01c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:28.510047 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3ab9620b-bbdc-4114-9316-80aab00ff01c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:28.589943 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:28.604612 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9620b-bbdc-4114-9316-80aab00ff01c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:28.606423 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9620b-bbdc-4114-9316-80aab00ff01c service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:28.624773 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 718/1425] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:48:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:48:29.516475 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cab00-5cda-4776-b04c-42b5e375f320 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:29.517043 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cab00-5cda-4776-b04c-42b5e375f320 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:29.517043 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cab00-5cda-4776-b04c-42b5e375f320 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:29.518415 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 00:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:29.524420 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2d2a1-e121-46ad-9404-1acb4411ff8d None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:29.525146 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2d2a1-e121-46ad-9404-1acb4411ff8d None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:29.525322 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2d2a1-e121-46ad-9404-1acb4411ff8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:29.610125 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-c2f2d2a1-e121-46ad-9404-1acb4411ff8d None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:29.611341 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c2f2d2a1-e121-46ad-9404-1acb4411ff8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:29.712897 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 00:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:48:29.862410 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870cab00-5cda-4776-b04c-42b5e375f320 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:29.863928 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-870cab00-5cda-4776-b04c-42b5e375f320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:29.966244 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:30.042618 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870cab00-5cda-4776-b04c-42b5e375f320 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:30.167319 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9990e-32a9-402e-b35d-447874893d48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:30.168146 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9990e-32a9-402e-b35d-447874893d48 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:30.168436 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9990e-32a9-402e-b35d-447874893d48 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:30.168705 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9990e-32a9-402e-b35d-447874893d48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:30.170379 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c3d9990e-32a9-402e-b35d-447874893d48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:30.219319 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:30.265780 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d9990e-32a9-402e-b35d-447874893d48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:30.267425 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d9990e-32a9-402e-b35d-447874893d48 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:30.286594 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 709/1428] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:48:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:48:31.085356 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58b8da-16fa-4a7f-9330-524abf09b0cc None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:31.085921 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58b8da-16fa-4a7f-9330-524abf09b0cc None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:31.086015 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58b8da-16fa-4a7f-9330-524abf09b0cc None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:31.088248 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 00:48:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:31.098114 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757ad00-c22a-42ec-b51c-374c074d20be None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:31.098537 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757ad00-c22a-42ec-b51c-374c074d20be None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:31.098778 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757ad00-c22a-42ec-b51c-374c074d20be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:31.179889 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-6757ad00-c22a-42ec-b51c-374c074d20be None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:31.181105 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6757ad00-c22a-42ec-b51c-374c074d20be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:31.295823 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 00:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:48:31.450777 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58b8da-16fa-4a7f-9330-524abf09b0cc None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:31.453283 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6a58b8da-16fa-4a7f-9330-524abf09b0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:31.525131 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:31.631938 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58b8da-16fa-4a7f-9330-524abf09b0cc None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:31.755708 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23ce52-3061-4bfc-be14-b8836e3904d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:31.756528 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23ce52-3061-4bfc-be14-b8836e3904d8 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:31.756879 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23ce52-3061-4bfc-be14-b8836e3904d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:31.757240 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23ce52-3061-4bfc-be14-b8836e3904d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:31.759869 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-de23ce52-3061-4bfc-be14-b8836e3904d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:31.767930 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:31.860249 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23ce52-3061-4bfc-be14-b8836e3904d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:31.862824 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23ce52-3061-4bfc-be14-b8836e3904d8 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:31.891097 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 721/1431] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:48:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:48:32.721198 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28c46d-a977-4a41-b412-cdfe7471ab2a None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:32.722151 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28c46d-a977-4a41-b412-cdfe7471ab2a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:32.722151 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28c46d-a977-4a41-b412-cdfe7471ab2a None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:32.724310 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 00:48:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:32.732533 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3eec88-357c-4cdd-8e89-426ec4058782 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:32.732976 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3eec88-357c-4cdd-8e89-426ec4058782 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:32.733096 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3eec88-357c-4cdd-8e89-426ec4058782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:32.815753 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-fb3eec88-357c-4cdd-8e89-426ec4058782 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:32.816988 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-fb3eec88-357c-4cdd-8e89-426ec4058782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:32.884996 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:32.916319 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 00:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:48:33.071151 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28c46d-a977-4a41-b412-cdfe7471ab2a None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:33.072571 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0b28c46d-a977-4a41-b412-cdfe7471ab2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:33.093295 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:33.255886 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28c46d-a977-4a41-b412-cdfe7471ab2a None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:33.360740 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:33.389636 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52999f35-b7d8-44a0-b596-bbc0ec1df38b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:33.390286 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52999f35-b7d8-44a0-b596-bbc0ec1df38b service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:33.390563 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52999f35-b7d8-44a0-b596-bbc0ec1df38b service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:33.390799 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52999f35-b7d8-44a0-b596-bbc0ec1df38b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:33.392501 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-52999f35-b7d8-44a0-b596-bbc0ec1df38b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:33.496462 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52999f35-b7d8-44a0-b596-bbc0ec1df38b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:33.498165 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52999f35-b7d8-44a0-b596-bbc0ec1df38b service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:33.517398 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 712/1434] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:48:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:48:34.322963 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998a17c-30e0-447b-9647-51a5703e5a65 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:34.323643 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998a17c-30e0-447b-9647-51a5703e5a65 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:34.323643 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998a17c-30e0-447b-9647-51a5703e5a65 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:34.324883 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 00:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:34.330919 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e06bd-8f7d-405f-a708-5d75feaa63f2 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:34.331676 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e06bd-8f7d-405f-a708-5d75feaa63f2 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:34.331848 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e06bd-8f7d-405f-a708-5d75feaa63f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:34.415091 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-1b2e06bd-8f7d-405f-a708-5d75feaa63f2 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:34.416324 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1b2e06bd-8f7d-405f-a708-5d75feaa63f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:34.460782 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:34.529109 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 00:48:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:48:34.677875 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998a17c-30e0-447b-9647-51a5703e5a65 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:34.679307 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f998a17c-30e0-447b-9647-51a5703e5a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:34.832898 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998a17c-30e0-447b-9647-51a5703e5a65 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:34.889683 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:34.953609 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a4c2d-ee61-41fc-8415-e15d9cb294fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:34.954168 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a4c2d-ee61-41fc-8415-e15d9cb294fb service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:34.954444 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a4c2d-ee61-41fc-8415-e15d9cb294fb service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:34.954713 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a4c2d-ee61-41fc-8415-e15d9cb294fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:34.956332 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ec9a4c2d-ee61-41fc-8415-e15d9cb294fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:35.049629 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a4c2d-ee61-41fc-8415-e15d9cb294fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:35.051273 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a4c2d-ee61-41fc-8415-e15d9cb294fb service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:35.069159 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 724/1437] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:48:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:48:35.925605 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860403d-b631-4e05-a498-17753a285c9d None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:35.926505 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860403d-b631-4e05-a498-17753a285c9d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:35.926669 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860403d-b631-4e05-a498-17753a285c9d None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:35.928698 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 00:48:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:35.936407 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd3adf-33e5-4579-8ae7-250907ba46a8 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:35.936853 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd3adf-33e5-4579-8ae7-250907ba46a8 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:35.936963 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd3adf-33e5-4579-8ae7-250907ba46a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:36.016782 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-b1bd3adf-33e5-4579-8ae7-250907ba46a8 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:36.018080 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b1bd3adf-33e5-4579-8ae7-250907ba46a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:36.020324 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:36.118638 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 00:48:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:48:36.276158 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860403d-b631-4e05-a498-17753a285c9d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:36.278759 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c860403d-b631-4e05-a498-17753a285c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:36.455057 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860403d-b631-4e05-a498-17753a285c9d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:36.484332 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:36.578954 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf1da2-e164-4d01-a3e6-e7fabd4363e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:36.579564 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf1da2-e164-4d01-a3e6-e7fabd4363e2 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:36.579844 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf1da2-e164-4d01-a3e6-e7fabd4363e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:36.580116 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf1da2-e164-4d01-a3e6-e7fabd4363e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:36.581715 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-31cf1da2-e164-4d01-a3e6-e7fabd4363e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:36.689647 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf1da2-e164-4d01-a3e6-e7fabd4363e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:36.691266 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf1da2-e164-4d01-a3e6-e7fabd4363e2 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:36.710774 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 715/1440] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:48:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:48:38.513905 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0d97c-5ae0-4926-afe9-1a5ff1ab4e53 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:38.514755 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0d97c-5ae0-4926-afe9-1a5ff1ab4e53 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:38.514755 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0d97c-5ae0-4926-afe9-1a5ff1ab4e53 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:38.516743 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:48:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:38.525915 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b1730-2191-4793-8e8e-71f3c6c34f72 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:38.526332 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b1730-2191-4793-8e8e-71f3c6c34f72 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:38.526470 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b1730-2191-4793-8e8e-71f3c6c34f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:38.583869 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:38.616834 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-4b9b1730-2191-4793-8e8e-71f3c6c34f72 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:38.618072 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4b9b1730-2191-4793-8e8e-71f3c6c34f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:38.718946 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:48:38.999499 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0d97c-5ae0-4926-afe9-1a5ff1ab4e53 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:39.001061 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-67a0d97c-5ae0-4926-afe9-1a5ff1ab4e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:39.116585 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0d97c-5ae0-4926-afe9-1a5ff1ab4e53 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:39.151657 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:39.196086 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc8cc4-2a1a-46c6-9564-f4c8303b17dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:39.196688 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc8cc4-2a1a-46c6-9564-f4c8303b17dc service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:39.196961 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc8cc4-2a1a-46c6-9564-f4c8303b17dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:39.197229 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc8cc4-2a1a-46c6-9564-f4c8303b17dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:39.198870 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-0cfc8cc4-2a1a-46c6-9564-f4c8303b17dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:39.318513 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc8cc4-2a1a-46c6-9564-f4c8303b17dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:39.319962 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc8cc4-2a1a-46c6-9564-f4c8303b17dc service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:39.460129 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 727/1443] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:48:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:48:41.517483 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38417c3-45e5-4991-a5f6-2f519e9af8da None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:41.518577 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38417c3-45e5-4991-a5f6-2f519e9af8da None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:41.518577 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38417c3-45e5-4991-a5f6-2f519e9af8da None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:41.520670 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:48:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:41.527221 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3e3d9-83e4-4178-961a-d5c807dc6db9 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:41.527947 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3e3d9-83e4-4178-961a-d5c807dc6db9 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:41.528370 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3e3d9-83e4-4178-961a-d5c807dc6db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:41.601764 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-aca3e3d9-83e4-4178-961a-d5c807dc6db9 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:41.603020 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-aca3e3d9-83e4-4178-961a-d5c807dc6db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:41.617969 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:41.710463 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:48:42.006994 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38417c3-45e5-4991-a5f6-2f519e9af8da None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:42.009375 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c38417c3-45e5-4991-a5f6-2f519e9af8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:42.126357 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38417c3-45e5-4991-a5f6-2f519e9af8da None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:42.139112 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:42.206895 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9427a-d7f1-4b40-9182-645dfa987e8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:42.207409 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9427a-d7f1-4b40-9182-645dfa987e8a service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:42.207681 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9427a-d7f1-4b40-9182-645dfa987e8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:42.207945 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9427a-d7f1-4b40-9182-645dfa987e8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:42.209527 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-40c9427a-d7f1-4b40-9182-645dfa987e8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:42.320695 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9427a-d7f1-4b40-9182-645dfa987e8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:42.322192 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9427a-d7f1-4b40-9182-645dfa987e8a service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:42.342198 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 718/1446] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:48:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:48:44.554443 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d686b-062f-4450-bb48-6f42f34f32f5 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:44.554966 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d686b-062f-4450-bb48-6f42f34f32f5 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:44.555064 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d686b-062f-4450-bb48-6f42f34f32f5 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:44.557134 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:48:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:44.564899 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba69b4-6a8e-493c-a5d8-e4ee2c92c08b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:44.565313 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba69b4-6a8e-493c-a5d8-e4ee2c92c08b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:44.565447 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba69b4-6a8e-493c-a5d8-e4ee2c92c08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:44.621260 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:44.641057 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-70ba69b4-6a8e-493c-a5d8-e4ee2c92c08b None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:44.642310 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-70ba69b4-6a8e-493c-a5d8-e4ee2c92c08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:44.747574 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:48:45.031127 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d686b-062f-4450-bb48-6f42f34f32f5 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:45.032686 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-198d686b-062f-4450-bb48-6f42f34f32f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:45.138280 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d686b-062f-4450-bb48-6f42f34f32f5 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:45.178365 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:45.214557 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448712e-a154-4c5d-8984-4208383cad9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:45.215077 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448712e-a154-4c5d-8984-4208383cad9f service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:45.215344 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448712e-a154-4c5d-8984-4208383cad9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:45.215606 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448712e-a154-4c5d-8984-4208383cad9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:45.217171 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-2448712e-a154-4c5d-8984-4208383cad9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:45.331939 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448712e-a154-4c5d-8984-4208383cad9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:45.333372 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448712e-a154-4c5d-8984-4208383cad9f service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:45.352558 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 730/1449] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:48:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:48:47.367374 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c233e-2150-440a-ac97-9b4853073679 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:47.367968 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c233e-2150-440a-ac97-9b4853073679 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:47.367968 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c233e-2150-440a-ac97-9b4853073679 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:47.369270 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:47.375275 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd3038-defe-4404-96e7-343e6d337600 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:47.375748 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd3038-defe-4404-96e7-343e6d337600 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:47.375863 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd3038-defe-4404-96e7-343e6d337600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:47.442298 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-6afd3038-defe-4404-96e7-343e6d337600 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:47.443501 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6afd3038-defe-4404-96e7-343e6d337600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:47.468251 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:47.557351 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:48:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:48:47.838804 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c233e-2150-440a-ac97-9b4853073679 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:47.840678 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-906c233e-2150-440a-ac97-9b4853073679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:47.953303 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c233e-2150-440a-ac97-9b4853073679 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:47.976787 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:48.035495 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca127cb-4425-4d28-ba08-fe7196f483ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:48.036102 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca127cb-4425-4d28-ba08-fe7196f483ed service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:48.036378 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca127cb-4425-4d28-ba08-fe7196f483ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:48.036643 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca127cb-4425-4d28-ba08-fe7196f483ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:48.038285 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4ca127cb-4425-4d28-ba08-fe7196f483ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:48.161465 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca127cb-4425-4d28-ba08-fe7196f483ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:48.162879 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca127cb-4425-4d28-ba08-fe7196f483ed service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:48.181718 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 721/1452] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:48:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:48:50.388126 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95badb6c-36c4-4b6a-bdb4-35d5ee66e8cc None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:50.388760 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95badb6c-36c4-4b6a-bdb4-35d5ee66e8cc None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:50.388760 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95badb6c-36c4-4b6a-bdb4-35d5ee66e8cc None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:50.390694 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:48:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:50.396174 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc8eb8-4b0d-43da-b257-f75ae3a20240 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:50.396650 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc8eb8-4b0d-43da-b257-f75ae3a20240 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:50.396744 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc8eb8-4b0d-43da-b257-f75ae3a20240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:50.463648 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:50.467055 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-38bc8eb8-4b0d-43da-b257-f75ae3a20240 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:50.468630 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-38bc8eb8-4b0d-43da-b257-f75ae3a20240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:50.580144 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:48:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:48:50.866715 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95badb6c-36c4-4b6a-bdb4-35d5ee66e8cc None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:50.869271 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-95badb6c-36c4-4b6a-bdb4-35d5ee66e8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:50.979628 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95badb6c-36c4-4b6a-bdb4-35d5ee66e8cc None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:51.031495 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:51.072173 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da0dbe-01be-46cd-abc9-1d3560ef5fda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:51.072994 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da0dbe-01be-46cd-abc9-1d3560ef5fda service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:51.073273 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da0dbe-01be-46cd-abc9-1d3560ef5fda service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:51.073645 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da0dbe-01be-46cd-abc9-1d3560ef5fda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:51.075270 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-56da0dbe-01be-46cd-abc9-1d3560ef5fda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:51.193623 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da0dbe-01be-46cd-abc9-1d3560ef5fda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:51.195051 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da0dbe-01be-46cd-abc9-1d3560ef5fda service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:51.215158 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 733/1455] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:48:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:48:53.221248 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fbeab-6be4-45d3-9239-4bb4e3e690be None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:53.221799 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fbeab-6be4-45d3-9239-4bb4e3e690be None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:53.221799 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fbeab-6be4-45d3-9239-4bb4e3e690be None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:53.223700 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:48:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:53.229556 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f1033-53f6-46d1-9509-d5b437070786 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:53.230381 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f1033-53f6-46d1-9509-d5b437070786 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:53.230658 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f1033-53f6-46d1-9509-d5b437070786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:53.298554 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-155f1033-53f6-46d1-9509-d5b437070786 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:53.299780 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-155f1033-53f6-46d1-9509-d5b437070786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:53.332213 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:53.404443 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:48:53.691738 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fbeab-6be4-45d3-9239-4bb4e3e690be None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:53.693303 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-067fbeab-6be4-45d3-9239-4bb4e3e690be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:53.815170 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fbeab-6be4-45d3-9239-4bb4e3e690be None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:53.845569 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:53.895320 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b3ea9-53c4-4a95-aea5-55b51a0b4d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:53.895926 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b3ea9-53c4-4a95-aea5-55b51a0b4d18 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:53.896208 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b3ea9-53c4-4a95-aea5-55b51a0b4d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:53.896476 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b3ea9-53c4-4a95-aea5-55b51a0b4d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:53.898128 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-294b3ea9-53c4-4a95-aea5-55b51a0b4d18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:54.018131 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b3ea9-53c4-4a95-aea5-55b51a0b4d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:54.019586 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b3ea9-53c4-4a95-aea5-55b51a0b4d18 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:54.038717 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 724/1458] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:48:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:48:56.029887 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c3713-361e-4eac-b2ab-64f73d90453c None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:56.030705 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c3713-361e-4eac-b2ab-64f73d90453c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:56.030847 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c3713-361e-4eac-b2ab-64f73d90453c None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:56.032919 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:48:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:56.041315 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b753ae-0e93-4920-a822-ae37e17e45d5 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:56.041977 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b753ae-0e93-4920-a822-ae37e17e45d5 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:56.041977 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b753ae-0e93-4920-a822-ae37e17e45d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:56.112266 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b0b753ae-0e93-4920-a822-ae37e17e45d5 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:56.113498 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b0b753ae-0e93-4920-a822-ae37e17e45d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:56.123104 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:56.215570 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:48:56.498655 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c3713-361e-4eac-b2ab-64f73d90453c None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:56.501091 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-499c3713-361e-4eac-b2ab-64f73d90453c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:56.621655 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c3713-361e-4eac-b2ab-64f73d90453c None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:56.681408 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:56.701279 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8d7e7-cbb5-491f-bf8a-bec83c921f7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:56.701926 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8d7e7-cbb5-491f-bf8a-bec83c921f7f service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:56.702209 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8d7e7-cbb5-491f-bf8a-bec83c921f7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:56.702507 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8d7e7-cbb5-491f-bf8a-bec83c921f7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:56.704237 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-03a8d7e7-cbb5-491f-bf8a-bec83c921f7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:56.828673 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8d7e7-cbb5-491f-bf8a-bec83c921f7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:56.830126 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8d7e7-cbb5-491f-bf8a-bec83c921f7f service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:56.848835 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 736/1461] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:48:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:48:58.817281 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99728e-e900-44c5-b84b-5fc24ec32684 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:58.818187 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99728e-e900-44c5-b84b-5fc24ec32684 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:58.818187 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99728e-e900-44c5-b84b-5fc24ec32684 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:58.820260 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:48:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:58.826115 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a8aeb-e757-45ab-950d-e925f288164b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:58.826547 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a8aeb-e757-45ab-950d-e925f288164b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:58.826659 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a8aeb-e757-45ab-950d-e925f288164b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:58.893307 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-6b8a8aeb-e757-45ab-950d-e925f288164b None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:58.894530 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6b8a8aeb-e757-45ab-950d-e925f288164b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:58.933532 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:58.998553 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:48:59.280711 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99728e-e900-44c5-b84b-5fc24ec32684 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:59.282333 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3d99728e-e900-44c5-b84b-5fc24ec32684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:59.400452 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99728e-e900-44c5-b84b-5fc24ec32684 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:59.443536 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:59.492615 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee5544-2414-4d41-beae-b3141b9ca6e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:59.493223 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee5544-2414-4d41-beae-b3141b9ca6e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:59.493494 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee5544-2414-4d41-beae-b3141b9ca6e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:59.493754 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee5544-2414-4d41-beae-b3141b9ca6e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:59.495600 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e1ee5544-2414-4d41-beae-b3141b9ca6e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:59.616062 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee5544-2414-4d41-beae-b3141b9ca6e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:59.617520 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee5544-2414-4d41-beae-b3141b9ca6e7 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:59.637316 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 727/1464] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:48:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:49:01.574806 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d5a75-d9d5-4e2c-9c1a-643c12c0928b None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:49:01.575631 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d5a75-d9d5-4e2c-9c1a-643c12c0928b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:49:01.575732 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d5a75-d9d5-4e2c-9c1a-643c12c0928b None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:49:01.578164 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:49:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:49:01.584367 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614173e-69c7-4daf-b62d-13649f2d54e6 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:49:01.585214 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614173e-69c7-4daf-b62d-13649f2d54e6 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:49:01.585214 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614173e-69c7-4daf-b62d-13649f2d54e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:49:01.664433 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-7614173e-69c7-4daf-b62d-13649f2d54e6 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:49:01.665625 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7614173e-69c7-4daf-b62d-13649f2d54e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:49:01.684332 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:49:01.775525 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:49:02.058168 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d5a75-d9d5-4e2c-9c1a-643c12c0928b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:49:02.059735 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a91d5a75-d9d5-4e2c-9c1a-643c12c0928b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:49:02.180483 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d5a75-d9d5-4e2c-9c1a-643c12c0928b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:49:02.252811 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:49:02.260494 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436c7d8-4194-4755-8520-eb86664c6b81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:49:02.261094 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436c7d8-4194-4755-8520-eb86664c6b81 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:49:02.261369 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436c7d8-4194-4755-8520-eb86664c6b81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:49:02.261635 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436c7d8-4194-4755-8520-eb86664c6b81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:49:02.263300 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6436c7d8-4194-4755-8520-eb86664c6b81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:49:02.377016 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436c7d8-4194-4755-8520-eb86664c6b81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:49:02.378486 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436c7d8-4194-4755-8520-eb86664c6b81 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:49:02.396781 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 739/1467] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:49:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:49:04.332155 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731873e8-3725-4e4c-b348-3e1f041bca91 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:49:04.332791 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731873e8-3725-4e4c-b348-3e1f041bca91 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:49:04.332791 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731873e8-3725-4e4c-b348-3e1f041bca91 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:49:04.334113 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:49:04.340458 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32ce75-c794-44cd-8b53-046e6d1d8be1 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:49:04.340924 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32ce75-c794-44cd-8b53-046e6d1d8be1 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:49:04.341031 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32ce75-c794-44cd-8b53-046e6d1d8be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:49:04.418039 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-2f32ce75-c794-44cd-8b53-046e6d1d8be1 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:49:04.419823 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-2f32ce75-c794-44cd-8b53-046e6d1d8be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:49:04.473353 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:49:04.524189 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:49:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:49:04.825325 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731873e8-3725-4e4c-b348-3e1f041bca91 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:49:04.827238 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-731873e8-3725-4e4c-b348-3e1f041bca91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:49:04.963245 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731873e8-3725-4e4c-b348-3e1f041bca91 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:49:05.015030 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:49:05.041638 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ecf42-fae8-46f0-8fb4-0f78bf247bda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:49:05.042210 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ecf42-fae8-46f0-8fb4-0f78bf247bda service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:49:05.042564 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ecf42-fae8-46f0-8fb4-0f78bf247bda service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:49:05.042725 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ecf42-fae8-46f0-8fb4-0f78bf247bda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:49:05.044373 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8f5ecf42-fae8-46f0-8fb4-0f78bf247bda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:49:05.157226 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5ecf42-fae8-46f0-8fb4-0f78bf247bda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:49:05.158631 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5ecf42-fae8-46f0-8fb4-0f78bf247bda service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:49:05.184367 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 730/1470] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:49:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:49:14.521988 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=22 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:49:15.180869 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=66 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:49:25.197729 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4152b7-2267-4a40-aa2a-cd617fe4c999 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:49:25.198635 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4152b7-2267-4a40-aa2a-cd617fe4c999 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:49:25.198820 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4152b7-2267-4a40-aa2a-cd617fe4c999 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:49:25.200963 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 741/1471] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:49:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:49:25.210003 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be4c07-7c35-4c08-942e-db97c9dcc7cb None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:49:25.210733 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be4c07-7c35-4c08-942e-db97c9dcc7cb None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:49:25.210891 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be4c07-7c35-4c08-942e-db97c9dcc7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:49:25.284979 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-58be4c07-7c35-4c08-942e-db97c9dcc7cb None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:49:25.286227 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-58be4c07-7c35-4c08-942e-db97c9dcc7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:49:25.399356 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 731/1472] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:49:25.697779 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0422e5-b2d8-44fe-a19e-92db80627f13 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:49:25.698188 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0422e5-b2d8-44fe-a19e-92db80627f13 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:49:25.698560 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0422e5-b2d8-44fe-a19e-92db80627f13 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:49:25.700403 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 742/1473] 10.222.0.52 () {54 vars in 967 bytes} [Sun Aug 28 00:49:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:49:25.706590 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32a3ce-8f69-4fa3-bea2-70cae347ebd3 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:49:25.706851 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32a3ce-8f69-4fa3-bea2-70cae347ebd3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:49:25.707122 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32a3ce-8f69-4fa3-bea2-70cae347ebd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:49:25.787562 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-6b32a3ce-8f69-4fa3-bea2-70cae347ebd3 None None] MFA Rules not processed for user `34fd9f7932e14a409d7668d40ff6680e`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:49:25.788776 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6b32a3ce-8f69-4fa3-bea2-70cae347ebd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:49:25.811865 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:49:25.871606 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 732/1474] 10.222.0.52 () {58 vars in 1064 bytes} [Sun Aug 28 00:49:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:49:25.879275 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0422e5-b2d8-44fe-a19e-92db80627f13 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:49:25.880834 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6c0422e5-b2d8-44fe-a19e-92db80627f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:49:25.996211 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0422e5-b2d8-44fe-a19e-92db80627f13 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:49:26.071118 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e950edc-5b2b-44b7-852c-4c2fb8c067b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34fd9f7932e14a409d7668d40ff6680e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:49:26.071813 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e950edc-5b2b-44b7-852c-4c2fb8c067b4 service glance] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:49:26.071965 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e950edc-5b2b-44b7-852c-4c2fb8c067b4 service glance] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:49:26.072359 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e950edc-5b2b-44b7-852c-4c2fb8c067b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:49:26.074001 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-7e950edc-5b2b-44b7-852c-4c2fb8c067b4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:49:26.129873 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:49:26.186841 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e950edc-5b2b-44b7-852c-4c2fb8c067b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:49:26.188278 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e950edc-5b2b-44b7-852c-4c2fb8c067b4 service glance] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:49:26.207624 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 743/1475] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:49:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:49:28.195944 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aaf337-1c07-420f-b44c-d5c49c4c0d56 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:49:28.196585 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aaf337-1c07-420f-b44c-d5c49c4c0d56 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:49:28.196585 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aaf337-1c07-420f-b44c-d5c49c4c0d56 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:49:28.197953 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 733/1476] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:49:28.205701 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581152c-1fc1-4497-9829-2dca2350ce78 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:49:28.206623 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581152c-1fc1-4497-9829-2dca2350ce78 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:49:28.206623 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581152c-1fc1-4497-9829-2dca2350ce78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:49:28.282054 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-7581152c-1fc1-4497-9829-2dca2350ce78 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:49:28.283274 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-7581152c-1fc1-4497-9829-2dca2350ce78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:49:28.392307 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 744/1477] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:49:28.666055 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aaf337-1c07-420f-b44c-d5c49c4c0d56 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:49:28.667603 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-89aaf337-1c07-420f-b44c-d5c49c4c0d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:49:28.800846 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aaf337-1c07-420f-b44c-d5c49c4c0d56 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:49:28.853590 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:49:28.904841 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218f01b-8bac-4989-9868-2092cf536eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:49:28.905448 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218f01b-8bac-4989-9868-2092cf536eae admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:49:28.905726 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218f01b-8bac-4989-9868-2092cf536eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:49:28.906017 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218f01b-8bac-4989-9868-2092cf536eae admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:49:28.906662 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218f01b-8bac-4989-9868-2092cf536eae admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:49:28.908463 dv-cinder-master-3-smb devstack@keystone.service[81517]: WARNING py.warnings [None req-c218f01b-8bac-4989-9868-2092cf536eae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 00:49:28.908463 dv-cinder-master-3-smb devstack@keystone.service[81517]: warnings.warn(msg) Aug 28 00:49:28.908463 dv-cinder-master-3-smb devstack@keystone.service[81517]: Aug 28 00:49:28.909616 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218f01b-8bac-4989-9868-2092cf536eae admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:49:28.931763 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 734/1478] 10.222.0.52 () {56 vars in 1108 bytes} [Sun Aug 28 00:49:28 2022] GET /identity/v3/projects => generated 2553 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:49:30.825277 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd3930-3f25-4811-98c9-77b1f9085d39 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:49:30.825830 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd3930-3f25-4811-98c9-77b1f9085d39 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:49:30.825830 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd3930-3f25-4811-98c9-77b1f9085d39 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:49:30.827203 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 745/1479] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:49:30.833895 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3234350-dde8-40dd-919b-061aa52b2cac None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:49:30.834614 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3234350-dde8-40dd-919b-061aa52b2cac None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:49:30.834798 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3234350-dde8-40dd-919b-061aa52b2cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:49:30.915099 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a3234350-dde8-40dd-919b-061aa52b2cac None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:49:30.916390 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a3234350-dde8-40dd-919b-061aa52b2cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:49:31.025310 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 735/1480] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:49:31.326088 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd3930-3f25-4811-98c9-77b1f9085d39 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:49:31.327656 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b2cd3930-3f25-4811-98c9-77b1f9085d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:49:31.338663 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:49:31.486980 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd3930-3f25-4811-98c9-77b1f9085d39 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:49:31.578792 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:49:31.616214 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a039e9-2ed2-4563-842c-0cb7b9df3f41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:49:31.616824 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a039e9-2ed2-4563-842c-0cb7b9df3f41 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:49:31.617060 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a039e9-2ed2-4563-842c-0cb7b9df3f41 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:49:31.617355 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a039e9-2ed2-4563-842c-0cb7b9df3f41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:49:31.619104 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-52a039e9-2ed2-4563-842c-0cb7b9df3f41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:49:31.715040 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a039e9-2ed2-4563-842c-0cb7b9df3f41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:49:31.716632 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a039e9-2ed2-4563-842c-0cb7b9df3f41 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:49:31.735313 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 746/1481] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:49:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:49:33.853057 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963829f-d3dd-4e2d-8ec7-04831c5a1027 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:49:33.853591 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963829f-d3dd-4e2d-8ec7-04831c5a1027 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:49:33.853591 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963829f-d3dd-4e2d-8ec7-04831c5a1027 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:49:33.854999 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 736/1482] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:49:33.861326 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aba460-f01c-41c3-aff4-0a607ef134c7 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:49:33.862234 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aba460-f01c-41c3-aff4-0a607ef134c7 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:49:33.862388 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aba460-f01c-41c3-aff4-0a607ef134c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:49:33.931120 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-f9aba460-f01c-41c3-aff4-0a607ef134c7 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:49:33.932333 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f9aba460-f01c-41c3-aff4-0a607ef134c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:49:33.981126 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:49:34.044167 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 747/1483] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:49:34.334341 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963829f-d3dd-4e2d-8ec7-04831c5a1027 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:49:34.336781 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c963829f-d3dd-4e2d-8ec7-04831c5a1027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:49:34.375519 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:49:34.469660 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963829f-d3dd-4e2d-8ec7-04831c5a1027 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:49:34.552346 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3eb5b-41ad-48b1-92c3-d35af75e061b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:49:34.552964 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3eb5b-41ad-48b1-92c3-d35af75e061b service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:49:34.553239 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3eb5b-41ad-48b1-92c3-d35af75e061b service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:49:34.553506 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3eb5b-41ad-48b1-92c3-d35af75e061b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:49:34.555150 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2ff3eb5b-41ad-48b1-92c3-d35af75e061b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:49:34.635844 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:49:34.682157 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3eb5b-41ad-48b1-92c3-d35af75e061b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:49:34.683627 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3eb5b-41ad-48b1-92c3-d35af75e061b service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:49:34.702944 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 737/1484] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:49:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:49:36.661121 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7eef4-12ec-48c0-8c68-a142d538c307 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:49:36.661735 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7eef4-12ec-48c0-8c68-a142d538c307 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:49:36.661735 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7eef4-12ec-48c0-8c68-a142d538c307 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:49:36.663054 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 748/1485] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:49:36.668869 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49e4e1-ad0c-4129-b607-e1a1ea28140d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:49:36.669378 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49e4e1-ad0c-4129-b607-e1a1ea28140d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:49:36.669378 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49e4e1-ad0c-4129-b607-e1a1ea28140d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:49:36.761825 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-aa49e4e1-ad0c-4129-b607-e1a1ea28140d None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:49:36.763094 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-aa49e4e1-ad0c-4129-b607-e1a1ea28140d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:49:36.872575 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 738/1486] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:49:37.175039 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7eef4-12ec-48c0-8c68-a142d538c307 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:49:37.176583 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b1b7eef4-12ec-48c0-8c68-a142d538c307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:49:37.292203 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7eef4-12ec-48c0-8c68-a142d538c307 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:49:37.368661 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:49:37.370444 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87809c18-36de-4326-bafb-6d2b2f65f3aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:49:37.371033 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87809c18-36de-4326-bafb-6d2b2f65f3aa service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:49:37.371349 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87809c18-36de-4326-bafb-6d2b2f65f3aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:49:37.371647 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87809c18-36de-4326-bafb-6d2b2f65f3aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:49:37.374087 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-87809c18-36de-4326-bafb-6d2b2f65f3aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:49:37.493305 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87809c18-36de-4326-bafb-6d2b2f65f3aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:49:37.494725 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87809c18-36de-4326-bafb-6d2b2f65f3aa service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:49:37.513955 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 749/1487] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:49:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:49:39.651513 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c526146-9453-4661-9f9c-085e271319fa None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:49:39.652109 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c526146-9453-4661-9f9c-085e271319fa None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:49:39.652109 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c526146-9453-4661-9f9c-085e271319fa None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:49:39.653421 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 739/1488] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:49:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:49:39.660053 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d14deb-67d3-4998-964b-c88c6df203cd None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:49:39.660810 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d14deb-67d3-4998-964b-c88c6df203cd None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:49:39.660987 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d14deb-67d3-4998-964b-c88c6df203cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:49:39.745113 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-47d14deb-67d3-4998-964b-c88c6df203cd None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:49:39.746374 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-47d14deb-67d3-4998-964b-c88c6df203cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:49:39.807601 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:49:39.856552 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 750/1489] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:49:40.153173 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c526146-9453-4661-9f9c-085e271319fa None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:49:40.154799 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8c526146-9453-4661-9f9c-085e271319fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:49:40.193973 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:49:40.272498 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c526146-9453-4661-9f9c-085e271319fa None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:49:40.355967 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541423d2-933b-4058-9032-961fb31a1ebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:49:40.356574 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541423d2-933b-4058-9032-961fb31a1ebe service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:49:40.356858 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541423d2-933b-4058-9032-961fb31a1ebe service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:49:40.357119 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541423d2-933b-4058-9032-961fb31a1ebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:49:40.358734 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-541423d2-933b-4058-9032-961fb31a1ebe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:49:40.452850 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:49:40.484803 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541423d2-933b-4058-9032-961fb31a1ebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:49:40.486296 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541423d2-933b-4058-9032-961fb31a1ebe service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:49:40.504757 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 740/1490] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:49:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:49:42.702584 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1e099-33be-485d-a0c7-e92628ef4e22 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:49:42.703202 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1e099-33be-485d-a0c7-e92628ef4e22 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:49:42.703202 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1e099-33be-485d-a0c7-e92628ef4e22 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:49:42.705105 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 751/1491] 10.222.0.52 () {54 vars in 927 bytes} [Sun Aug 28 00:49:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:49:42.711752 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fb365-70bd-4fe4-a8e4-f0df10323be9 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:49:42.712392 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fb365-70bd-4fe4-a8e4-f0df10323be9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:49:42.712392 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fb365-70bd-4fe4-a8e4-f0df10323be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:49:42.787404 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-674fb365-70bd-4fe4-a8e4-f0df10323be9 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:49:42.788638 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-674fb365-70bd-4fe4-a8e4-f0df10323be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:49:42.902579 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 741/1492] 10.222.0.52 () {58 vars in 1024 bytes} [Sun Aug 28 00:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:49:43.198911 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1e099-33be-485d-a0c7-e92628ef4e22 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:49:43.201003 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-88d1e099-33be-485d-a0c7-e92628ef4e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:49:43.318328 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1e099-33be-485d-a0c7-e92628ef4e22 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:49:43.392740 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d17f25-5db5-43eb-91a2-07d678bf5286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:49:43.393343 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d17f25-5db5-43eb-91a2-07d678bf5286 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:49:43.393616 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d17f25-5db5-43eb-91a2-07d678bf5286 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:49:43.394157 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d17f25-5db5-43eb-91a2-07d678bf5286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:49:43.395763 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a1d17f25-5db5-43eb-91a2-07d678bf5286 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:49:43.404971 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:49:43.513609 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d17f25-5db5-43eb-91a2-07d678bf5286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:49:43.515014 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d17f25-5db5-43eb-91a2-07d678bf5286 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:49:43.533548 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 752/1493] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:49:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:49:52.900407 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=82 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:49:53.539759 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=50 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:04.127014 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ba193-6336-49d8-9bad-a57d392966c8 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:04.131456 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ba193-6336-49d8-9bad-a57d392966c8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:04.131456 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ba193-6336-49d8-9bad-a57d392966c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:04.218447 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-886ba193-6336-49d8-9bad-a57d392966c8 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:04.219669 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-886ba193-6336-49d8-9bad-a57d392966c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:04.324117 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 742/1494] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:51:04.333644 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288b459-2f0e-409a-8d74-b1c76455d088 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:04.334695 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288b459-2f0e-409a-8d74-b1c76455d088 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:04.334695 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288b459-2f0e-409a-8d74-b1c76455d088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:04.419851 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-9288b459-2f0e-409a-8d74-b1c76455d088 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:04.420974 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9288b459-2f0e-409a-8d74-b1c76455d088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:04.523099 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 753/1495] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:51:04.527989 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ba193-6336-49d8-9bad-a57d392966c8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:04.529250 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-886ba193-6336-49d8-9bad-a57d392966c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:04.541455 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ba193-6336-49d8-9bad-a57d392966c8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:04.608038 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:04.646796 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57816e7a-fb5f-4d3d-82b3-0b90ee89d693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:04.647408 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57816e7a-fb5f-4d3d-82b3-0b90ee89d693 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:04.647684 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57816e7a-fb5f-4d3d-82b3-0b90ee89d693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:04.647951 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57816e7a-fb5f-4d3d-82b3-0b90ee89d693 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:04.648592 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57816e7a-fb5f-4d3d-82b3-0b90ee89d693 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:04.648890 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57816e7a-fb5f-4d3d-82b3-0b90ee89d693 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:04.649963 dv-cinder-master-3-smb devstack@keystone.service[81517]: WARNING py.warnings [None req-57816e7a-fb5f-4d3d-82b3-0b90ee89d693 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 00:51:04.649963 dv-cinder-master-3-smb devstack@keystone.service[81517]: warnings.warn(msg) Aug 28 00:51:04.649963 dv-cinder-master-3-smb devstack@keystone.service[81517]: Aug 28 00:51:04.650855 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57816e7a-fb5f-4d3d-82b3-0b90ee89d693 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:04.663325 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 743/1496] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:04.672076 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288b459-2f0e-409a-8d74-b1c76455d088 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:04.681763 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288b459-2f0e-409a-8d74-b1c76455d088 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:04.746049 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:04.782972 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b10fec-ef1a-417e-b219-875d036e2be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:04.783576 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b10fec-ef1a-417e-b219-875d036e2be8 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:04.783846 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b10fec-ef1a-417e-b219-875d036e2be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:04.784106 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b10fec-ef1a-417e-b219-875d036e2be8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:04.784727 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b10fec-ef1a-417e-b219-875d036e2be8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:04.786507 dv-cinder-master-3-smb devstack@keystone.service[81518]: WARNING py.warnings [None req-93b10fec-ef1a-417e-b219-875d036e2be8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 00:51:04.786507 dv-cinder-master-3-smb devstack@keystone.service[81518]: warnings.warn(msg) Aug 28 00:51:04.786507 dv-cinder-master-3-smb devstack@keystone.service[81518]: Aug 28 00:51:04.788054 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b10fec-ef1a-417e-b219-875d036e2be8 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:04.851616 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 754/1497] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:51:04 2022] POST /identity/v3/projects => generated 377 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:51:04.856001 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57816e7a-fb5f-4d3d-82b3-0b90ee89d693 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:04.857549 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-57816e7a-fb5f-4d3d-82b3-0b90ee89d693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:04.895986 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57816e7a-fb5f-4d3d-82b3-0b90ee89d693 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:04.998401 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64f3d2-082d-42aa-af0f-b1c7d2f0731b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:04.998921 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64f3d2-082d-42aa-af0f-b1c7d2f0731b admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:04.999200 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64f3d2-082d-42aa-af0f-b1c7d2f0731b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:04.999457 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64f3d2-082d-42aa-af0f-b1c7d2f0731b admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:05.000084 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64f3d2-082d-42aa-af0f-b1c7d2f0731b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:05.001112 dv-cinder-master-3-smb devstack@keystone.service[81517]: WARNING py.warnings [None req-1c64f3d2-082d-42aa-af0f-b1c7d2f0731b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 00:51:05.001112 dv-cinder-master-3-smb devstack@keystone.service[81517]: warnings.warn(msg) Aug 28 00:51:05.001112 dv-cinder-master-3-smb devstack@keystone.service[81517]: Aug 28 00:51:05.002811 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64f3d2-082d-42aa-af0f-b1c7d2f0731b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:05.048812 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 744/1498] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:51:04 2022] POST /identity/v3/users => generated 289 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:51:05.052848 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b10fec-ef1a-417e-b219-875d036e2be8 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:05.054555 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-93b10fec-ef1a-417e-b219-875d036e2be8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:05.135703 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b10fec-ef1a-417e-b219-875d036e2be8 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:05.225899 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:05.245277 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e2bbd3-83c5-4eb0-9f98-cb85dbde81f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:05.246276 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2bbd3-83c5-4eb0-9f98-cb85dbde81f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:05.246664 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2bbd3-83c5-4eb0-9f98-cb85dbde81f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:05.247117 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2bbd3-83c5-4eb0-9f98-cb85dbde81f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:05.248117 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e2bbd3-83c5-4eb0-9f98-cb85dbde81f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:05.249798 dv-cinder-master-3-smb devstack@keystone.service[81518]: WARNING py.warnings [None req-34e2bbd3-83c5-4eb0-9f98-cb85dbde81f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 00:51:05.249798 dv-cinder-master-3-smb devstack@keystone.service[81518]: warnings.warn(msg) Aug 28 00:51:05.249798 dv-cinder-master-3-smb devstack@keystone.service[81518]: Aug 28 00:51:05.251117 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e2bbd3-83c5-4eb0-9f98-cb85dbde81f4 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:05.265909 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 755/1499] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:51:05.270179 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64f3d2-082d-42aa-af0f-b1c7d2f0731b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:05.271823 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1c64f3d2-082d-42aa-af0f-b1c7d2f0731b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:05.283581 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64f3d2-082d-42aa-af0f-b1c7d2f0731b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:05.311617 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:05.391666 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a64fb5-1572-4ef8-829e-3562055b8c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:05.392264 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a64fb5-1572-4ef8-829e-3562055b8c7b admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:05.392539 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a64fb5-1572-4ef8-829e-3562055b8c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:05.392803 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a64fb5-1572-4ef8-829e-3562055b8c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:05.393435 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a64fb5-1572-4ef8-829e-3562055b8c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:05.394489 dv-cinder-master-3-smb devstack@keystone.service[81517]: WARNING py.warnings [None req-c9a64fb5-1572-4ef8-829e-3562055b8c7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 00:51:05.394489 dv-cinder-master-3-smb devstack@keystone.service[81517]: warnings.warn(msg) Aug 28 00:51:05.394489 dv-cinder-master-3-smb devstack@keystone.service[81517]: Aug 28 00:51:05.395343 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a64fb5-1572-4ef8-829e-3562055b8c7b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:05.408614 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 745/1500] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:51:05.413600 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e2bbd3-83c5-4eb0-9f98-cb85dbde81f4 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:05.415195 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-34e2bbd3-83c5-4eb0-9f98-cb85dbde81f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:05.448715 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e2bbd3-83c5-4eb0-9f98-cb85dbde81f4 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:05.554665 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756531f-5556-4b93-8c46-fc8c9e976c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:05.555332 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756531f-5556-4b93-8c46-fc8c9e976c62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:05.555612 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756531f-5556-4b93-8c46-fc8c9e976c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:05.555887 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756531f-5556-4b93-8c46-fc8c9e976c62 admin admin] PATH_INFO: `/v3/projects/9d7cad227b3a43e29173cb98ec6e2731/users/1ecac86a376e4771bda5b1fe99e31023/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:05.578375 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756531f-5556-4b93-8c46-fc8c9e976c62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d7cad227b3a43e29173cb98ec6e2731, user_id=1ecac86a376e4771bda5b1fe99e31023, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:05.579410 dv-cinder-master-3-smb devstack@keystone.service[81518]: WARNING py.warnings [None req-f756531f-5556-4b93-8c46-fc8c9e976c62 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 00:51:05.579410 dv-cinder-master-3-smb devstack@keystone.service[81518]: warnings.warn(msg) Aug 28 00:51:05.579410 dv-cinder-master-3-smb devstack@keystone.service[81518]: Aug 28 00:51:05.581352 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756531f-5556-4b93-8c46-fc8c9e976c62 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:05.618872 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 756/1501] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:51:05 2022] PUT /identity/v3/projects/9d7cad227b3a43e29173cb98ec6e2731/users/1ecac86a376e4771bda5b1fe99e31023/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:51:05.631348 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d9113-d31a-4e84-a456-a2dbbc032408 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:05.631600 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d9113-d31a-4e84-a456-a2dbbc032408 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:05.631902 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d9113-d31a-4e84-a456-a2dbbc032408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:05.689592 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b85d9113-d31a-4e84-a456-a2dbbc032408 None None] MFA Rules not processed for user `1ecac86a376e4771bda5b1fe99e31023`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:05.690907 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b85d9113-d31a-4e84-a456-a2dbbc032408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:05.784440 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 746/1502] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:51:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:51:05.801363 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babeb23-5fdc-4201-aa49-c910932bae61 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:05.801773 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babeb23-5fdc-4201-aa49-c910932bae61 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:05.802196 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babeb23-5fdc-4201-aa49-c910932bae61 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:05.804073 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 757/1503] 10.222.0.52 () {54 vars in 964 bytes} [Sun Aug 28 00:51:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:05.815561 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616fd4e-2140-425e-954c-439ed90fc9cd None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:05.815999 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616fd4e-2140-425e-954c-439ed90fc9cd None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:05.816431 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616fd4e-2140-425e-954c-439ed90fc9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:05.851911 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:06.027589 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-0616fd4e-2140-425e-954c-439ed90fc9cd None None] MFA Rules not processed for user `3fbafa16c1ce4402ae4086e51767c05b`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:06.028860 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0616fd4e-2140-425e-954c-439ed90fc9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:06.124653 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 747/1504] 10.222.0.52 () {58 vars in 1061 bytes} [Sun Aug 28 00:51:05 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:51:06.133085 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babeb23-5fdc-4201-aa49-c910932bae61 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:06.134659 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3babeb23-5fdc-4201-aa49-c910932bae61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:06.188535 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:06.248730 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babeb23-5fdc-4201-aa49-c910932bae61 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:06.322861 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96dae9-2ded-41b4-8f16-e618bdd99a17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:06.323468 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96dae9-2ded-41b4-8f16-e618bdd99a17 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:06.323742 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96dae9-2ded-41b4-8f16-e618bdd99a17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:06.324011 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96dae9-2ded-41b4-8f16-e618bdd99a17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:06.325608 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-dc96dae9-2ded-41b4-8f16-e618bdd99a17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:06.444721 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96dae9-2ded-41b4-8f16-e618bdd99a17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:06.446090 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96dae9-2ded-41b4-8f16-e618bdd99a17 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:06.449505 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:06.465687 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 758/1505] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:51:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:51:06.512107 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67012ba-251b-4120-a928-42cf907891f9 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:06.512567 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67012ba-251b-4120-a928-42cf907891f9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:06.512663 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67012ba-251b-4120-a928-42cf907891f9 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:06.513924 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 748/1506] 10.222.0.52 () {52 vars in 830 bytes} [Sun Aug 28 00:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:06.517588 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96dae9-2ded-41b4-8f16-e618bdd99a17 service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:06.518896 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-dc96dae9-2ded-41b4-8f16-e618bdd99a17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:06.626704 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96dae9-2ded-41b4-8f16-e618bdd99a17 service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:06.737223 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74836892-c476-4dca-a119-2460d67e7aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:06.737769 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74836892-c476-4dca-a119-2460d67e7aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:06.738073 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74836892-c476-4dca-a119-2460d67e7aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:06.738344 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74836892-c476-4dca-a119-2460d67e7aa9 admin admin] PATH_INFO: `/v3/users/1ecac86a376e4771bda5b1fe99e31023` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:06.751511 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74836892-c476-4dca-a119-2460d67e7aa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ecac86a376e4771bda5b1fe99e31023)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:06.752580 dv-cinder-master-3-smb devstack@keystone.service[81518]: WARNING py.warnings [None req-74836892-c476-4dca-a119-2460d67e7aa9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 00:51:06.752580 dv-cinder-master-3-smb devstack@keystone.service[81518]: warnings.warn(msg) Aug 28 00:51:06.752580 dv-cinder-master-3-smb devstack@keystone.service[81518]: Aug 28 00:51:06.753831 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74836892-c476-4dca-a119-2460d67e7aa9 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:06.764115 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:06.825258 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-74836892-c476-4dca-a119-2460d67e7aa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ecac86a376e4771bda5b1fe99e31023'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:51:06.840218 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-74836892-c476-4dca-a119-2460d67e7aa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ecac86a376e4771bda5b1fe99e31023'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:51:06.853484 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-74836892-c476-4dca-a119-2460d67e7aa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ecac86a376e4771bda5b1fe99e31023'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:51:06.881114 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-74836892-c476-4dca-a119-2460d67e7aa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ecac86a376e4771bda5b1fe99e31023'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:51:06.881662 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-74836892-c476-4dca-a119-2460d67e7aa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ecac86a376e4771bda5b1fe99e31023'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:51:06.887926 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 759/1507] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:51:06 2022] DELETE /identity/v3/users/1ecac86a376e4771bda5b1fe99e31023 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:51:06.892747 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ee3af-06ae-4704-bb26-fabb192b8c1b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:06.893028 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ee3af-06ae-4704-bb26-fabb192b8c1b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:06.893296 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ee3af-06ae-4704-bb26-fabb192b8c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:06.954683 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-409ee3af-06ae-4704-bb26-fabb192b8c1b None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:06.955910 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-409ee3af-06ae-4704-bb26-fabb192b8c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:07.038059 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:07.051511 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 749/1508] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:51:07.062778 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74836892-c476-4dca-a119-2460d67e7aa9 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:07.064055 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-74836892-c476-4dca-a119-2460d67e7aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:07.170694 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74836892-c476-4dca-a119-2460d67e7aa9 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:07.226950 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:07.253651 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd89d1-3c26-4467-95fe-2c5755dddfd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:07.254530 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd89d1-3c26-4467-95fe-2c5755dddfd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:07.254821 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd89d1-3c26-4467-95fe-2c5755dddfd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:07.255166 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd89d1-3c26-4467-95fe-2c5755dddfd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:07.257024 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8cdd89d1-3c26-4467-95fe-2c5755dddfd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:07.378407 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd89d1-3c26-4467-95fe-2c5755dddfd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:07.379802 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd89d1-3c26-4467-95fe-2c5755dddfd6 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:07.408636 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 760/1509] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:51:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:51:07.779046 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ee3af-06ae-4704-bb26-fabb192b8c1b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:07.780386 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-409ee3af-06ae-4704-bb26-fabb192b8c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:07.792713 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ee3af-06ae-4704-bb26-fabb192b8c1b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:07.891161 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad57dcf-b811-4218-a95c-e93bfacb3dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:07.891784 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad57dcf-b811-4218-a95c-e93bfacb3dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:07.892063 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad57dcf-b811-4218-a95c-e93bfacb3dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:07.892298 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad57dcf-b811-4218-a95c-e93bfacb3dcb admin admin] PATH_INFO: `/v3/projects/9d7cad227b3a43e29173cb98ec6e2731` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:07.903147 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad57dcf-b811-4218-a95c-e93bfacb3dcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d7cad227b3a43e29173cb98ec6e2731)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:07.904129 dv-cinder-master-3-smb devstack@keystone.service[81517]: WARNING py.warnings [None req-5ad57dcf-b811-4218-a95c-e93bfacb3dcb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 00:51:07.904129 dv-cinder-master-3-smb devstack@keystone.service[81517]: warnings.warn(msg) Aug 28 00:51:07.904129 dv-cinder-master-3-smb devstack@keystone.service[81517]: Aug 28 00:51:07.905311 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad57dcf-b811-4218-a95c-e93bfacb3dcb admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:07.968578 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5ad57dcf-b811-4218-a95c-e93bfacb3dcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d7cad227b3a43e29173cb98ec6e2731', 'request_id': 'req-5ad57dcf-b811-4218-a95c-e93bfacb3dcb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:51:07.977014 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5ad57dcf-b811-4218-a95c-e93bfacb3dcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d7cad227b3a43e29173cb98ec6e2731', 'request_id': 'req-5ad57dcf-b811-4218-a95c-e93bfacb3dcb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:51:07.990081 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5ad57dcf-b811-4218-a95c-e93bfacb3dcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d7cad227b3a43e29173cb98ec6e2731', 'request_id': 'req-5ad57dcf-b811-4218-a95c-e93bfacb3dcb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:51:08.022243 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5ad57dcf-b811-4218-a95c-e93bfacb3dcb admin admin] The token cache is being invalidate because project 9d7cad227b3a43e29173cb98ec6e2731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:51:08.022516 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5ad57dcf-b811-4218-a95c-e93bfacb3dcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:51:08.023067 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5ad57dcf-b811-4218-a95c-e93bfacb3dcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:51:08.024392 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 750/1510] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:51:07 2022] DELETE /identity/v3/projects/9d7cad227b3a43e29173cb98ec6e2731 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:51:17.404840 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=62 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:18.019652 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:44.104209 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda21cb4-12d1-48d1-9b18-ceac0de7e491 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:44.104840 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda21cb4-12d1-48d1-9b18-ceac0de7e491 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:44.104840 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda21cb4-12d1-48d1-9b18-ceac0de7e491 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:44.106183 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 00:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:44.112185 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2328226-0d7e-40dd-8f21-2d6968ff1b93 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:44.112668 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2328226-0d7e-40dd-8f21-2d6968ff1b93 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:44.112774 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2328226-0d7e-40dd-8f21-2d6968ff1b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:44.200551 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f2328226-0d7e-40dd-8f21-2d6968ff1b93 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:44.202381 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f2328226-0d7e-40dd-8f21-2d6968ff1b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:44.315370 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 751/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 00:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:52:44.473225 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda21cb4-12d1-48d1-9b18-ceac0de7e491 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:44.476178 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-eda21cb4-12d1-48d1-9b18-ceac0de7e491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:44.606334 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda21cb4-12d1-48d1-9b18-ceac0de7e491 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:44.612340 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d662077-d7f7-4072-9e11-5c3a5cb20c51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:44.612954 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d662077-d7f7-4072-9e11-5c3a5cb20c51 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:44.613224 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d662077-d7f7-4072-9e11-5c3a5cb20c51 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:44.613544 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d662077-d7f7-4072-9e11-5c3a5cb20c51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:44.622570 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d662077-d7f7-4072-9e11-5c3a5cb20c51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:44.624249 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d662077-d7f7-4072-9e11-5c3a5cb20c51 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:44.634426 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 762/1513] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:52:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:52:45.483660 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb379bc-50b3-4877-8409-88efd03ca5b8 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:45.484204 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb379bc-50b3-4877-8409-88efd03ca5b8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:45.484204 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb379bc-50b3-4877-8409-88efd03ca5b8 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:45.485439 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 752/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 00:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:45.491633 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a4579-6df7-4226-8751-d6028d5b0459 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:45.492169 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a4579-6df7-4226-8751-d6028d5b0459 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:45.492169 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a4579-6df7-4226-8751-d6028d5b0459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:45.513096 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-b91a4579-6df7-4226-8751-d6028d5b0459 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:45.514346 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b91a4579-6df7-4226-8751-d6028d5b0459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:45.523029 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 763/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 00:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:52:45.678216 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb379bc-50b3-4877-8409-88efd03ca5b8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:45.693631 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb379bc-50b3-4877-8409-88efd03ca5b8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:45.699474 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e4afa-cbf8-44d3-8f4b-e49d425a7b8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:45.700092 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e4afa-cbf8-44d3-8f4b-e49d425a7b8a service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:45.700371 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e4afa-cbf8-44d3-8f4b-e49d425a7b8a service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:45.700637 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e4afa-cbf8-44d3-8f4b-e49d425a7b8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:45.709138 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e4afa-cbf8-44d3-8f4b-e49d425a7b8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:45.710764 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e4afa-cbf8-44d3-8f4b-e49d425a7b8a service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:45.720791 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 753/1516] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:52:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:52:45.763812 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd6c0b-a540-4548-b48e-546b36d7d939 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:45.764079 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd6c0b-a540-4548-b48e-546b36d7d939 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:45.764356 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd6c0b-a540-4548-b48e-546b36d7d939 None None] PATH_INFO: `/v3` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:45.766214 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 764/1517] 10.222.0.62 () {54 vars in 925 bytes} [Sun Aug 28 00:52:45 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:45.773701 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd13ab9-97e1-4559-ab04-04cb876958f3 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:45.774089 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd13ab9-97e1-4559-ab04-04cb876958f3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:45.774257 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd13ab9-97e1-4559-ab04-04cb876958f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:45.841078 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-3dd13ab9-97e1-4559-ab04-04cb876958f3 None None] MFA Rules not processed for user `ae87149f6ab04a9997263598737ae27e`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:45.842312 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3dd13ab9-97e1-4559-ab04-04cb876958f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:45.859706 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:45.926424 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 754/1518] 10.222.0.62 () {58 vars in 1015 bytes} [Sun Aug 28 00:52:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:52:54.718749 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1655dab-18d8-4885-bfc4-e8db1537389e None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:54.719322 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1655dab-18d8-4885-bfc4-e8db1537389e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:54.719322 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1655dab-18d8-4885-bfc4-e8db1537389e None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:54.720573 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 765/1519] 10.222.0.52 () {54 vars in 961 bytes} [Sun Aug 28 00:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:54.727248 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b3bb5-7c03-4f76-8691-4c7744a90e0d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:54.727700 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b3bb5-7c03-4f76-8691-4c7744a90e0d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:54.727900 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b3bb5-7c03-4f76-8691-4c7744a90e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:54.758376 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-744b3bb5-7c03-4f76-8691-4c7744a90e0d None None] MFA Rules not processed for user `ae87149f6ab04a9997263598737ae27e`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:54.759612 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-744b3bb5-7c03-4f76-8691-4c7744a90e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:54.768362 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 755/1520] 10.222.0.52 () {58 vars in 1058 bytes} [Sun Aug 28 00:52:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:52:54.776699 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1655dab-18d8-4885-bfc4-e8db1537389e None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:54.791190 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1655dab-18d8-4885-bfc4-e8db1537389e None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:54.796698 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd63a2-7d60-44f1-93cc-e2e8f1f672b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae87149f6ab04a9997263598737ae27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:54.797306 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd63a2-7d60-44f1-93cc-e2e8f1f672b9 service placement] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:54.797579 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd63a2-7d60-44f1-93cc-e2e8f1f672b9 service placement] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:54.797879 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd63a2-7d60-44f1-93cc-e2e8f1f672b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:54.806456 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd63a2-7d60-44f1-93cc-e2e8f1f672b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:54.808103 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd63a2-7d60-44f1-93cc-e2e8f1f672b9 service placement] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:54.817829 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 766/1521] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:52:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:52:56.971238 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e393e9-b972-4063-9322-c40c26c44219 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:56.972268 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e393e9-b972-4063-9322-c40c26c44219 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:56.972268 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e393e9-b972-4063-9322-c40c26c44219 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:56.974854 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 00:52:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:56.979919 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f26738-7a64-4008-93c1-35e39ae0f6cd None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:56.980392 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f26738-7a64-4008-93c1-35e39ae0f6cd None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:56.980508 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f26738-7a64-4008-93c1-35e39ae0f6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:57.001413 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-46f26738-7a64-4008-93c1-35e39ae0f6cd None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:57.002662 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-46f26738-7a64-4008-93c1-35e39ae0f6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:57.011992 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 00:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:52:57.166139 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e393e9-b972-4063-9322-c40c26c44219 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:57.181261 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e393e9-b972-4063-9322-c40c26c44219 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:57.187527 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddf6cc-37e5-47d0-ba1c-e7a30ec9ce18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:57.188114 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddf6cc-37e5-47d0-ba1c-e7a30ec9ce18 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:57.188373 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddf6cc-37e5-47d0-ba1c-e7a30ec9ce18 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:57.188639 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddf6cc-37e5-47d0-ba1c-e7a30ec9ce18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:57.197831 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddf6cc-37e5-47d0-ba1c-e7a30ec9ce18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:57.199505 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddf6cc-37e5-47d0-ba1c-e7a30ec9ce18 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:57.209240 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 757/1524] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:52:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:52:58.037234 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5306a0-bf9d-4165-b74e-3fcaa15c6cfd None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:58.037813 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5306a0-bf9d-4165-b74e-3fcaa15c6cfd None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:58.037813 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5306a0-bf9d-4165-b74e-3fcaa15c6cfd None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:58.039176 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 00:52:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:58.045194 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38a155-a94d-4dcd-a679-0da85aee31ab None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:58.046021 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38a155-a94d-4dcd-a679-0da85aee31ab None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:58.046184 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38a155-a94d-4dcd-a679-0da85aee31ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:58.076391 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-ee38a155-a94d-4dcd-a679-0da85aee31ab None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:58.077598 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ee38a155-a94d-4dcd-a679-0da85aee31ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:58.086616 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 00:52:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:52:58.242945 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5306a0-bf9d-4165-b74e-3fcaa15c6cfd None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:58.265923 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5306a0-bf9d-4165-b74e-3fcaa15c6cfd None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:58.275067 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc1c39-6c7a-4af3-93be-20da0b151548 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:58.275663 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc1c39-6c7a-4af3-93be-20da0b151548 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:58.275940 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc1c39-6c7a-4af3-93be-20da0b151548 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:58.276239 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc1c39-6c7a-4af3-93be-20da0b151548 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:58.285103 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc1c39-6c7a-4af3-93be-20da0b151548 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:58.286948 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc1c39-6c7a-4af3-93be-20da0b151548 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:58.297120 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 769/1527] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:52:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:53:02.139266 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5449c5b-8921-417b-8dfb-6855c76e88d8 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:02.140154 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5449c5b-8921-417b-8dfb-6855c76e88d8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:02.140154 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5449c5b-8921-417b-8dfb-6855c76e88d8 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:02.142386 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:53:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:53:02.147902 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85d605-5637-4d75-8744-1f49a97b6390 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:02.148349 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85d605-5637-4d75-8744-1f49a97b6390 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:02.148448 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85d605-5637-4d75-8744-1f49a97b6390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:02.168641 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-6c85d605-5637-4d75-8744-1f49a97b6390 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:02.169859 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6c85d605-5637-4d75-8744-1f49a97b6390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:02.178957 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:53:02.486097 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5449c5b-8921-417b-8dfb-6855c76e88d8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:02.488193 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b5449c5b-8921-417b-8dfb-6855c76e88d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:02.582458 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5449c5b-8921-417b-8dfb-6855c76e88d8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:02.586435 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb0e58-635e-4517-83ca-d3967e5da2b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:02.587021 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb0e58-635e-4517-83ca-d3967e5da2b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:02.587291 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb0e58-635e-4517-83ca-d3967e5da2b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:02.587556 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb0e58-635e-4517-83ca-d3967e5da2b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:02.596687 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb0e58-635e-4517-83ca-d3967e5da2b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:02.598200 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb0e58-635e-4517-83ca-d3967e5da2b6 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:02.607869 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 760/1530] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:53:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:53:04.496732 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c8dce-099d-4b60-b97c-220fb662c610 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:04.497629 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c8dce-099d-4b60-b97c-220fb662c610 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:04.497629 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c8dce-099d-4b60-b97c-220fb662c610 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:04.499887 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:53:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:53:04.506102 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cbdeb-a9df-416b-a11a-c912fda818c1 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:04.506568 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cbdeb-a9df-416b-a11a-c912fda818c1 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:04.506679 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cbdeb-a9df-416b-a11a-c912fda818c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:04.527759 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-1d5cbdeb-a9df-416b-a11a-c912fda818c1 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:04.528962 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1d5cbdeb-a9df-416b-a11a-c912fda818c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:04.538398 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:53:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:53:04.821634 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c8dce-099d-4b60-b97c-220fb662c610 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:04.823684 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-435c8dce-099d-4b60-b97c-220fb662c610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:04.838606 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c8dce-099d-4b60-b97c-220fb662c610 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:04.842966 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145bb4b-5236-4714-a3b0-543c8aea0aef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:04.843847 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145bb4b-5236-4714-a3b0-543c8aea0aef service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:04.844221 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145bb4b-5236-4714-a3b0-543c8aea0aef service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:04.844579 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145bb4b-5236-4714-a3b0-543c8aea0aef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:04.856652 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145bb4b-5236-4714-a3b0-543c8aea0aef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:04.858178 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145bb4b-5236-4714-a3b0-543c8aea0aef service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:04.869066 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 772/1533] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:53:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:53:08.343797 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd850db-ad51-4404-863f-4c6c7603fb9b None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:08.344707 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd850db-ad51-4404-863f-4c6c7603fb9b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:08.344707 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd850db-ad51-4404-863f-4c6c7603fb9b None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:08.346882 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:53:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:53:08.354037 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2fc80-ef88-4875-8434-12134197e99b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:08.354592 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2fc80-ef88-4875-8434-12134197e99b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:08.354692 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2fc80-ef88-4875-8434-12134197e99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:08.362675 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=81 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:08.375589 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-09a2fc80-ef88-4875-8434-12134197e99b None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:08.376784 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-09a2fc80-ef88-4875-8434-12134197e99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:08.385550 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:53:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:53:08.932071 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd850db-ad51-4404-863f-4c6c7603fb9b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:08.934908 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1fd850db-ad51-4404-863f-4c6c7603fb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:09.011594 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:09.027750 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd850db-ad51-4404-863f-4c6c7603fb9b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:09.031802 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36623e0-a026-4df4-a887-361c8e5d7e2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:09.032401 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36623e0-a026-4df4-a887-361c8e5d7e2a service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:09.032676 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36623e0-a026-4df4-a887-361c8e5d7e2a service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:09.032943 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36623e0-a026-4df4-a887-361c8e5d7e2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:09.042553 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36623e0-a026-4df4-a887-361c8e5d7e2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:09.043998 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36623e0-a026-4df4-a887-361c8e5d7e2a service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:09.053601 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 763/1536] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:53:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:53:11.018711 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d4977-c2d4-4ce9-8386-c4566d1c1c87 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:11.019281 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d4977-c2d4-4ce9-8386-c4566d1c1c87 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:11.019281 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d4977-c2d4-4ce9-8386-c4566d1c1c87 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:11.021772 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:53:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:53:11.027270 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e31818-3391-471b-bb40-553e3413abd2 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:11.027787 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e31818-3391-471b-bb40-553e3413abd2 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:11.027787 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e31818-3391-471b-bb40-553e3413abd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:11.049633 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b6e31818-3391-471b-bb40-553e3413abd2 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:11.050859 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b6e31818-3391-471b-bb40-553e3413abd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:11.060524 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:53:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:53:11.627400 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d4977-c2d4-4ce9-8386-c4566d1c1c87 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:11.629477 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e34d4977-c2d4-4ce9-8386-c4566d1c1c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:11.649198 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d4977-c2d4-4ce9-8386-c4566d1c1c87 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:11.652847 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e26ca6-c0c1-4b2c-a8c4-0a6f2f03dc07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:11.653455 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e26ca6-c0c1-4b2c-a8c4-0a6f2f03dc07 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:11.653748 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e26ca6-c0c1-4b2c-a8c4-0a6f2f03dc07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:11.654024 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e26ca6-c0c1-4b2c-a8c4-0a6f2f03dc07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:11.666260 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e26ca6-c0c1-4b2c-a8c4-0a6f2f03dc07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:11.668446 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e26ca6-c0c1-4b2c-a8c4-0a6f2f03dc07 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:11.681617 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 775/1539] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:53:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:53:21.044750 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=11 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:21.676913 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=8 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:37.387380 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295a54e-954c-42cb-960b-0a31fd7154cd None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:37.390176 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295a54e-954c-42cb-960b-0a31fd7154cd None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:37.390176 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295a54e-954c-42cb-960b-0a31fd7154cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:37.415295 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-d295a54e-954c-42cb-960b-0a31fd7154cd None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:37.416438 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d295a54e-954c-42cb-960b-0a31fd7154cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:37.427964 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 765/1540] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:37.438065 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bc9c1-4d54-4839-bfd5-29e0adbb230b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:37.438659 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bc9c1-4d54-4839-bfd5-29e0adbb230b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:37.438659 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bc9c1-4d54-4839-bfd5-29e0adbb230b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:37.471478 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-fa1bc9c1-4d54-4839-bfd5-29e0adbb230b None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:37.472744 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-fa1bc9c1-4d54-4839-bfd5-29e0adbb230b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:37.483450 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 776/1541] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:37.488069 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295a54e-954c-42cb-960b-0a31fd7154cd None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:37.506048 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295a54e-954c-42cb-960b-0a31fd7154cd None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:37.511479 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d0641-2534-471d-87d0-9ad5f2f4db96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:37.512113 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d0641-2534-471d-87d0-9ad5f2f4db96 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:37.512380 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d0641-2534-471d-87d0-9ad5f2f4db96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:37.512637 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d0641-2534-471d-87d0-9ad5f2f4db96 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:37.513453 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d0641-2534-471d-87d0-9ad5f2f4db96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:54:37.513566 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d0641-2534-471d-87d0-9ad5f2f4db96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:37.515218 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d0641-2534-471d-87d0-9ad5f2f4db96 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:37.533324 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 766/1542] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:54:37.546397 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1bc9c1-4d54-4839-bfd5-29e0adbb230b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:37.564511 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1bc9c1-4d54-4839-bfd5-29e0adbb230b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:37.570576 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfcd8a-b839-4172-a06d-261106d533c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:37.571214 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfcd8a-b839-4172-a06d-261106d533c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:37.571491 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfcd8a-b839-4172-a06d-261106d533c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:37.571759 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfcd8a-b839-4172-a06d-261106d533c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:37.572414 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bfcd8a-b839-4172-a06d-261106d533c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:37.575472 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bfcd8a-b839-4172-a06d-261106d533c8 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:37.633095 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 777/1543] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:54:37 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:54:37.637232 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d0641-2534-471d-87d0-9ad5f2f4db96 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:37.652637 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d0641-2534-471d-87d0-9ad5f2f4db96 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:37.738483 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da946cf-f552-4719-872d-d02c847c34b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:37.739905 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da946cf-f552-4719-872d-d02c847c34b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:37.739905 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da946cf-f552-4719-872d-d02c847c34b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:37.739905 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da946cf-f552-4719-872d-d02c847c34b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:37.740172 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da946cf-f552-4719-872d-d02c847c34b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:37.742153 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da946cf-f552-4719-872d-d02c847c34b3 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:37.775018 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20962d32-b7e2-4ce2-9673-442da047de32 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:37.775289 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20962d32-b7e2-4ce2-9673-442da047de32 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:37.775664 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20962d32-b7e2-4ce2-9673-442da047de32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:37.776109 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 767/1544] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:54:37 2022] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:54:37.780788 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da946cf-f552-4719-872d-d02c847c34b3 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:37.791328 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da946cf-f552-4719-872d-d02c847c34b3 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:37.803377 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b764580-01d0-42eb-906d-91c91fff6c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:37.804006 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b764580-01d0-42eb-906d-91c91fff6c86 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:37.804283 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b764580-01d0-42eb-906d-91c91fff6c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:37.804553 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b764580-01d0-42eb-906d-91c91fff6c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:37.805206 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b764580-01d0-42eb-906d-91c91fff6c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:37.806963 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b764580-01d0-42eb-906d-91c91fff6c86 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:37.814373 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-20962d32-b7e2-4ce2-9673-442da047de32 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:37.815686 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-20962d32-b7e2-4ce2-9673-442da047de32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:37.825669 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 768/1545] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:54:37.827779 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b23d2b-4df8-47b0-8631-651baa18081e None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:37.828067 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b23d2b-4df8-47b0-8631-651baa18081e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:37.828337 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b23d2b-4df8-47b0-8631-651baa18081e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:37.832571 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 778/1546] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:54:37.833417 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20962d32-b7e2-4ce2-9673-442da047de32 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:37.858819 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20962d32-b7e2-4ce2-9673-442da047de32 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:37.874676 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a21ade-a679-468d-a293-23750475b857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:37.875314 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a21ade-a679-468d-a293-23750475b857 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:37.875590 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a21ade-a679-468d-a293-23750475b857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:37.875861 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a21ade-a679-468d-a293-23750475b857 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:37.876512 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a21ade-a679-468d-a293-23750475b857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:37.878255 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a21ade-a679-468d-a293-23750475b857 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:37.883792 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-51b23d2b-4df8-47b0-8631-651baa18081e None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:37.885134 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-51b23d2b-4df8-47b0-8631-651baa18081e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:37.905485 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 779/1547] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:54:37.906871 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274141a-1e92-4538-86cc-34086c569309 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:37.907160 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274141a-1e92-4538-86cc-34086c569309 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:37.907431 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274141a-1e92-4538-86cc-34086c569309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:37.907557 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 769/1548] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:37.909301 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b9fad-64e7-487c-8e50-8edc5ac0b086 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:37.909587 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b9fad-64e7-487c-8e50-8edc5ac0b086 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:37.914098 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b9fad-64e7-487c-8e50-8edc5ac0b086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:37.947114 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-1274141a-1e92-4538-86cc-34086c569309 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:37.951539 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1274141a-1e92-4538-86cc-34086c569309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:37.953725 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-2a4b9fad-64e7-487c-8e50-8edc5ac0b086 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:37.955952 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2a4b9fad-64e7-487c-8e50-8edc5ac0b086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:37.968348 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 780/1549] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:37.969154 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274141a-1e92-4538-86cc-34086c569309 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:37.975902 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 770/1550] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:37.977182 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f31e3-feb5-48a8-a8bd-8bc620b8abed None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:37.977449 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f31e3-feb5-48a8-a8bd-8bc620b8abed None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:37.977720 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f31e3-feb5-48a8-a8bd-8bc620b8abed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:37.993084 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274141a-1e92-4538-86cc-34086c569309 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:38.005373 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efd5df-1be4-4f00-990b-36bb090c5933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:38.006214 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efd5df-1be4-4f00-990b-36bb090c5933 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:38.006492 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efd5df-1be4-4f00-990b-36bb090c5933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:38.006765 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efd5df-1be4-4f00-990b-36bb090c5933 admin admin] PATH_INFO: `/v3/projects/d71aa005fbfa48e6bf642a89b707d801/users/422387594ff44fd185b8745d1286c931/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:38.019072 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-0b6f31e3-feb5-48a8-a8bd-8bc620b8abed None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:38.020288 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0b6f31e3-feb5-48a8-a8bd-8bc620b8abed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:38.036733 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21efd5df-1be4-4f00-990b-36bb090c5933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d71aa005fbfa48e6bf642a89b707d801, user_id=422387594ff44fd185b8745d1286c931, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:38.041350 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21efd5df-1be4-4f00-990b-36bb090c5933 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:38.044444 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 771/1551] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:38.050492 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020dab9-a0b6-4bde-8cbe-8546289914c1 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:38.050874 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020dab9-a0b6-4bde-8cbe-8546289914c1 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:38.051071 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020dab9-a0b6-4bde-8cbe-8546289914c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:38.071899 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 781/1552] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:54:37 2022] PUT /identity/v3/projects/d71aa005fbfa48e6bf642a89b707d801/users/422387594ff44fd185b8745d1286c931/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:54:38.073012 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efd5df-1be4-4f00-990b-36bb090c5933 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:38.075903 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f020dab9-a0b6-4bde-8cbe-8546289914c1 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:38.077091 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f020dab9-a0b6-4bde-8cbe-8546289914c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:38.133763 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efd5df-1be4-4f00-990b-36bb090c5933 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:38.140324 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738d59d-6e7f-4b89-93b3-eaa58a1cbe40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:38.140936 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738d59d-6e7f-4b89-93b3-eaa58a1cbe40 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:38.141091 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 772/1553] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:38.141228 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738d59d-6e7f-4b89-93b3-eaa58a1cbe40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:38.141499 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738d59d-6e7f-4b89-93b3-eaa58a1cbe40 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:38.142247 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a738d59d-6e7f-4b89-93b3-eaa58a1cbe40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:54:38.142550 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a738d59d-6e7f-4b89-93b3-eaa58a1cbe40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:38.142880 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50030b-815c-4216-9085-25275728bc70 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:38.143171 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50030b-815c-4216-9085-25275728bc70 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:38.143444 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50030b-815c-4216-9085-25275728bc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:38.143609 dv-cinder-master-3-smb devstack@keystone.service[81518]: WARNING py.warnings [None req-a738d59d-6e7f-4b89-93b3-eaa58a1cbe40 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 00:54:38.143609 dv-cinder-master-3-smb devstack@keystone.service[81518]: warnings.warn(msg) Aug 28 00:54:38.143609 dv-cinder-master-3-smb devstack@keystone.service[81518]: Aug 28 00:54:38.144455 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a738d59d-6e7f-4b89-93b3-eaa58a1cbe40 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:38.164070 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 782/1554] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:54:38.164070 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861d862-35a2-4916-8ff0-1b8c38c2386b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:38.164070 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861d862-35a2-4916-8ff0-1b8c38c2386b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:38.164070 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861d862-35a2-4916-8ff0-1b8c38c2386b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:38.171035 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-9e50030b-815c-4216-9085-25275728bc70 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:38.172249 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9e50030b-815c-4216-9085-25275728bc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:38.178177 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-7861d862-35a2-4916-8ff0-1b8c38c2386b None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:38.179325 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-7861d862-35a2-4916-8ff0-1b8c38c2386b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:38.180421 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 773/1555] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:38.181605 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006062b-1525-49ba-bef0-37c216d6f2f3 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:38.181928 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006062b-1525-49ba-bef0-37c216d6f2f3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:38.182205 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006062b-1525-49ba-bef0-37c216d6f2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:38.189443 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 783/1556] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:38.190939 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab4aa5-346a-4e72-89aa-1c8a8bd76278 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:38.191219 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab4aa5-346a-4e72-89aa-1c8a8bd76278 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:38.192425 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab4aa5-346a-4e72-89aa-1c8a8bd76278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:38.202550 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f006062b-1525-49ba-bef0-37c216d6f2f3 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:38.203749 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f006062b-1525-49ba-bef0-37c216d6f2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:38.211526 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-d0ab4aa5-346a-4e72-89aa-1c8a8bd76278 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:38.211670 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 774/1557] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:38.212669 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d0ab4aa5-346a-4e72-89aa-1c8a8bd76278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:38.212780 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569c497-4aea-42c2-88bd-0848a68a4746 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:38.213016 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569c497-4aea-42c2-88bd-0848a68a4746 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:38.213287 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569c497-4aea-42c2-88bd-0848a68a4746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:38.220706 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 784/1558] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:38.222000 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e9f87-61f8-4497-b721-cc8ae101e454 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:38.222276 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e9f87-61f8-4497-b721-cc8ae101e454 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:38.222539 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e9f87-61f8-4497-b721-cc8ae101e454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:38.233570 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-0569c497-4aea-42c2-88bd-0848a68a4746 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:38.234834 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0569c497-4aea-42c2-88bd-0848a68a4746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:38.243769 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 775/1559] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:38.244568 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569c497-4aea-42c2-88bd-0848a68a4746 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:38.252742 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-209e9f87-61f8-4497-b721-cc8ae101e454 None None] MFA Rules not processed for user `422387594ff44fd185b8745d1286c931`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:38.253951 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-209e9f87-61f8-4497-b721-cc8ae101e454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:38.260586 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569c497-4aea-42c2-88bd-0848a68a4746 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:38.265321 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1795da2-7164-47ba-b9f2-52d2f61abf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:38.265953 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1795da2-7164-47ba-b9f2-52d2f61abf12 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:38.266235 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1795da2-7164-47ba-b9f2-52d2f61abf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:38.266507 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1795da2-7164-47ba-b9f2-52d2f61abf12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:38.267153 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1795da2-7164-47ba-b9f2-52d2f61abf12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:54:38.267454 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1795da2-7164-47ba-b9f2-52d2f61abf12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:38.269073 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1795da2-7164-47ba-b9f2-52d2f61abf12 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:38.288117 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 776/1560] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:54:38.288117 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1795da2-7164-47ba-b9f2-52d2f61abf12 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:38.291470 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1795da2-7164-47ba-b9f2-52d2f61abf12 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:38.296105 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82969864-cf9f-4dcb-8e7a-d8a04e1f90bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:38.296693 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82969864-cf9f-4dcb-8e7a-d8a04e1f90bd admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:38.296969 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82969864-cf9f-4dcb-8e7a-d8a04e1f90bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:38.297243 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82969864-cf9f-4dcb-8e7a-d8a04e1f90bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:38.297889 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82969864-cf9f-4dcb-8e7a-d8a04e1f90bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:38.298790 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:38.298916 dv-cinder-master-3-smb devstack@keystone.service[81517]: WARNING py.warnings [None req-82969864-cf9f-4dcb-8e7a-d8a04e1f90bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 00:54:38.298916 dv-cinder-master-3-smb devstack@keystone.service[81517]: warnings.warn(msg) Aug 28 00:54:38.298916 dv-cinder-master-3-smb devstack@keystone.service[81517]: Aug 28 00:54:38.300089 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82969864-cf9f-4dcb-8e7a-d8a04e1f90bd admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:38.305043 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:38.324208 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 785/1561] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:38.325265 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e9f87-61f8-4497-b721-cc8ae101e454 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:38.335969 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e9f87-61f8-4497-b721-cc8ae101e454 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:38.342216 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 777/1562] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:54:38 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:54:38.342216 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82969864-cf9f-4dcb-8e7a-d8a04e1f90bd admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:38.342476 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d4e44-c27f-47bb-ae41-cd68ebadaa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:38.342476 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d4e44-c27f-47bb-ae41-cd68ebadaa39 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:38.342476 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d4e44-c27f-47bb-ae41-cd68ebadaa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:38.342476 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d4e44-c27f-47bb-ae41-cd68ebadaa39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:38.343112 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d4e44-c27f-47bb-ae41-cd68ebadaa39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:54:38.343411 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d4e44-c27f-47bb-ae41-cd68ebadaa39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:38.345056 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d4e44-c27f-47bb-ae41-cd68ebadaa39 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:38.357570 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 786/1563] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:54:38.358817 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83f7cc-b216-45ab-a9cd-8dd3d80f3a42 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:38.359102 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83f7cc-b216-45ab-a9cd-8dd3d80f3a42 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:38.359375 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83f7cc-b216-45ab-a9cd-8dd3d80f3a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:38.384578 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-6b83f7cc-b216-45ab-a9cd-8dd3d80f3a42 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:38.385833 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6b83f7cc-b216-45ab-a9cd-8dd3d80f3a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:38.412316 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82969864-cf9f-4dcb-8e7a-d8a04e1f90bd admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:38.417096 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35368e-04a8-4ebe-af46-d0baa5ee7c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:38.417690 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35368e-04a8-4ebe-af46-d0baa5ee7c4f admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:38.418000 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35368e-04a8-4ebe-af46-d0baa5ee7c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:38.418273 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35368e-04a8-4ebe-af46-d0baa5ee7c4f admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:38.418918 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35368e-04a8-4ebe-af46-d0baa5ee7c4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:54:38.419218 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35368e-04a8-4ebe-af46-d0baa5ee7c4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:38.420850 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35368e-04a8-4ebe-af46-d0baa5ee7c4f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:38.432466 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 778/1564] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:54:38.433824 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c12d5-767b-43b7-8640-d83391b3cc3c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:38.434159 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c12d5-767b-43b7-8640-d83391b3cc3c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:38.434413 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c12d5-767b-43b7-8640-d83391b3cc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:38.452418 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 787/1565] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:38.453794 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e8531-889c-4dbf-8258-5cb569d5e579 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:38.454176 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-233c12d5-767b-43b7-8640-d83391b3cc3c None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:38.454318 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e8531-889c-4dbf-8258-5cb569d5e579 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:38.454738 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e8531-889c-4dbf-8258-5cb569d5e579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:38.455406 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-233c12d5-767b-43b7-8640-d83391b3cc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:38.463423 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 779/1566] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:38.464470 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c12d5-767b-43b7-8640-d83391b3cc3c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:38.474027 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-416e8531-889c-4dbf-8258-5cb569d5e579 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:38.475538 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-416e8531-889c-4dbf-8258-5cb569d5e579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:38.476682 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c12d5-767b-43b7-8640-d83391b3cc3c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:38.481558 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd623bc7-b62a-472f-ab9c-1531cfec3f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:38.482262 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd623bc7-b62a-472f-ab9c-1531cfec3f07 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:38.482537 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd623bc7-b62a-472f-ab9c-1531cfec3f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:38.482803 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd623bc7-b62a-472f-ab9c-1531cfec3f07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:38.483473 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd623bc7-b62a-472f-ab9c-1531cfec3f07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:38.483834 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 788/1567] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:38.485375 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd623bc7-b62a-472f-ab9c-1531cfec3f07 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:38.486698 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e8531-889c-4dbf-8258-5cb569d5e579 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:38.496615 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e8531-889c-4dbf-8258-5cb569d5e579 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:38.501255 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2a40c-0625-43f0-a802-5b9c815d6a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:38.501865 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2a40c-0625-43f0-a802-5b9c815d6a64 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:38.502161 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2a40c-0625-43f0-a802-5b9c815d6a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:38.502433 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2a40c-0625-43f0-a802-5b9c815d6a64 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:38.503065 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2a40c-0625-43f0-a802-5b9c815d6a64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:38.504138 dv-cinder-master-3-smb devstack@keystone.service[81518]: WARNING py.warnings [None req-ddd2a40c-0625-43f0-a802-5b9c815d6a64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 00:54:38.504138 dv-cinder-master-3-smb devstack@keystone.service[81518]: warnings.warn(msg) Aug 28 00:54:38.504138 dv-cinder-master-3-smb devstack@keystone.service[81518]: Aug 28 00:54:38.505409 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2a40c-0625-43f0-a802-5b9c815d6a64 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:38.514563 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 780/1568] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:54:38 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:54:38.516102 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c437e7-96ef-4624-a2e4-298f6691a878 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:38.516574 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c437e7-96ef-4624-a2e4-298f6691a878 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:38.516851 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c437e7-96ef-4624-a2e4-298f6691a878 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:38.518219 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 781/1569] 10.222.0.52 () {54 vars in 962 bytes} [Sun Aug 28 00:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:54:38.518761 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c437e7-96ef-4624-a2e4-298f6691a878 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:38.531124 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 789/1570] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:54:38 2022] POST /identity/v3/users => generated 290 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:54:38.532227 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2a40c-0625-43f0-a802-5b9c815d6a64 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:38.542236 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2a40c-0625-43f0-a802-5b9c815d6a64 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:38.587785 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c437e7-96ef-4624-a2e4-298f6691a878 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:38.592815 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412b94c-c6d5-4249-9255-f2c644ff7a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:38.593537 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412b94c-c6d5-4249-9255-f2c644ff7a22 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:38.593962 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412b94c-c6d5-4249-9255-f2c644ff7a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:38.594335 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412b94c-c6d5-4249-9255-f2c644ff7a22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:38.595061 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412b94c-c6d5-4249-9255-f2c644ff7a22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:38.597096 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412b94c-c6d5-4249-9255-f2c644ff7a22 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:38.598089 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf8b73-e8fb-4a72-99bf-4d4d43831dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:38.598733 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf8b73-e8fb-4a72-99bf-4d4d43831dde admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:38.599024 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf8b73-e8fb-4a72-99bf-4d4d43831dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:38.599611 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf8b73-e8fb-4a72-99bf-4d4d43831dde admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:38.600251 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf8b73-e8fb-4a72-99bf-4d4d43831dde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:38.602305 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf8b73-e8fb-4a72-99bf-4d4d43831dde admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:38.627047 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 782/1571] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:54:38 2022] POST /identity/v3/projects => generated 393 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:54:38.630798 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412b94c-c6d5-4249-9255-f2c644ff7a22 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:38.630936 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 790/1572] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:54:38 2022] POST /identity/v3/projects => generated 369 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:54:38.631632 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf8b73-e8fb-4a72-99bf-4d4d43831dde admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:38.665326 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:38.670492 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:38.695004 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf8b73-e8fb-4a72-99bf-4d4d43831dde admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:38.695672 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412b94c-c6d5-4249-9255-f2c644ff7a22 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:38.699761 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c54528-8210-49fe-84d9-cd31d97b8146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:38.700372 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c54528-8210-49fe-84d9-cd31d97b8146 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:38.700653 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c54528-8210-49fe-84d9-cd31d97b8146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:38.700924 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c54528-8210-49fe-84d9-cd31d97b8146 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:38.701576 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c54528-8210-49fe-84d9-cd31d97b8146 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:54:38.701790 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf5a72-d40d-4a84-ae47-a297494c67e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:38.701947 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c54528-8210-49fe-84d9-cd31d97b8146 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:38.702431 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf5a72-d40d-4a84-ae47-a297494c67e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:38.702704 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf5a72-d40d-4a84-ae47-a297494c67e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:38.702968 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf5a72-d40d-4a84-ae47-a297494c67e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:38.703518 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c54528-8210-49fe-84d9-cd31d97b8146 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:38.703616 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf5a72-d40d-4a84-ae47-a297494c67e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:54:38.703922 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf5a72-d40d-4a84-ae47-a297494c67e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:38.706255 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf5a72-d40d-4a84-ae47-a297494c67e1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:38.715042 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 791/1573] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:54:38.715925 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c54528-8210-49fe-84d9-cd31d97b8146 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:38.726171 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 783/1574] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:54:38.726171 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf5a72-d40d-4a84-ae47-a297494c67e1 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:38.731785 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf5a72-d40d-4a84-ae47-a297494c67e1 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:38.732103 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c54528-8210-49fe-84d9-cd31d97b8146 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:38.736200 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bddeafb-79f0-477b-8ab3-4fe8e649014f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:38.736900 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bddeafb-79f0-477b-8ab3-4fe8e649014f admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:38.737051 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9a833-c2d4-4c52-9ed0-9f43c51bae20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:38.737181 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bddeafb-79f0-477b-8ab3-4fe8e649014f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:38.737432 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bddeafb-79f0-477b-8ab3-4fe8e649014f admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:38.737605 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9a833-c2d4-4c52-9ed0-9f43c51bae20 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:38.737907 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9a833-c2d4-4c52-9ed0-9f43c51bae20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:38.738081 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bddeafb-79f0-477b-8ab3-4fe8e649014f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:38.738268 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9a833-c2d4-4c52-9ed0-9f43c51bae20 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:38.739546 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9a833-c2d4-4c52-9ed0-9f43c51bae20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:54:38.739847 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9a833-c2d4-4c52-9ed0-9f43c51bae20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:38.739991 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bddeafb-79f0-477b-8ab3-4fe8e649014f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:38.741428 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9a833-c2d4-4c52-9ed0-9f43c51bae20 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:38.755022 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 792/1575] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:54:38.756248 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86b19d-4714-45c4-8fd5-58ff73066b8f None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:38.756583 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86b19d-4714-45c4-8fd5-58ff73066b8f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:38.756858 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86b19d-4714-45c4-8fd5-58ff73066b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:38.769650 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 784/1576] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:54:38 2022] POST /identity/v3/users => generated 293 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:54:38.770893 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bddeafb-79f0-477b-8ab3-4fe8e649014f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:38.780558 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bddeafb-79f0-477b-8ab3-4fe8e649014f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:38.785351 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410f81e-fc81-4971-9263-7f163ff28f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:38.785987 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410f81e-fc81-4971-9263-7f163ff28f6b admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:38.786270 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410f81e-fc81-4971-9263-7f163ff28f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:38.786544 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410f81e-fc81-4971-9263-7f163ff28f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:38.787183 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410f81e-fc81-4971-9263-7f163ff28f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:38.788812 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410f81e-fc81-4971-9263-7f163ff28f6b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:38.795026 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-5d86b19d-4714-45c4-8fd5-58ff73066b8f None None] MFA Rules not processed for user `f890ff4e7807477db7f17c2f6434dce8`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:38.796243 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-5d86b19d-4714-45c4-8fd5-58ff73066b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:38.799519 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 785/1577] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:54:38.802890 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410f81e-fc81-4971-9263-7f163ff28f6b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:38.813440 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410f81e-fc81-4971-9263-7f163ff28f6b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:38.818765 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7bc4a0-e771-41df-860a-1be8a0cda7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:38.819388 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bc4a0-e771-41df-860a-1be8a0cda7de admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:38.819662 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bc4a0-e771-41df-860a-1be8a0cda7de admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:38.819922 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bc4a0-e771-41df-860a-1be8a0cda7de admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:38.820541 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7bc4a0-e771-41df-860a-1be8a0cda7de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:38.822507 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7bc4a0-e771-41df-860a-1be8a0cda7de admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:38.849255 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 786/1578] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:54:38 2022] POST /identity/v3/users => generated 297 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:54:38.849255 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7bc4a0-e771-41df-860a-1be8a0cda7de admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:38.857054 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7bc4a0-e771-41df-860a-1be8a0cda7de admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:38.862222 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67db8b-4e77-4c6e-97af-71bc21c73753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:38.862831 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67db8b-4e77-4c6e-97af-71bc21c73753 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:38.863104 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67db8b-4e77-4c6e-97af-71bc21c73753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:38.863366 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67db8b-4e77-4c6e-97af-71bc21c73753 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:38.863992 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67db8b-4e77-4c6e-97af-71bc21c73753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:38.865936 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67db8b-4e77-4c6e-97af-71bc21c73753 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:38.867611 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 793/1579] 10.222.0.52 () {58 vars in 1059 bytes} [Sun Aug 28 00:54:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:38.868441 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86b19d-4714-45c4-8fd5-58ff73066b8f None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:38.879194 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86b19d-4714-45c4-8fd5-58ff73066b8f None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:38.884334 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15238e-6834-49c0-b1a6-f11a26c7adcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:38.884990 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15238e-6834-49c0-b1a6-f11a26c7adcf admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:38.885383 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15238e-6834-49c0-b1a6-f11a26c7adcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:38.885650 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15238e-6834-49c0-b1a6-f11a26c7adcf admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:38.886553 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15238e-6834-49c0-b1a6-f11a26c7adcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:38.888478 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15238e-6834-49c0-b1a6-f11a26c7adcf admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:38.893644 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 787/1580] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:54:38 2022] POST /identity/v3/users => generated 285 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:54:38.893644 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67db8b-4e77-4c6e-97af-71bc21c73753 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:38.902996 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67db8b-4e77-4c6e-97af-71bc21c73753 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:38.907509 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e11c6-dd06-4cc4-8453-fe5afc2baff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:38.908102 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e11c6-dd06-4cc4-8453-fe5afc2baff3 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:38.908638 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e11c6-dd06-4cc4-8453-fe5afc2baff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:38.908638 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e11c6-dd06-4cc4-8453-fe5afc2baff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:38.909248 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e11c6-dd06-4cc4-8453-fe5afc2baff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:38.911198 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e11c6-dd06-4cc4-8453-fe5afc2baff3 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:38.920347 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 794/1581] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:54:38 2022] POST /identity/v3/projects => generated 363 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:54:38.921316 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15238e-6834-49c0-b1a6-f11a26c7adcf admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:38.945394 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 788/1582] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:54:38 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:54:38.945394 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e11c6-dd06-4cc4-8453-fe5afc2baff3 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:38.984664 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15238e-6834-49c0-b1a6-f11a26c7adcf admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:38.999785 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:39.007080 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e11c6-dd06-4cc4-8453-fe5afc2baff3 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:39.012715 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c24a23-d27d-471f-bf2c-420b825ff513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:39.013324 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c24a23-d27d-471f-bf2c-420b825ff513 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:39.014073 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c24a23-d27d-471f-bf2c-420b825ff513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:39.014352 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c24a23-d27d-471f-bf2c-420b825ff513 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:39.014999 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c24a23-d27d-471f-bf2c-420b825ff513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:39.016639 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c24a23-d27d-471f-bf2c-420b825ff513 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:39.026918 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 789/1583] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:54:39.027773 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c24a23-d27d-471f-bf2c-420b825ff513 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:39.037754 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c24a23-d27d-471f-bf2c-420b825ff513 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:39.042550 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bcab3-a499-42df-9035-1f19d3697d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:39.043187 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bcab3-a499-42df-9035-1f19d3697d5a admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:39.043470 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bcab3-a499-42df-9035-1f19d3697d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:39.043746 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bcab3-a499-42df-9035-1f19d3697d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:39.044391 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409bcab3-a499-42df-9035-1f19d3697d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:39.046077 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409bcab3-a499-42df-9035-1f19d3697d5a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:39.048592 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d22c5-1083-442e-8b50-d1334b2647aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:39.049197 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d22c5-1083-442e-8b50-d1334b2647aa admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:39.049471 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d22c5-1083-442e-8b50-d1334b2647aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:39.049738 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d22c5-1083-442e-8b50-d1334b2647aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:39.050400 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d22c5-1083-442e-8b50-d1334b2647aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:39.052283 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d22c5-1083-442e-8b50-d1334b2647aa admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:39.056432 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 790/1584] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:54:39.057231 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bcab3-a499-42df-9035-1f19d3697d5a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:39.069376 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bcab3-a499-42df-9035-1f19d3697d5a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:39.075944 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559f6a0-7ebe-46a2-8295-a9fce067bd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:39.076540 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559f6a0-7ebe-46a2-8295-a9fce067bd5c admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:39.076819 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559f6a0-7ebe-46a2-8295-a9fce067bd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:39.077092 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559f6a0-7ebe-46a2-8295-a9fce067bd5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:39.077731 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559f6a0-7ebe-46a2-8295-a9fce067bd5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:39.079370 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559f6a0-7ebe-46a2-8295-a9fce067bd5c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:39.081142 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 795/1585] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:54:38 2022] POST /identity/v3/projects => generated 375 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:54:39.082009 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d22c5-1083-442e-8b50-d1334b2647aa admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:39.093569 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 791/1586] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:54:39.093569 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559f6a0-7ebe-46a2-8295-a9fce067bd5c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:39.101402 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559f6a0-7ebe-46a2-8295-a9fce067bd5c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:39.114026 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:39.153066 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d22c5-1083-442e-8b50-d1334b2647aa admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:39.158914 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2007c-38ce-413a-8bd2-49000d2c8fc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:39.159688 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2007c-38ce-413a-8bd2-49000d2c8fc1 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:39.159989 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2007c-38ce-413a-8bd2-49000d2c8fc1 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:39.160270 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2007c-38ce-413a-8bd2-49000d2c8fc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:39.161682 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1484fff-62e4-4ce7-8bc2-98338755266d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:39.162324 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1484fff-62e4-4ce7-8bc2-98338755266d admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:39.162603 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1484fff-62e4-4ce7-8bc2-98338755266d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:39.162872 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1484fff-62e4-4ce7-8bc2-98338755266d admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:39.163550 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1484fff-62e4-4ce7-8bc2-98338755266d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:39.165202 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1484fff-62e4-4ce7-8bc2-98338755266d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:39.176154 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 792/1587] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:54:39.176782 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1484fff-62e4-4ce7-8bc2-98338755266d admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:39.187507 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1484fff-62e4-4ce7-8bc2-98338755266d admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:39.192189 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048ba5f-f56f-497f-a0be-608704ef1ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:39.192764 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048ba5f-f56f-497f-a0be-608704ef1ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:39.193040 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048ba5f-f56f-497f-a0be-608704ef1ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:39.193344 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048ba5f-f56f-497f-a0be-608704ef1ac8 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:39.193990 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048ba5f-f56f-497f-a0be-608704ef1ac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:39.196004 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048ba5f-f56f-497f-a0be-608704ef1ac8 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:39.221100 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 793/1588] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:54:39 2022] POST /identity/v3/users => generated 282 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:54:39.221987 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048ba5f-f56f-497f-a0be-608704ef1ac8 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:39.226287 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2007c-38ce-413a-8bd2-49000d2c8fc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:39.227901 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2007c-38ce-413a-8bd2-49000d2c8fc1 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:39.232519 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048ba5f-f56f-497f-a0be-608704ef1ac8 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:39.237033 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 796/1589] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:54:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:54:39.237182 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618975c-9c69-46ae-b263-c26d9789a8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:39.237754 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618975c-9c69-46ae-b263-c26d9789a8e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:39.237964 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2007c-38ce-413a-8bd2-49000d2c8fc1 service nova] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:39.238083 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618975c-9c69-46ae-b263-c26d9789a8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:39.238389 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618975c-9c69-46ae-b263-c26d9789a8e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:39.238955 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618975c-9c69-46ae-b263-c26d9789a8e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:39.240880 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618975c-9c69-46ae-b263-c26d9789a8e2 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:39.248620 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2007c-38ce-413a-8bd2-49000d2c8fc1 service nova] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:39.253413 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f649b-6d15-4565-b05b-4064e54ed60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:39.254072 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f649b-6d15-4565-b05b-4064e54ed60e admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:39.254332 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f649b-6d15-4565-b05b-4064e54ed60e admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:39.254606 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f649b-6d15-4565-b05b-4064e54ed60e admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:39.255244 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f649b-6d15-4565-b05b-4064e54ed60e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:39.256950 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f649b-6d15-4565-b05b-4064e54ed60e admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:39.268736 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 794/1590] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:54:39 2022] POST /identity/v3/users => generated 295 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:54:39.268736 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618975c-9c69-46ae-b263-c26d9789a8e2 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:39.269016 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 797/1591] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:54:39.269111 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f649b-6d15-4565-b05b-4064e54ed60e admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:39.279965 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618975c-9c69-46ae-b263-c26d9789a8e2 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:39.280173 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f649b-6d15-4565-b05b-4064e54ed60e admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:39.284798 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ac609-3276-4c41-90d8-d15ac2537f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:39.285375 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ac609-3276-4c41-90d8-d15ac2537f49 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:39.285654 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ac609-3276-4c41-90d8-d15ac2537f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:39.286094 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ac609-3276-4c41-90d8-d15ac2537f49 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:39.286644 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ac609-3276-4c41-90d8-d15ac2537f49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:39.287709 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc50bdf-30ae-469b-960e-1a5075f60eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:39.288473 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc50bdf-30ae-469b-960e-1a5075f60eb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:39.288592 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ac609-3276-4c41-90d8-d15ac2537f49 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:39.288754 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc50bdf-30ae-469b-960e-1a5075f60eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:39.289095 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc50bdf-30ae-469b-960e-1a5075f60eb2 admin admin] PATH_INFO: `/v3/projects/3513289586f248dbbf966bfa15aefca5/users/c9ef21c1f5b949df8230d1587c4a1fa6/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:39.307112 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc50bdf-30ae-469b-960e-1a5075f60eb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3513289586f248dbbf966bfa15aefca5, user_id=c9ef21c1f5b949df8230d1587c4a1fa6, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:39.308308 dv-cinder-master-3-smb devstack@keystone.service[81517]: WARNING py.warnings [None req-3bc50bdf-30ae-469b-960e-1a5075f60eb2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 00:54:39.308308 dv-cinder-master-3-smb devstack@keystone.service[81517]: warnings.warn(msg) Aug 28 00:54:39.308308 dv-cinder-master-3-smb devstack@keystone.service[81517]: Aug 28 00:54:39.310615 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc50bdf-30ae-469b-960e-1a5075f60eb2 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:39.312236 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 798/1592] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:54:39 2022] POST /identity/v3/users => generated 288 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:54:39.313108 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ac609-3276-4c41-90d8-d15ac2537f49 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:39.324145 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ac609-3276-4c41-90d8-d15ac2537f49 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:39.329827 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 795/1593] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:54:39 2022] PUT /identity/v3/projects/3513289586f248dbbf966bfa15aefca5/users/c9ef21c1f5b949df8230d1587c4a1fa6/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:54:39.331068 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc50bdf-30ae-469b-960e-1a5075f60eb2 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:39.335979 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:39.390622 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fd2ae-38d5-4f5d-815c-f4fc42f5020b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:39.391420 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fd2ae-38d5-4f5d-815c-f4fc42f5020b admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:39.391787 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fd2ae-38d5-4f5d-815c-f4fc42f5020b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:39.392152 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fd2ae-38d5-4f5d-815c-f4fc42f5020b admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:39.392898 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fd2ae-38d5-4f5d-815c-f4fc42f5020b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:39.394827 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fd2ae-38d5-4f5d-815c-f4fc42f5020b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:39.401174 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc50bdf-30ae-469b-960e-1a5075f60eb2 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:39.406670 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47404f-276d-420f-90d0-83163e596230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:39.410270 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 799/1594] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:54:39.410380 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47404f-276d-420f-90d0-83163e596230 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:39.410380 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47404f-276d-420f-90d0-83163e596230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:39.410380 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47404f-276d-420f-90d0-83163e596230 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:39.410380 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47404f-276d-420f-90d0-83163e596230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:39.410700 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fd2ae-38d5-4f5d-815c-f4fc42f5020b admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:39.410783 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47404f-276d-420f-90d0-83163e596230 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:39.423800 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 796/1595] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:54:39.424423 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fd2ae-38d5-4f5d-815c-f4fc42f5020b admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:39.424560 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47404f-276d-420f-90d0-83163e596230 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:39.428750 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2dda77-2600-4b20-b791-d7a2f5bb7ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:39.429472 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dda77-2600-4b20-b791-d7a2f5bb7ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:39.429814 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dda77-2600-4b20-b791-d7a2f5bb7ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:39.430189 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dda77-2600-4b20-b791-d7a2f5bb7ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:39.430984 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2dda77-2600-4b20-b791-d7a2f5bb7ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:39.433593 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2dda77-2600-4b20-b791-d7a2f5bb7ea4 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:39.434869 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47404f-276d-420f-90d0-83163e596230 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:39.439772 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7dd9a-f901-4f55-a855-b401e6ae6939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:39.440445 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7dd9a-f901-4f55-a855-b401e6ae6939 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:39.440823 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7dd9a-f901-4f55-a855-b401e6ae6939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:39.441162 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7dd9a-f901-4f55-a855-b401e6ae6939 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:39.441902 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7dd9a-f901-4f55-a855-b401e6ae6939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:39.443625 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7dd9a-f901-4f55-a855-b401e6ae6939 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:39.446736 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 800/1596] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:54:39.447661 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2dda77-2600-4b20-b791-d7a2f5bb7ea4 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:39.455023 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 797/1597] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:54:39.455886 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7dd9a-f901-4f55-a855-b401e6ae6939 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:39.460926 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2dda77-2600-4b20-b791-d7a2f5bb7ea4 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:39.465804 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af2d17-639b-4e5c-9360-3824720fdd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:39.466663 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af2d17-639b-4e5c-9360-3824720fdd1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:39.466949 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af2d17-639b-4e5c-9360-3824720fdd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:39.467251 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af2d17-639b-4e5c-9360-3824720fdd1f admin admin] PATH_INFO: `/v3/projects/44778b8fc08d4efaadf42fe5a382b5da/users/5f227aa72915442384469ddc844198dd/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:39.470080 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7dd9a-f901-4f55-a855-b401e6ae6939 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:39.475355 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3780d6c-ce1d-48af-9543-440fca59b394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:39.476124 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3780d6c-ce1d-48af-9543-440fca59b394 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:39.476576 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3780d6c-ce1d-48af-9543-440fca59b394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:39.476994 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3780d6c-ce1d-48af-9543-440fca59b394 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:39.477944 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3780d6c-ce1d-48af-9543-440fca59b394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:39.480391 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3780d6c-ce1d-48af-9543-440fca59b394 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:39.482771 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af2d17-639b-4e5c-9360-3824720fdd1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=44778b8fc08d4efaadf42fe5a382b5da, user_id=5f227aa72915442384469ddc844198dd, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:39.485480 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af2d17-639b-4e5c-9360-3824720fdd1f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:39.494996 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 798/1598] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:54:39.494996 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79da13-ae62-4723-8574-ccad24a24c45 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:39.494996 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79da13-ae62-4723-8574-ccad24a24c45 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:39.494996 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79da13-ae62-4723-8574-ccad24a24c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:39.500897 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 801/1599] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:54:39 2022] PUT /identity/v3/projects/44778b8fc08d4efaadf42fe5a382b5da/users/5f227aa72915442384469ddc844198dd/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:54:39.501779 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af2d17-639b-4e5c-9360-3824720fdd1f admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:39.516001 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-6b79da13-ae62-4723-8574-ccad24a24c45 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:39.517343 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6b79da13-ae62-4723-8574-ccad24a24c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:39.553139 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:39.577125 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af2d17-639b-4e5c-9360-3824720fdd1f admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:39.582233 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352a631-614a-4a4a-ac3d-668615f3bdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:39.584118 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352a631-614a-4a4a-ac3d-668615f3bdd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:39.584118 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352a631-614a-4a4a-ac3d-668615f3bdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:39.584118 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352a631-614a-4a4a-ac3d-668615f3bdd9 admin admin] PATH_INFO: `/v3/projects/43c85d5220304cce8699c7eb041e35a1/users/687249b94db247b4b608e416559d0556/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:39.596734 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 799/1600] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:39.597599 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79da13-ae62-4723-8574-ccad24a24c45 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:39.600467 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352a631-614a-4a4a-ac3d-668615f3bdd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43c85d5220304cce8699c7eb041e35a1, user_id=687249b94db247b4b608e416559d0556, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:39.606292 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352a631-614a-4a4a-ac3d-668615f3bdd9 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:39.607852 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79da13-ae62-4723-8574-ccad24a24c45 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:39.613235 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1953f-dd4e-4152-960b-a08d5023f075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:39.614020 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1953f-dd4e-4152-960b-a08d5023f075 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:39.614406 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1953f-dd4e-4152-960b-a08d5023f075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:39.614671 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1953f-dd4e-4152-960b-a08d5023f075 admin admin] PATH_INFO: `/v3/projects/5330be95cf364ed2b49fdd93b8c70a7a/users/bb9a97f64c184e258a45e1137e405d68/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:39.623080 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 802/1601] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:54:39 2022] PUT /identity/v3/projects/43c85d5220304cce8699c7eb041e35a1/users/687249b94db247b4b608e416559d0556/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:54:39.624477 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352a631-614a-4a4a-ac3d-668615f3bdd9 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:39.629792 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c1953f-dd4e-4152-960b-a08d5023f075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5330be95cf364ed2b49fdd93b8c70a7a, user_id=bb9a97f64c184e258a45e1137e405d68, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:39.632502 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c1953f-dd4e-4152-960b-a08d5023f075 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:39.645704 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 800/1602] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:54:39 2022] PUT /identity/v3/projects/5330be95cf364ed2b49fdd93b8c70a7a/users/bb9a97f64c184e258a45e1137e405d68/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:54:39.654856 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1953f-dd4e-4152-960b-a08d5023f075 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:39.682438 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:39.688738 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352a631-614a-4a4a-ac3d-668615f3bdd9 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:39.718925 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1953f-dd4e-4152-960b-a08d5023f075 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:39.723808 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c19c3c-0367-4480-80b5-ed274b40b9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:39.724741 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c19c3c-0367-4480-80b5-ed274b40b9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:39.725026 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c19c3c-0367-4480-80b5-ed274b40b9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:39.725288 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c19c3c-0367-4480-80b5-ed274b40b9e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:39.725955 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c19c3c-0367-4480-80b5-ed274b40b9e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:39.727573 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c19c3c-0367-4480-80b5-ed274b40b9e7 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:39.737606 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 801/1603] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:54:39.738840 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66458201-b5bd-4cad-9813-5e8a6edf9854 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:39.739120 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66458201-b5bd-4cad-9813-5e8a6edf9854 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:39.739399 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66458201-b5bd-4cad-9813-5e8a6edf9854 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:39.740797 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 802/1604] 10.222.0.52 () {54 vars in 912 bytes} [Sun Aug 28 00:54:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:54:39.741374 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66458201-b5bd-4cad-9813-5e8a6edf9854 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:39.748491 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bff454-2e30-40ef-ab23-9d29d566509f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:39.749134 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bff454-2e30-40ef-ab23-9d29d566509f admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:39.749414 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bff454-2e30-40ef-ab23-9d29d566509f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:39.749684 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bff454-2e30-40ef-ab23-9d29d566509f admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:39.750362 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bff454-2e30-40ef-ab23-9d29d566509f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:39.752197 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bff454-2e30-40ef-ab23-9d29d566509f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:39.754004 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66458201-b5bd-4cad-9813-5e8a6edf9854 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:39.758704 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc49260-9323-456a-9be2-0ed189793a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:39.759297 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc49260-9323-456a-9be2-0ed189793a74 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:39.759578 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc49260-9323-456a-9be2-0ed189793a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:39.759850 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc49260-9323-456a-9be2-0ed189793a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:39.760488 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc49260-9323-456a-9be2-0ed189793a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:39.762262 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc49260-9323-456a-9be2-0ed189793a74 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:39.762865 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 803/1605] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:54:39.763947 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cbba4-a8f0-419e-92bc-8bd05ec91cc7 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:39.764238 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cbba4-a8f0-419e-92bc-8bd05ec91cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:39.764641 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cbba4-a8f0-419e-92bc-8bd05ec91cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:39.774149 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 803/1606] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:54:39.775257 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc49260-9323-456a-9be2-0ed189793a74 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:39.785134 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-4f7cbba4-a8f0-419e-92bc-8bd05ec91cc7 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:39.786400 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-4f7cbba4-a8f0-419e-92bc-8bd05ec91cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:39.798033 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 804/1607] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:39.799832 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccfe04-c446-49b6-be8f-44d5edbc0a6e None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:39.800302 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccfe04-c446-49b6-be8f-44d5edbc0a6e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:39.800762 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccfe04-c446-49b6-be8f-44d5edbc0a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:39.826307 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-85ccfe04-c446-49b6-be8f-44d5edbc0a6e None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:39.828337 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-85ccfe04-c446-49b6-be8f-44d5edbc0a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:39.836217 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 805/1608] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:39.837590 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e1c86-9a39-437b-b9d3-a7eec923b4bd None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:39.837905 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e1c86-9a39-437b-b9d3-a7eec923b4bd None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:39.838300 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e1c86-9a39-437b-b9d3-a7eec923b4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:39.846158 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc49260-9323-456a-9be2-0ed189793a74 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:39.850730 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d18c16-ba2a-49a9-b76f-c0dfd893457c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:39.851340 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d18c16-ba2a-49a9-b76f-c0dfd893457c service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:39.851671 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d18c16-ba2a-49a9-b76f-c0dfd893457c service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:39.851929 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d18c16-ba2a-49a9-b76f-c0dfd893457c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:39.866182 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d18c16-ba2a-49a9-b76f-c0dfd893457c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:39.866869 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-559e1c86-9a39-437b-b9d3-a7eec923b4bd None None] MFA Rules not processed for user `bb9a97f64c184e258a45e1137e405d68`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:39.867682 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d18c16-ba2a-49a9-b76f-c0dfd893457c service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:39.868083 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-559e1c86-9a39-437b-b9d3-a7eec923b4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:39.877109 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 804/1609] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:54:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:54:39.877913 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d18c16-ba2a-49a9-b76f-c0dfd893457c service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:39.887482 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d18c16-ba2a-49a9-b76f-c0dfd893457c service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:39.893916 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae897e9f-7d35-4abf-8e6d-d8457f0c8013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:39.894568 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae897e9f-7d35-4abf-8e6d-d8457f0c8013 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:39.894854 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae897e9f-7d35-4abf-8e6d-d8457f0c8013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:39.895108 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae897e9f-7d35-4abf-8e6d-d8457f0c8013 admin admin] PATH_INFO: `/v3/projects/74898ba0beb64167a612629cd2efb278/users/cc8eaa6c0af74ff3aa6e41189388dc8e/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:39.912051 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae897e9f-7d35-4abf-8e6d-d8457f0c8013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74898ba0beb64167a612629cd2efb278, user_id=cc8eaa6c0af74ff3aa6e41189388dc8e, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:39.914853 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae897e9f-7d35-4abf-8e6d-d8457f0c8013 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:39.928642 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 805/1610] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:54:39 2022] PUT /identity/v3/projects/74898ba0beb64167a612629cd2efb278/users/cc8eaa6c0af74ff3aa6e41189388dc8e/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:54:39.929900 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922fe51-9475-473c-8fe4-21355d41b557 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:39.930183 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922fe51-9475-473c-8fe4-21355d41b557 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:39.930451 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922fe51-9475-473c-8fe4-21355d41b557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:39.944418 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 806/1611] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:39.945584 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e1c86-9a39-437b-b9d3-a7eec923b4bd None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:39.950769 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-8922fe51-9475-473c-8fe4-21355d41b557 None None] MFA Rules not processed for user `f890ff4e7807477db7f17c2f6434dce8`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:39.952666 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8922fe51-9475-473c-8fe4-21355d41b557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:39.956714 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:39.957010 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e1c86-9a39-437b-b9d3-a7eec923b4bd None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:40.027432 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d417505-a6b0-4f61-9378-b4744a7a2549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:40.028342 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d417505-a6b0-4f61-9378-b4744a7a2549 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:40.028818 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d417505-a6b0-4f61-9378-b4744a7a2549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:40.029305 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d417505-a6b0-4f61-9378-b4744a7a2549 admin admin] PATH_INFO: `/v3/projects/f5d7e36eee0b4b9db4b0ecf704f3f326/users/c6b390fd5a014ca5976ed77d1f77efaf/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:40.031069 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 806/1612] 10.222.0.52 () {58 vars in 1009 bytes} [Sun Aug 28 00:54:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:40.037773 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922fe51-9475-473c-8fe4-21355d41b557 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:40.048180 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d417505-a6b0-4f61-9378-b4744a7a2549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5d7e36eee0b4b9db4b0ecf704f3f326, user_id=c6b390fd5a014ca5976ed77d1f77efaf, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:40.051789 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d417505-a6b0-4f61-9378-b4744a7a2549 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:40.052538 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922fe51-9475-473c-8fe4-21355d41b557 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:40.059371 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cdb121-c459-4943-bd74-255aa7772225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:40.060274 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cdb121-c459-4943-bd74-255aa7772225 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:40.060669 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cdb121-c459-4943-bd74-255aa7772225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:40.061007 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cdb121-c459-4943-bd74-255aa7772225 admin admin] PATH_INFO: `/v3/projects/92ce0c8bbcda4400b3dc7f220dff9ed1/users/1810e64573d145d48b13c774b7a07e60/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:40.063231 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:40.077712 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 807/1613] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:54:39 2022] PUT /identity/v3/projects/f5d7e36eee0b4b9db4b0ecf704f3f326/users/c6b390fd5a014ca5976ed77d1f77efaf/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:54:40.078234 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d417505-a6b0-4f61-9378-b4744a7a2549 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:40.092317 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cdb121-c459-4943-bd74-255aa7772225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92ce0c8bbcda4400b3dc7f220dff9ed1, user_id=1810e64573d145d48b13c774b7a07e60, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:40.095408 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cdb121-c459-4943-bd74-255aa7772225 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:40.114547 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 807/1614] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:54:40 2022] PUT /identity/v3/projects/92ce0c8bbcda4400b3dc7f220dff9ed1/users/1810e64573d145d48b13c774b7a07e60/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:54:40.114547 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cdb121-c459-4943-bd74-255aa7772225 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:40.151933 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d417505-a6b0-4f61-9378-b4744a7a2549 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:40.178949 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cdb121-c459-4943-bd74-255aa7772225 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:40.182983 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958299cf-b8d4-4d29-a2db-155e7ac1b82b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:40.183665 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958299cf-b8d4-4d29-a2db-155e7ac1b82b service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:40.183947 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958299cf-b8d4-4d29-a2db-155e7ac1b82b service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:40.184247 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958299cf-b8d4-4d29-a2db-155e7ac1b82b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:40.206149 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeecc4fc-6f87-4cd2-bb99-4f10ff3f7ec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:40.207253 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecc4fc-6f87-4cd2-bb99-4f10ff3f7ec4 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:40.207618 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecc4fc-6f87-4cd2-bb99-4f10ff3f7ec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:40.207901 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecc4fc-6f87-4cd2-bb99-4f10ff3f7ec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:40.256501 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958299cf-b8d4-4d29-a2db-155e7ac1b82b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:40.258717 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958299cf-b8d4-4d29-a2db-155e7ac1b82b service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:40.269571 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 808/1615] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:54:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:54:40.270750 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf71f3-4c90-40e0-8180-433ebd9e1e27 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:40.271036 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf71f3-4c90-40e0-8180-433ebd9e1e27 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:40.271311 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf71f3-4c90-40e0-8180-433ebd9e1e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:40.279621 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeecc4fc-6f87-4cd2-bb99-4f10ff3f7ec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:40.280771 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeecc4fc-6f87-4cd2-bb99-4f10ff3f7ec4 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:40.290416 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-7dbf71f3-4c90-40e0-8180-433ebd9e1e27 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:40.291704 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7dbf71f3-4c90-40e0-8180-433ebd9e1e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:40.292364 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 808/1616] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:54:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:54:40.293192 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeecc4fc-6f87-4cd2-bb99-4f10ff3f7ec4 service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:40.299808 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 809/1617] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:40.300416 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf71f3-4c90-40e0-8180-433ebd9e1e27 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:40.307328 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeecc4fc-6f87-4cd2-bb99-4f10ff3f7ec4 service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:40.314556 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7650015-294b-4ab1-ab0f-6931320d586c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:40.315147 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7650015-294b-4ab1-ab0f-6931320d586c admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:40.315481 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7650015-294b-4ab1-ab0f-6931320d586c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:40.315757 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7650015-294b-4ab1-ab0f-6931320d586c admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:40.316391 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7650015-294b-4ab1-ab0f-6931320d586c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:40.318480 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7650015-294b-4ab1-ab0f-6931320d586c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:40.327627 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:40.373949 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 809/1618] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:54:40 2022] POST /identity/v3/projects => generated 371 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:54:40.376788 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5255496-2d7c-4ce5-af3d-792eae7609e1 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:40.377588 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5255496-2d7c-4ce5-af3d-792eae7609e1 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:40.377897 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5255496-2d7c-4ce5-af3d-792eae7609e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:40.378199 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf71f3-4c90-40e0-8180-433ebd9e1e27 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:40.414673 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-e5255496-2d7c-4ce5-af3d-792eae7609e1 None None] MFA Rules not processed for user `c6b390fd5a014ca5976ed77d1f77efaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:40.415940 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e5255496-2d7c-4ce5-af3d-792eae7609e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:40.452947 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:40.496542 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490da4a9-4ed2-45b6-8455-0732be744408 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:40.497406 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490da4a9-4ed2-45b6-8455-0732be744408 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:40.497571 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490da4a9-4ed2-45b6-8455-0732be744408 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:40.497954 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490da4a9-4ed2-45b6-8455-0732be744408 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:40.504381 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 810/1619] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:40.506080 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe2402-e485-46fe-9e3e-d6ff54304e02 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:40.506446 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe2402-e485-46fe-9e3e-d6ff54304e02 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:40.506721 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe2402-e485-46fe-9e3e-d6ff54304e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:40.535914 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-2dbe2402-e485-46fe-9e3e-d6ff54304e02 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:40.537110 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-2dbe2402-e485-46fe-9e3e-d6ff54304e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:40.591118 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490da4a9-4ed2-45b6-8455-0732be744408 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:40.593641 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490da4a9-4ed2-45b6-8455-0732be744408 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:40.609454 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 810/1620] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:54:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:54:40.610611 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490da4a9-4ed2-45b6-8455-0732be744408 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:40.661698 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 811/1621] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:40.664366 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe2402-e485-46fe-9e3e-d6ff54304e02 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:40.681730 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe2402-e485-46fe-9e3e-d6ff54304e02 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:40.692724 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490da4a9-4ed2-45b6-8455-0732be744408 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:40.695959 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883d9c3-633a-4880-8971-117c52fcd00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:40.698555 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0d346-7ebb-4334-8999-f1dbb919e5c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:40.699159 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0d346-7ebb-4334-8999-f1dbb919e5c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:40.699538 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0d346-7ebb-4334-8999-f1dbb919e5c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:40.699819 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0d346-7ebb-4334-8999-f1dbb919e5c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:40.700100 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883d9c3-633a-4880-8971-117c52fcd00c admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:40.700514 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883d9c3-633a-4880-8971-117c52fcd00c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:40.700730 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883d9c3-633a-4880-8971-117c52fcd00c admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:40.701395 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883d9c3-633a-4880-8971-117c52fcd00c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:40.705207 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883d9c3-633a-4880-8971-117c52fcd00c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:40.712644 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e0d346-7ebb-4334-8999-f1dbb919e5c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:40.715709 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e0d346-7ebb-4334-8999-f1dbb919e5c3 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:40.735975 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 811/1622] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:54:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:54:40.735975 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0d346-7ebb-4334-8999-f1dbb919e5c3 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:40.751692 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0d346-7ebb-4334-8999-f1dbb919e5c3 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:40.758430 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5e795-c494-4138-9374-483899a6859a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:40.759618 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5e795-c494-4138-9374-483899a6859a admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:40.760071 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5e795-c494-4138-9374-483899a6859a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:40.760381 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5e795-c494-4138-9374-483899a6859a admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:40.761897 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5e795-c494-4138-9374-483899a6859a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:40.764664 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5e795-c494-4138-9374-483899a6859a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:40.782291 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 812/1623] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:54:40 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:54:40.784582 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883d9c3-633a-4880-8971-117c52fcd00c admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:40.802487 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:40.805926 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883d9c3-633a-4880-8971-117c52fcd00c admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:40.817968 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 812/1624] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:54:40 2022] POST /identity/v3/projects => generated 365 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:54:40.817968 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5e795-c494-4138-9374-483899a6859a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:40.821551 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129ec15-18fd-4c95-8fbc-f945bae86dac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:40.822211 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129ec15-18fd-4c95-8fbc-f945bae86dac service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:40.822491 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129ec15-18fd-4c95-8fbc-f945bae86dac service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:40.822762 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129ec15-18fd-4c95-8fbc-f945bae86dac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:40.842256 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129ec15-18fd-4c95-8fbc-f945bae86dac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:40.843721 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129ec15-18fd-4c95-8fbc-f945bae86dac service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:40.869714 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 813/1625] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:54:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:54:40.870642 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129ec15-18fd-4c95-8fbc-f945bae86dac service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:40.889792 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129ec15-18fd-4c95-8fbc-f945bae86dac service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:40.985632 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275dd741-d303-4c7f-816f-97942e856cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:40.986580 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dd741-d303-4c7f-816f-97942e856cbc admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:40.987099 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dd741-d303-4c7f-816f-97942e856cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:40.987535 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dd741-d303-4c7f-816f-97942e856cbc admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:40.988359 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275dd741-d303-4c7f-816f-97942e856cbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:40.991071 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275dd741-d303-4c7f-816f-97942e856cbc admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:41.023807 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5e795-c494-4138-9374-483899a6859a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:41.030902 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 814/1626] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:54:40 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:54:41.034279 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275dd741-d303-4c7f-816f-97942e856cbc admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:41.041436 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4f6dd-d7ff-4e73-ad44-e29ac7bd600b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:41.042210 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4f6dd-d7ff-4e73-ad44-e29ac7bd600b admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:41.044281 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4f6dd-d7ff-4e73-ad44-e29ac7bd600b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:41.044580 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4f6dd-d7ff-4e73-ad44-e29ac7bd600b admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:41.046994 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4f6dd-d7ff-4e73-ad44-e29ac7bd600b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:41.053089 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4f6dd-d7ff-4e73-ad44-e29ac7bd600b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:41.058077 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275dd741-d303-4c7f-816f-97942e856cbc admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:41.070300 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1b838-8dc3-49fd-a445-3827e91e3596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:41.071340 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1b838-8dc3-49fd-a445-3827e91e3596 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:41.074440 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1b838-8dc3-49fd-a445-3827e91e3596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:41.074776 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1b838-8dc3-49fd-a445-3827e91e3596 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:41.076248 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1b838-8dc3-49fd-a445-3827e91e3596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:41.078266 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 813/1627] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:54:41.079084 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1b838-8dc3-49fd-a445-3827e91e3596 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:41.082472 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4f6dd-d7ff-4e73-ad44-e29ac7bd600b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:41.105937 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4f6dd-d7ff-4e73-ad44-e29ac7bd600b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:41.110907 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 815/1628] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:54:41.115398 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1b838-8dc3-49fd-a445-3827e91e3596 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:41.123731 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36421e73-d9c3-4fb6-8e3b-2ff8cfdb04c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:41.127051 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36421e73-d9c3-4fb6-8e3b-2ff8cfdb04c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:41.127561 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36421e73-d9c3-4fb6-8e3b-2ff8cfdb04c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:41.127842 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36421e73-d9c3-4fb6-8e3b-2ff8cfdb04c2 admin admin] PATH_INFO: `/v3/projects/88c3665d21e8489991f9037092fa9aca/users/fabd5e4340eb4ecca2070432cfc326dd/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:41.147180 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1b838-8dc3-49fd-a445-3827e91e3596 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:41.160284 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059599bd-557d-47ce-82e3-826dbf6e8a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:41.162367 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059599bd-557d-47ce-82e3-826dbf6e8a50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:41.162808 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059599bd-557d-47ce-82e3-826dbf6e8a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:41.163738 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059599bd-557d-47ce-82e3-826dbf6e8a50 admin admin] PATH_INFO: `/v3/projects/5a7d86f164cf475388b8102e1d497d0e/users/09dc18ee0701477584eb788ac5bc591c/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:41.173973 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36421e73-d9c3-4fb6-8e3b-2ff8cfdb04c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c3665d21e8489991f9037092fa9aca, user_id=fabd5e4340eb4ecca2070432cfc326dd, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:41.177186 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36421e73-d9c3-4fb6-8e3b-2ff8cfdb04c2 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:41.203330 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 814/1629] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:54:41 2022] PUT /identity/v3/projects/88c3665d21e8489991f9037092fa9aca/users/fabd5e4340eb4ecca2070432cfc326dd/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:54:41.206974 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36421e73-d9c3-4fb6-8e3b-2ff8cfdb04c2 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:41.209869 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059599bd-557d-47ce-82e3-826dbf6e8a50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a7d86f164cf475388b8102e1d497d0e, user_id=09dc18ee0701477584eb788ac5bc591c, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:41.212891 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059599bd-557d-47ce-82e3-826dbf6e8a50 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:41.223232 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:41.244871 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 816/1630] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:54:41 2022] PUT /identity/v3/projects/5a7d86f164cf475388b8102e1d497d0e/users/09dc18ee0701477584eb788ac5bc591c/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:54:41.248840 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059599bd-557d-47ce-82e3-826dbf6e8a50 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:41.419144 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36421e73-d9c3-4fb6-8e3b-2ff8cfdb04c2 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:41.468621 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059599bd-557d-47ce-82e3-826dbf6e8a50 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:41.485153 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1039e-60bc-46d5-ad1a-c6a19d8bd069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:41.489447 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1039e-60bc-46d5-ad1a-c6a19d8bd069 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:41.489972 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1039e-60bc-46d5-ad1a-c6a19d8bd069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:41.490347 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1039e-60bc-46d5-ad1a-c6a19d8bd069 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:41.492536 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1039e-60bc-46d5-ad1a-c6a19d8bd069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:41.502531 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1039e-60bc-46d5-ad1a-c6a19d8bd069 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:41.534181 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 817/1631] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:54:41.538577 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1039e-60bc-46d5-ad1a-c6a19d8bd069 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:41.573154 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1039e-60bc-46d5-ad1a-c6a19d8bd069 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:41.588898 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e279d-daa7-4e1c-aa42-9be916235230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:41.590847 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e279d-daa7-4e1c-aa42-9be916235230 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:41.592783 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e279d-daa7-4e1c-aa42-9be916235230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:41.593157 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e279d-daa7-4e1c-aa42-9be916235230 admin admin] PATH_INFO: `/v3/projects/5a7d86f164cf475388b8102e1d497d0e/users/09dc18ee0701477584eb788ac5bc591c/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:41.597886 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e279d-daa7-4e1c-aa42-9be916235230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a7d86f164cf475388b8102e1d497d0e, user_id=09dc18ee0701477584eb788ac5bc591c, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:41.604309 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e279d-daa7-4e1c-aa42-9be916235230 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:41.615651 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4346e6-5d53-44f7-a465-623abc7c503a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:41.616398 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4346e6-5d53-44f7-a465-623abc7c503a admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:41.617806 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4346e6-5d53-44f7-a465-623abc7c503a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:41.618194 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4346e6-5d53-44f7-a465-623abc7c503a admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:41.620504 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4346e6-5d53-44f7-a465-623abc7c503a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:41.627330 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4346e6-5d53-44f7-a465-623abc7c503a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:41.635576 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 818/1632] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:54:41 2022] PUT /identity/v3/projects/5a7d86f164cf475388b8102e1d497d0e/users/09dc18ee0701477584eb788ac5bc591c/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:54:41.646225 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1facc-de8a-4ab2-acc3-692db9d4925f None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:41.646649 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1facc-de8a-4ab2-acc3-692db9d4925f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:41.647024 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1facc-de8a-4ab2-acc3-692db9d4925f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:41.657118 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 815/1633] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:54:41.658353 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4346e6-5d53-44f7-a465-623abc7c503a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:41.681158 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4346e6-5d53-44f7-a465-623abc7c503a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:41.700715 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:41.712550 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-ccd1facc-de8a-4ab2-acc3-692db9d4925f None None] MFA Rules not processed for user `09dc18ee0701477584eb788ac5bc591c`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:41.718162 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ccd1facc-de8a-4ab2-acc3-692db9d4925f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:41.788699 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d75e8-29a1-4e1b-93f5-bc83e1b0655a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:41.790556 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d75e8-29a1-4e1b-93f5-bc83e1b0655a admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:41.792244 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d75e8-29a1-4e1b-93f5-bc83e1b0655a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:41.793805 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d75e8-29a1-4e1b-93f5-bc83e1b0655a admin admin] PATH_INFO: `/v3/projects/88c3665d21e8489991f9037092fa9aca/users/fabd5e4340eb4ecca2070432cfc326dd/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:41.797628 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d75e8-29a1-4e1b-93f5-bc83e1b0655a admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c3665d21e8489991f9037092fa9aca, user_id=fabd5e4340eb4ecca2070432cfc326dd, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:41.801133 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d75e8-29a1-4e1b-93f5-bc83e1b0655a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:41.816296 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 816/1634] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:54:41 2022] PUT /identity/v3/projects/88c3665d21e8489991f9037092fa9aca/users/fabd5e4340eb4ecca2070432cfc326dd/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:54:41.826717 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c7d79-6c68-42a3-870e-6094bb98333e None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:41.827327 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c7d79-6c68-42a3-870e-6094bb98333e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:41.827873 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c7d79-6c68-42a3-870e-6094bb98333e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:41.882082 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 819/1635] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:41 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:54:41.890491 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1facc-de8a-4ab2-acc3-692db9d4925f None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:41.927677 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-d96c7d79-6c68-42a3-870e-6094bb98333e None None] MFA Rules not processed for user `fabd5e4340eb4ecca2070432cfc326dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:41.932060 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d96c7d79-6c68-42a3-870e-6094bb98333e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:42.002044 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1facc-de8a-4ab2-acc3-692db9d4925f None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:42.035222 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:42.141032 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c7703-e6e6-4c3b-966b-6e416f7df21c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:42.141674 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c7703-e6e6-4c3b-966b-6e416f7df21c service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:42.141989 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c7703-e6e6-4c3b-966b-6e416f7df21c service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:42.142267 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c7703-e6e6-4c3b-966b-6e416f7df21c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:42.223149 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 817/1636] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:54:42.227386 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c7d79-6c68-42a3-870e-6094bb98333e None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:42.246289 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c7d79-6c68-42a3-870e-6094bb98333e None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:42.265877 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef3852-c62c-44fc-8c85-599219d0286f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:42.265877 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef3852-c62c-44fc-8c85-599219d0286f service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:42.265877 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef3852-c62c-44fc-8c85-599219d0286f service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:42.266362 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef3852-c62c-44fc-8c85-599219d0286f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:42.286461 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef3852-c62c-44fc-8c85-599219d0286f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:42.289280 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef3852-c62c-44fc-8c85-599219d0286f service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:42.289819 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c7703-e6e6-4c3b-966b-6e416f7df21c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:42.291317 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c7703-e6e6-4c3b-966b-6e416f7df21c service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:42.314050 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 820/1637] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:54:41 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:54:42.334954 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 818/1638] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:54:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:54:42.588105 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c7703-e6e6-4c3b-966b-6e416f7df21c service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:42.607658 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c376c89-2009-4ae5-bc1c-5aea52d969f4 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:42.608603 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c376c89-2009-4ae5-bc1c-5aea52d969f4 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:42.609076 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c376c89-2009-4ae5-bc1c-5aea52d969f4 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:42.610017 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c7703-e6e6-4c3b-966b-6e416f7df21c service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:42.611692 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 819/1639] 10.222.0.52 () {54 vars in 962 bytes} [Sun Aug 28 00:54:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:54:42.620212 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c2cab-ae54-4bdb-b24f-e9323f4a8a9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:42.620896 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c2cab-ae54-4bdb-b24f-e9323f4a8a9a service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:42.621489 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c2cab-ae54-4bdb-b24f-e9323f4a8a9a service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:42.621489 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c2cab-ae54-4bdb-b24f-e9323f4a8a9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:42.629090 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b34f07-67c3-447c-9888-2512faed4d5d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:42.630115 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b34f07-67c3-447c-9888-2512faed4d5d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:42.630616 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b34f07-67c3-447c-9888-2512faed4d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:42.684713 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-40b34f07-67c3-447c-9888-2512faed4d5d None None] MFA Rules not processed for user `f890ff4e7807477db7f17c2f6434dce8`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:42.686441 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-40b34f07-67c3-447c-9888-2512faed4d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:42.771188 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c2cab-ae54-4bdb-b24f-e9323f4a8a9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:42.773751 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c2cab-ae54-4bdb-b24f-e9323f4a8a9a service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:42.809160 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 821/1640] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:54:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:54:42.847014 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 820/1641] 10.222.0.52 () {58 vars in 1059 bytes} [Sun Aug 28 00:54:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:42.852937 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237dc4c3-eda5-447b-8796-0e15ec555a40 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:42.853319 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237dc4c3-eda5-447b-8796-0e15ec555a40 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:42.853683 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237dc4c3-eda5-447b-8796-0e15ec555a40 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:42.856969 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 822/1642] 10.222.0.52 () {54 vars in 912 bytes} [Sun Aug 28 00:54:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:54:42.862170 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2022707-4540-4caf-9b5a-f57681dd114e None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:42.862473 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2022707-4540-4caf-9b5a-f57681dd114e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:42.862738 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2022707-4540-4caf-9b5a-f57681dd114e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:42.895240 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-d2022707-4540-4caf-9b5a-f57681dd114e None None] MFA Rules not processed for user `f890ff4e7807477db7f17c2f6434dce8`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:42.899773 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d2022707-4540-4caf-9b5a-f57681dd114e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:42.930991 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 821/1643] 10.222.0.52 () {58 vars in 1009 bytes} [Sun Aug 28 00:54:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:42.956105 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237dc4c3-eda5-447b-8796-0e15ec555a40 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:42.973703 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237dc4c3-eda5-447b-8796-0e15ec555a40 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:43.003049 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c1098b-4f37-40f9-b73b-784a007598fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:43.004884 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1098b-4f37-40f9-b73b-784a007598fd service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:43.006111 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1098b-4f37-40f9-b73b-784a007598fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:43.006679 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1098b-4f37-40f9-b73b-784a007598fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:43.039877 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c1098b-4f37-40f9-b73b-784a007598fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:43.044098 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c1098b-4f37-40f9-b73b-784a007598fd service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:43.067706 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 823/1644] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:54:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:54:43.671599 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2022707-4540-4caf-9b5a-f57681dd114e None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:43.677969 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:43.827582 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2022707-4540-4caf-9b5a-f57681dd114e None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:43.833257 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad10bd-c795-4679-a6e2-d97671b299e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:43.835416 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad10bd-c795-4679-a6e2-d97671b299e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:43.835929 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad10bd-c795-4679-a6e2-d97671b299e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:43.836356 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad10bd-c795-4679-a6e2-d97671b299e4 admin admin] PATH_INFO: `/v3/users/c6b390fd5a014ca5976ed77d1f77efaf` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:43.838084 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad10bd-c795-4679-a6e2-d97671b299e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6b390fd5a014ca5976ed77d1f77efaf)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:43.839458 dv-cinder-master-3-smb devstack@keystone.service[81517]: WARNING py.warnings [None req-c2ad10bd-c795-4679-a6e2-d97671b299e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 00:54:43.839458 dv-cinder-master-3-smb devstack@keystone.service[81517]: warnings.warn(msg) Aug 28 00:54:43.839458 dv-cinder-master-3-smb devstack@keystone.service[81517]: Aug 28 00:54:43.841084 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad10bd-c795-4679-a6e2-d97671b299e4 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:44.001407 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c2ad10bd-c795-4679-a6e2-d97671b299e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6b390fd5a014ca5976ed77d1f77efaf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:44.027561 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c2ad10bd-c795-4679-a6e2-d97671b299e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6b390fd5a014ca5976ed77d1f77efaf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:44.039296 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c2ad10bd-c795-4679-a6e2-d97671b299e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6b390fd5a014ca5976ed77d1f77efaf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:44.053436 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c2ad10bd-c795-4679-a6e2-d97671b299e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6b390fd5a014ca5976ed77d1f77efaf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:44.054473 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c2ad10bd-c795-4679-a6e2-d97671b299e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6b390fd5a014ca5976ed77d1f77efaf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:44.072458 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b87f2-ee10-417c-9a92-3d31da267d28 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:44.073086 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 822/1645] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:54:43 2022] DELETE /identity/v3/users/c6b390fd5a014ca5976ed77d1f77efaf => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:54:44.073938 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b87f2-ee10-417c-9a92-3d31da267d28 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:44.074218 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b87f2-ee10-417c-9a92-3d31da267d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:44.111789 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-473b87f2-ee10-417c-9a92-3d31da267d28 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:44.113021 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-473b87f2-ee10-417c-9a92-3d31da267d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:44.241025 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:44.284297 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 824/1646] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:44.321557 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad10bd-c795-4679-a6e2-d97671b299e4 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:44.326299 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c2ad10bd-c795-4679-a6e2-d97671b299e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:44.452388 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad10bd-c795-4679-a6e2-d97671b299e4 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:44.457404 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775fd438-47fb-4ca8-839f-36516bc40c6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:44.458308 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fd438-47fb-4ca8-839f-36516bc40c6d service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:44.458962 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fd438-47fb-4ca8-839f-36516bc40c6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:44.459524 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fd438-47fb-4ca8-839f-36516bc40c6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:44.470556 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775fd438-47fb-4ca8-839f-36516bc40c6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:44.472478 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775fd438-47fb-4ca8-839f-36516bc40c6d service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:44.485888 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 823/1647] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:54:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:54:45.938939 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b87f2-ee10-417c-9a92-3d31da267d28 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:45.941112 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-473b87f2-ee10-417c-9a92-3d31da267d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:45.954282 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b87f2-ee10-417c-9a92-3d31da267d28 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:45.960014 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09349e-cbb5-4e10-8dab-38847f2ed856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:45.960935 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09349e-cbb5-4e10-8dab-38847f2ed856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:45.961446 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09349e-cbb5-4e10-8dab-38847f2ed856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:45.961974 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09349e-cbb5-4e10-8dab-38847f2ed856 admin admin] PATH_INFO: `/v3/projects/f5d7e36eee0b4b9db4b0ecf704f3f326` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:45.964456 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09349e-cbb5-4e10-8dab-38847f2ed856 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5d7e36eee0b4b9db4b0ecf704f3f326)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:45.965814 dv-cinder-master-3-smb devstack@keystone.service[81518]: WARNING py.warnings [None req-da09349e-cbb5-4e10-8dab-38847f2ed856 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 00:54:45.965814 dv-cinder-master-3-smb devstack@keystone.service[81518]: warnings.warn(msg) Aug 28 00:54:45.965814 dv-cinder-master-3-smb devstack@keystone.service[81518]: Aug 28 00:54:45.967411 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09349e-cbb5-4e10-8dab-38847f2ed856 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:46.103866 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-da09349e-cbb5-4e10-8dab-38847f2ed856 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5d7e36eee0b4b9db4b0ecf704f3f326', 'request_id': 'req-da09349e-cbb5-4e10-8dab-38847f2ed856'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:46.119096 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-da09349e-cbb5-4e10-8dab-38847f2ed856 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5d7e36eee0b4b9db4b0ecf704f3f326', 'request_id': 'req-da09349e-cbb5-4e10-8dab-38847f2ed856'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:46.154343 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-da09349e-cbb5-4e10-8dab-38847f2ed856 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5d7e36eee0b4b9db4b0ecf704f3f326', 'request_id': 'req-da09349e-cbb5-4e10-8dab-38847f2ed856'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:46.179612 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-da09349e-cbb5-4e10-8dab-38847f2ed856 admin admin] The token cache is being invalidate because project f5d7e36eee0b4b9db4b0ecf704f3f326 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:54:46.180164 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-da09349e-cbb5-4e10-8dab-38847f2ed856 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:46.181054 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-da09349e-cbb5-4e10-8dab-38847f2ed856 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:46.187125 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775fd438-47fb-4ca8-839f-36516bc40c6d service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:46.193421 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 825/1648] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:54:45 2022] DELETE /identity/v3/projects/f5d7e36eee0b4b9db4b0ecf704f3f326 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:54:46.201874 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775fd438-47fb-4ca8-839f-36516bc40c6d service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:46.250037 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:46.319665 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f1467-2d15-4017-ab2b-0eba61b53d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:46.320751 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f1467-2d15-4017-ab2b-0eba61b53d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:46.325023 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f1467-2d15-4017-ab2b-0eba61b53d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:46.325829 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f1467-2d15-4017-ab2b-0eba61b53d58 admin admin] PATH_INFO: `/v3/users/09dc18ee0701477584eb788ac5bc591c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:46.328946 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f1467-2d15-4017-ab2b-0eba61b53d58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09dc18ee0701477584eb788ac5bc591c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:46.332343 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f1467-2d15-4017-ab2b-0eba61b53d58 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:46.461623 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-564f1467-2d15-4017-ab2b-0eba61b53d58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09dc18ee0701477584eb788ac5bc591c'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:46.502694 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-564f1467-2d15-4017-ab2b-0eba61b53d58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09dc18ee0701477584eb788ac5bc591c'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:46.511856 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-564f1467-2d15-4017-ab2b-0eba61b53d58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09dc18ee0701477584eb788ac5bc591c'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:46.525734 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-564f1467-2d15-4017-ab2b-0eba61b53d58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09dc18ee0701477584eb788ac5bc591c'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:46.526624 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-564f1467-2d15-4017-ab2b-0eba61b53d58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09dc18ee0701477584eb788ac5bc591c'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:46.551786 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 824/1649] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:54:46 2022] DELETE /identity/v3/users/09dc18ee0701477584eb788ac5bc591c => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:54:47.021490 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09349e-cbb5-4e10-8dab-38847f2ed856 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:47.023288 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-da09349e-cbb5-4e10-8dab-38847f2ed856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:47.059004 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09349e-cbb5-4e10-8dab-38847f2ed856 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:47.225692 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40def4-65d4-4aa1-b880-77939e87da12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:47.226779 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40def4-65d4-4aa1-b880-77939e87da12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:47.227346 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40def4-65d4-4aa1-b880-77939e87da12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:47.227777 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40def4-65d4-4aa1-b880-77939e87da12 admin admin] PATH_INFO: `/v3/users/422387594ff44fd185b8745d1286c931` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:47.229703 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40def4-65d4-4aa1-b880-77939e87da12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=422387594ff44fd185b8745d1286c931)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:47.244816 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40def4-65d4-4aa1-b880-77939e87da12 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:47.335015 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9f40def4-65d4-4aa1-b880-77939e87da12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '422387594ff44fd185b8745d1286c931'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:47.379409 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9f40def4-65d4-4aa1-b880-77939e87da12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '422387594ff44fd185b8745d1286c931'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:47.404101 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9f40def4-65d4-4aa1-b880-77939e87da12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '422387594ff44fd185b8745d1286c931'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:47.443230 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9f40def4-65d4-4aa1-b880-77939e87da12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '422387594ff44fd185b8745d1286c931'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:47.459954 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9f40def4-65d4-4aa1-b880-77939e87da12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '422387594ff44fd185b8745d1286c931'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:47.478686 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:47.519532 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa20eb4-18eb-4c45-aa21-0b0e561dbe8b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:47.520051 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa20eb4-18eb-4c45-aa21-0b0e561dbe8b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:47.520255 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa20eb4-18eb-4c45-aa21-0b0e561dbe8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:47.525997 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 826/1650] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:54:47 2022] DELETE /identity/v3/users/422387594ff44fd185b8745d1286c931 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:54:47.581446 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-baa20eb4-18eb-4c45-aa21-0b0e561dbe8b None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:47.582786 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-baa20eb4-18eb-4c45-aa21-0b0e561dbe8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:47.753112 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 825/1651] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:47.794600 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40def4-65d4-4aa1-b880-77939e87da12 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:47.801681 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9f40def4-65d4-4aa1-b880-77939e87da12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:47.961865 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40def4-65d4-4aa1-b880-77939e87da12 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:47.984374 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20477b-0966-4778-a69f-410eebf42bb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:47.986030 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20477b-0966-4778-a69f-410eebf42bb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:47.988541 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20477b-0966-4778-a69f-410eebf42bb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:47.988541 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20477b-0966-4778-a69f-410eebf42bb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:48.014683 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f20477b-0966-4778-a69f-410eebf42bb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:48.020985 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f20477b-0966-4778-a69f-410eebf42bb0 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:48.041734 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 827/1652] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:54:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:54:48.908774 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa20eb4-18eb-4c45-aa21-0b0e561dbe8b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:48.912784 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-baa20eb4-18eb-4c45-aa21-0b0e561dbe8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:48.946971 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa20eb4-18eb-4c45-aa21-0b0e561dbe8b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:48.965570 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976632fa-4b05-449d-ba73-a84da933d0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:48.966616 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976632fa-4b05-449d-ba73-a84da933d0bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:48.967562 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976632fa-4b05-449d-ba73-a84da933d0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:48.968214 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976632fa-4b05-449d-ba73-a84da933d0bb admin admin] PATH_INFO: `/v3/projects/5a7d86f164cf475388b8102e1d497d0e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:48.969788 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976632fa-4b05-449d-ba73-a84da933d0bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a7d86f164cf475388b8102e1d497d0e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:48.972005 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976632fa-4b05-449d-ba73-a84da933d0bb admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:49.068746 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:49.080554 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-976632fa-4b05-449d-ba73-a84da933d0bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a7d86f164cf475388b8102e1d497d0e', 'request_id': 'req-976632fa-4b05-449d-ba73-a84da933d0bb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:49.095893 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-976632fa-4b05-449d-ba73-a84da933d0bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a7d86f164cf475388b8102e1d497d0e', 'request_id': 'req-976632fa-4b05-449d-ba73-a84da933d0bb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:49.108984 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-976632fa-4b05-449d-ba73-a84da933d0bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a7d86f164cf475388b8102e1d497d0e', 'request_id': 'req-976632fa-4b05-449d-ba73-a84da933d0bb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:49.134132 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-976632fa-4b05-449d-ba73-a84da933d0bb admin admin] The token cache is being invalidate because project 5a7d86f164cf475388b8102e1d497d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:54:49.134350 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-976632fa-4b05-449d-ba73-a84da933d0bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:49.135334 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-976632fa-4b05-449d-ba73-a84da933d0bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:49.138495 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 826/1653] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:54:48 2022] DELETE /identity/v3/projects/5a7d86f164cf475388b8102e1d497d0e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:54:49.143315 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede50163-6e37-4bff-8f61-517adfd4ddbc None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:49.143812 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede50163-6e37-4bff-8f61-517adfd4ddbc None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:49.143884 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede50163-6e37-4bff-8f61-517adfd4ddbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:49.179432 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-ede50163-6e37-4bff-8f61-517adfd4ddbc None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:49.187653 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ede50163-6e37-4bff-8f61-517adfd4ddbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:49.365091 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 828/1654] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:49.375429 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4028426-4f8c-46c0-9458-0d3137b86ae1 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:49.375876 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4028426-4f8c-46c0-9458-0d3137b86ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:49.376287 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4028426-4f8c-46c0-9458-0d3137b86ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:49.426336 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a4028426-4f8c-46c0-9458-0d3137b86ae1 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:49.427577 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a4028426-4f8c-46c0-9458-0d3137b86ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:49.463243 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 827/1655] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:49.466710 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede50163-6e37-4bff-8f61-517adfd4ddbc None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:49.477453 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede50163-6e37-4bff-8f61-517adfd4ddbc None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:49.491604 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d38e47-aa55-4a64-89f6-bec14835ab78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:49.492578 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d38e47-aa55-4a64-89f6-bec14835ab78 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:49.492995 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d38e47-aa55-4a64-89f6-bec14835ab78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:49.493403 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d38e47-aa55-4a64-89f6-bec14835ab78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:49.494274 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d38e47-aa55-4a64-89f6-bec14835ab78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:54:49.494865 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d38e47-aa55-4a64-89f6-bec14835ab78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:49.498256 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d38e47-aa55-4a64-89f6-bec14835ab78 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:49.565705 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 829/1656] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:54:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:54:49.567216 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4028426-4f8c-46c0-9458-0d3137b86ae1 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:49.584248 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4028426-4f8c-46c0-9458-0d3137b86ae1 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:49.605986 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf01ec-152c-46e9-abbe-6eda9e5f40e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:49.609046 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf01ec-152c-46e9-abbe-6eda9e5f40e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:49.609971 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf01ec-152c-46e9-abbe-6eda9e5f40e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:49.610502 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf01ec-152c-46e9-abbe-6eda9e5f40e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:49.611876 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccf01ec-152c-46e9-abbe-6eda9e5f40e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:49.624874 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccf01ec-152c-46e9-abbe-6eda9e5f40e5 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:49.705126 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 828/1657] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:54:49 2022] POST /identity/v3/projects => generated 367 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:54:49.715497 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d38e47-aa55-4a64-89f6-bec14835ab78 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:49.735204 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d38e47-aa55-4a64-89f6-bec14835ab78 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:49.876130 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e70194-fec0-4026-9fc7-0b7c3f2c288d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:49.876771 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e70194-fec0-4026-9fc7-0b7c3f2c288d admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:49.877051 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e70194-fec0-4026-9fc7-0b7c3f2c288d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:49.877325 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e70194-fec0-4026-9fc7-0b7c3f2c288d admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:49.878085 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e70194-fec0-4026-9fc7-0b7c3f2c288d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:49.881336 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e70194-fec0-4026-9fc7-0b7c3f2c288d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:49.939930 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 830/1658] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:54:49 2022] POST /identity/v3/users => generated 284 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:54:49.944476 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf01ec-152c-46e9-abbe-6eda9e5f40e5 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:49.965694 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf01ec-152c-46e9-abbe-6eda9e5f40e5 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:49.979537 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db42433-1c22-4678-954b-4b03e2de9c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:49.980476 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db42433-1c22-4678-954b-4b03e2de9c05 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:49.980914 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db42433-1c22-4678-954b-4b03e2de9c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:49.982160 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db42433-1c22-4678-954b-4b03e2de9c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:49.982994 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db42433-1c22-4678-954b-4b03e2de9c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:49.986848 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db42433-1c22-4678-954b-4b03e2de9c05 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:50.019249 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 829/1659] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:54:50.021550 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e70194-fec0-4026-9fc7-0b7c3f2c288d admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:50.039442 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e70194-fec0-4026-9fc7-0b7c3f2c288d admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:50.046211 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5a2f1-74d9-4c2c-bd15-7d724419a49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:50.047999 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5a2f1-74d9-4c2c-bd15-7d724419a49c admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:50.052872 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5a2f1-74d9-4c2c-bd15-7d724419a49c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:50.053606 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5a2f1-74d9-4c2c-bd15-7d724419a49c admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:50.055196 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5a2f1-74d9-4c2c-bd15-7d724419a49c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:50.058430 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5a2f1-74d9-4c2c-bd15-7d724419a49c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:50.082895 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 831/1660] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:54:50.088732 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db42433-1c22-4678-954b-4b03e2de9c05 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:50.110984 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db42433-1c22-4678-954b-4b03e2de9c05 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:50.124043 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd18db-a1ce-47ee-ac88-e17695024b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:50.124825 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd18db-a1ce-47ee-ac88-e17695024b5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:50.125463 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd18db-a1ce-47ee-ac88-e17695024b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:50.126131 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd18db-a1ce-47ee-ac88-e17695024b5a admin admin] PATH_INFO: `/v3/projects/2391e569a11f4afeb9dc62059af36726/users/b0f3814b38c041638f080fbeb929c643/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:50.158232 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd18db-a1ce-47ee-ac88-e17695024b5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2391e569a11f4afeb9dc62059af36726, user_id=b0f3814b38c041638f080fbeb929c643, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:50.165180 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd18db-a1ce-47ee-ac88-e17695024b5a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:50.214650 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 830/1661] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:54:50 2022] PUT /identity/v3/projects/2391e569a11f4afeb9dc62059af36726/users/b0f3814b38c041638f080fbeb929c643/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:54:50.217336 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3ff22-8458-4624-b938-75cfe34c9c4c None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:50.217861 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3ff22-8458-4624-b938-75cfe34c9c4c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:50.217967 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3ff22-8458-4624-b938-75cfe34c9c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:50.242413 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:50.282384 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-35f3ff22-8458-4624-b938-75cfe34c9c4c None None] MFA Rules not processed for user `b0f3814b38c041638f080fbeb929c643`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:50.283646 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-35f3ff22-8458-4624-b938-75cfe34c9c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:50.407228 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 832/1662] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:50.409402 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd18db-a1ce-47ee-ac88-e17695024b5a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:50.618665 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd18db-a1ce-47ee-ac88-e17695024b5a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:50.628200 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89eee3d-2af0-415b-845f-5cd9cc6e91bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:50.628841 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89eee3d-2af0-415b-845f-5cd9cc6e91bd admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:50.629113 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89eee3d-2af0-415b-845f-5cd9cc6e91bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:50.629373 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89eee3d-2af0-415b-845f-5cd9cc6e91bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:50.630038 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89eee3d-2af0-415b-845f-5cd9cc6e91bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:50.632923 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89eee3d-2af0-415b-845f-5cd9cc6e91bd admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:50.725630 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 831/1663] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:54:50 2022] POST /identity/v3/projects => generated 367 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:54:50.726825 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3ff22-8458-4624-b938-75cfe34c9c4c None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:50.767587 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3ff22-8458-4624-b938-75cfe34c9c4c None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:50.996854 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046f87a-0b59-40a0-a2c7-04a2be23b773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:50.997559 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046f87a-0b59-40a0-a2c7-04a2be23b773 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:51.000937 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046f87a-0b59-40a0-a2c7-04a2be23b773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:51.002221 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046f87a-0b59-40a0-a2c7-04a2be23b773 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:51.004117 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046f87a-0b59-40a0-a2c7-04a2be23b773 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:51.018467 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046f87a-0b59-40a0-a2c7-04a2be23b773 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:51.093298 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 833/1664] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:54:50 2022] POST /identity/v3/users => generated 290 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:54:51.094731 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89eee3d-2af0-415b-845f-5cd9cc6e91bd admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:51.122710 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89eee3d-2af0-415b-845f-5cd9cc6e91bd admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:51.142580 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270505be-1612-4106-be2a-0fd6f5ef8875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:51.143829 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270505be-1612-4106-be2a-0fd6f5ef8875 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:51.144265 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270505be-1612-4106-be2a-0fd6f5ef8875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:51.144670 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270505be-1612-4106-be2a-0fd6f5ef8875 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:51.146348 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270505be-1612-4106-be2a-0fd6f5ef8875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:51.149169 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270505be-1612-4106-be2a-0fd6f5ef8875 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:51.173076 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 832/1665] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:54:51.177093 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046f87a-0b59-40a0-a2c7-04a2be23b773 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:51.196824 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046f87a-0b59-40a0-a2c7-04a2be23b773 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:51.211344 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f2146-4e90-4897-824a-45abe00fb931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:51.212054 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f2146-4e90-4897-824a-45abe00fb931 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:51.212450 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f2146-4e90-4897-824a-45abe00fb931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:51.212738 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f2146-4e90-4897-824a-45abe00fb931 admin admin] PATH_INFO: `/v3/projects/7db748abad384d5b9e818174d70b199c/users/50e3d500a6aa4a7893b951175ceccc0d/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:51.247558 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f2146-4e90-4897-824a-45abe00fb931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7db748abad384d5b9e818174d70b199c, user_id=50e3d500a6aa4a7893b951175ceccc0d, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:51.253290 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f2146-4e90-4897-824a-45abe00fb931 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:51.302347 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 834/1666] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:54:51 2022] PUT /identity/v3/projects/7db748abad384d5b9e818174d70b199c/users/50e3d500a6aa4a7893b951175ceccc0d/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:54:51.309179 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270505be-1612-4106-be2a-0fd6f5ef8875 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:51.332087 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270505be-1612-4106-be2a-0fd6f5ef8875 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:51.432820 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:51.478595 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c44568-56e0-415f-8199-bd223c0558dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:51.479274 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c44568-56e0-415f-8199-bd223c0558dd admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:51.479994 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c44568-56e0-415f-8199-bd223c0558dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:51.480293 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c44568-56e0-415f-8199-bd223c0558dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:51.482190 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c44568-56e0-415f-8199-bd223c0558dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:51.483881 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c44568-56e0-415f-8199-bd223c0558dd admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:51.515353 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 833/1667] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:54:51.519392 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f2146-4e90-4897-824a-45abe00fb931 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:51.537482 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f2146-4e90-4897-824a-45abe00fb931 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:51.551241 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28614a-93f2-44c0-9a65-f9b7b27cbaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:51.552583 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28614a-93f2-44c0-9a65-f9b7b27cbaaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:51.552878 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28614a-93f2-44c0-9a65-f9b7b27cbaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:51.553168 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28614a-93f2-44c0-9a65-f9b7b27cbaaf admin admin] PATH_INFO: `/v3/projects/7db748abad384d5b9e818174d70b199c/users/50e3d500a6aa4a7893b951175ceccc0d/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:51.563443 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d28614a-93f2-44c0-9a65-f9b7b27cbaaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7db748abad384d5b9e818174d70b199c, user_id=50e3d500a6aa4a7893b951175ceccc0d, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:51.566176 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d28614a-93f2-44c0-9a65-f9b7b27cbaaf admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:51.588613 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c44568-56e0-415f-8199-bd223c0558dd admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:51.594365 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a6c44568-56e0-415f-8199-bd223c0558dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:51.629104 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c44568-56e0-415f-8199-bd223c0558dd admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:51.629297 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 835/1668] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:54:51 2022] PUT /identity/v3/projects/7db748abad384d5b9e818174d70b199c/users/50e3d500a6aa4a7893b951175ceccc0d/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:54:51.631179 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed654ad8-61d0-4d54-a7b5-d6e21ef462bb None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:51.631463 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed654ad8-61d0-4d54-a7b5-d6e21ef462bb None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:51.631729 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed654ad8-61d0-4d54-a7b5-d6e21ef462bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:51.705792 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-ed654ad8-61d0-4d54-a7b5-d6e21ef462bb None None] MFA Rules not processed for user `50e3d500a6aa4a7893b951175ceccc0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:51.710266 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ed654ad8-61d0-4d54-a7b5-d6e21ef462bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:51.768534 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d87a6d-96c1-4bd8-b712-4f261d9d5e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:51.769691 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d87a6d-96c1-4bd8-b712-4f261d9d5e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:51.770318 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d87a6d-96c1-4bd8-b712-4f261d9d5e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:51.770848 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d87a6d-96c1-4bd8-b712-4f261d9d5e5d admin admin] PATH_INFO: `/v3/projects/d71aa005fbfa48e6bf642a89b707d801` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:51.772297 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d87a6d-96c1-4bd8-b712-4f261d9d5e5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d71aa005fbfa48e6bf642a89b707d801)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:51.774486 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d87a6d-96c1-4bd8-b712-4f261d9d5e5d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:51.811728 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:51.890899 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d5d87a6d-96c1-4bd8-b712-4f261d9d5e5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd71aa005fbfa48e6bf642a89b707d801', 'request_id': 'req-d5d87a6d-96c1-4bd8-b712-4f261d9d5e5d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:51.903516 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 836/1669] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:51 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:51.907906 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d5d87a6d-96c1-4bd8-b712-4f261d9d5e5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd71aa005fbfa48e6bf642a89b707d801', 'request_id': 'req-d5d87a6d-96c1-4bd8-b712-4f261d9d5e5d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:51.918129 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d5d87a6d-96c1-4bd8-b712-4f261d9d5e5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd71aa005fbfa48e6bf642a89b707d801', 'request_id': 'req-d5d87a6d-96c1-4bd8-b712-4f261d9d5e5d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:51.920049 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed654ad8-61d0-4d54-a7b5-d6e21ef462bb None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:51.929814 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ed654ad8-61d0-4d54-a7b5-d6e21ef462bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:51.944473 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d5d87a6d-96c1-4bd8-b712-4f261d9d5e5d admin admin] The token cache is being invalidate because project d71aa005fbfa48e6bf642a89b707d801 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:54:51.944691 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d5d87a6d-96c1-4bd8-b712-4f261d9d5e5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:51.945410 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d5d87a6d-96c1-4bd8-b712-4f261d9d5e5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:51.947473 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 834/1670] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:54:51 2022] DELETE /identity/v3/projects/d71aa005fbfa48e6bf642a89b707d801 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:54:51.962964 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa91494-c1f6-4930-9ac0-db5f988ffb32 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:51.964540 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa91494-c1f6-4930-9ac0-db5f988ffb32 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:51.966309 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa91494-c1f6-4930-9ac0-db5f988ffb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:52.021449 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-cfa91494-c1f6-4930-9ac0-db5f988ffb32 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:52.027116 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-cfa91494-c1f6-4930-9ac0-db5f988ffb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:52.117003 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed654ad8-61d0-4d54-a7b5-d6e21ef462bb None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:52.258648 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 835/1671] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:52.261760 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb183ac-31c3-45e2-a61f-f3c1b0fe0c23 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:52.261760 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb183ac-31c3-45e2-a61f-f3c1b0fe0c23 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:52.262186 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb183ac-31c3-45e2-a61f-f3c1b0fe0c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:52.298361 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46eefc9-5b11-4874-b250-bf1377b26a4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:52.299189 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46eefc9-5b11-4874-b250-bf1377b26a4e service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:52.299523 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46eefc9-5b11-4874-b250-bf1377b26a4e service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:52.299900 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46eefc9-5b11-4874-b250-bf1377b26a4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:52.302478 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c46eefc9-5b11-4874-b250-bf1377b26a4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:52.312124 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:52.335362 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-7eb183ac-31c3-45e2-a61f-f3c1b0fe0c23 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:52.339484 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7eb183ac-31c3-45e2-a61f-f3c1b0fe0c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:52.359880 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 836/1672] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:52.365570 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb183ac-31c3-45e2-a61f-f3c1b0fe0c23 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:52.402416 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb183ac-31c3-45e2-a61f-f3c1b0fe0c23 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:52.409217 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ba390-81fa-4bbb-b75f-e97256055b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:52.412385 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ba390-81fa-4bbb-b75f-e97256055b54 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:52.413108 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ba390-81fa-4bbb-b75f-e97256055b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:52.413776 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ba390-81fa-4bbb-b75f-e97256055b54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:52.414964 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ba390-81fa-4bbb-b75f-e97256055b54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:54:52.414964 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ba390-81fa-4bbb-b75f-e97256055b54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:52.416857 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ba390-81fa-4bbb-b75f-e97256055b54 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:52.438640 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 837/1673] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:54:52.441690 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ba390-81fa-4bbb-b75f-e97256055b54 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:52.443217 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46eefc9-5b11-4874-b250-bf1377b26a4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:52.452748 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46eefc9-5b11-4874-b250-bf1377b26a4e service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:52.487075 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 837/1674] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:54:51 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:54:52.487604 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ba390-81fa-4bbb-b75f-e97256055b54 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:52.511873 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aabf9a-2572-4603-a06c-50d850739777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:52.512607 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aabf9a-2572-4603-a06c-50d850739777 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:52.513093 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aabf9a-2572-4603-a06c-50d850739777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:52.513429 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aabf9a-2572-4603-a06c-50d850739777 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:52.516799 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aabf9a-2572-4603-a06c-50d850739777 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:52.520148 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aabf9a-2572-4603-a06c-50d850739777 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:52.600855 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46eefc9-5b11-4874-b250-bf1377b26a4e service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:52.607421 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 838/1675] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:54:52 2022] POST /identity/v3/projects => generated 371 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:54:52.616098 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46eefc9-5b11-4874-b250-bf1377b26a4e service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:52.713248 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:52.802997 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19181b78-d66a-49e1-ae25-c864b1576351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:52.808145 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19181b78-d66a-49e1-ae25-c864b1576351 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:52.808427 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19181b78-d66a-49e1-ae25-c864b1576351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:52.811877 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19181b78-d66a-49e1-ae25-c864b1576351 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:52.815849 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19181b78-d66a-49e1-ae25-c864b1576351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:52.819053 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19181b78-d66a-49e1-ae25-c864b1576351 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:52.873466 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 838/1676] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:54:52 2022] POST /identity/v3/users => generated 286 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:54:52.880930 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aabf9a-2572-4603-a06c-50d850739777 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:52.892082 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aabf9a-2572-4603-a06c-50d850739777 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:52.907956 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96630cf1-a67c-4e2d-8a2e-3134961c84f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:52.909050 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96630cf1-a67c-4e2d-8a2e-3134961c84f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:52.910179 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96630cf1-a67c-4e2d-8a2e-3134961c84f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:52.910851 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96630cf1-a67c-4e2d-8a2e-3134961c84f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:52.912526 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96630cf1-a67c-4e2d-8a2e-3134961c84f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:52.915553 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96630cf1-a67c-4e2d-8a2e-3134961c84f2 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:52.945424 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 839/1677] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:54:52.949500 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19181b78-d66a-49e1-ae25-c864b1576351 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:52.970440 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19181b78-d66a-49e1-ae25-c864b1576351 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:52.978713 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4efa6b-f977-4450-8904-51556a80a86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:52.979252 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4efa6b-f977-4450-8904-51556a80a86c admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:52.979716 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4efa6b-f977-4450-8904-51556a80a86c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:52.980061 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4efa6b-f977-4450-8904-51556a80a86c admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:52.984511 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4efa6b-f977-4450-8904-51556a80a86c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:52.986555 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4efa6b-f977-4450-8904-51556a80a86c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:53.026016 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 839/1678] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:54:53.030203 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96630cf1-a67c-4e2d-8a2e-3134961c84f2 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:53.049173 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96630cf1-a67c-4e2d-8a2e-3134961c84f2 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:53.056311 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446129d9-9746-4ddd-9bc3-c10e3d303423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:53.057589 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446129d9-9746-4ddd-9bc3-c10e3d303423 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:53.058137 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446129d9-9746-4ddd-9bc3-c10e3d303423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:53.058645 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446129d9-9746-4ddd-9bc3-c10e3d303423 admin admin] PATH_INFO: `/v3/projects/d944fe1554364235b5fd2498f98c9140/users/6bf9ff1546b949e9bdca1e03a9e244cc/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:53.083505 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446129d9-9746-4ddd-9bc3-c10e3d303423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d944fe1554364235b5fd2498f98c9140, user_id=6bf9ff1546b949e9bdca1e03a9e244cc, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:53.086780 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446129d9-9746-4ddd-9bc3-c10e3d303423 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:53.146733 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 840/1679] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:54:53 2022] PUT /identity/v3/projects/d944fe1554364235b5fd2498f98c9140/users/6bf9ff1546b949e9bdca1e03a9e244cc/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:54:53.164552 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626ff08-5aee-4b8b-99b4-031d59a13f09 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:53.164931 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626ff08-5aee-4b8b-99b4-031d59a13f09 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:53.165277 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626ff08-5aee-4b8b-99b4-031d59a13f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:53.258562 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-6626ff08-5aee-4b8b-99b4-031d59a13f09 None None] MFA Rules not processed for user `6bf9ff1546b949e9bdca1e03a9e244cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:53.258562 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6626ff08-5aee-4b8b-99b4-031d59a13f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:53.464710 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 840/1680] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:53.476508 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446129d9-9746-4ddd-9bc3-c10e3d303423 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:53.479367 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-446129d9-9746-4ddd-9bc3-c10e3d303423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:53.739414 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446129d9-9746-4ddd-9bc3-c10e3d303423 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:53.755272 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effb21f-6a4b-49d1-8a3b-2465a3455de3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:53.755904 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effb21f-6a4b-49d1-8a3b-2465a3455de3 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:53.756178 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effb21f-6a4b-49d1-8a3b-2465a3455de3 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:53.756450 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effb21f-6a4b-49d1-8a3b-2465a3455de3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:53.775112 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8effb21f-6a4b-49d1-8a3b-2465a3455de3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:53.777034 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8effb21f-6a4b-49d1-8a3b-2465a3455de3 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:53.803671 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 841/1681] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:54:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:54:55.003178 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d62f1-c45b-4ead-a4e4-8ff7cccb5334 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:55.004050 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d62f1-c45b-4ead-a4e4-8ff7cccb5334 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:55.004475 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d62f1-c45b-4ead-a4e4-8ff7cccb5334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:55.066333 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-8a9d62f1-c45b-4ead-a4e4-8ff7cccb5334 None None] MFA Rules not processed for user `c9ef21c1f5b949df8230d1587c4a1fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:55.067590 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8a9d62f1-c45b-4ead-a4e4-8ff7cccb5334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:55.244964 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 841/1682] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:55.257065 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b13845-8e5c-4b71-9fbb-ad719a7dacb4 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:55.258627 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b13845-8e5c-4b71-9fbb-ad719a7dacb4 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:55.259066 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b13845-8e5c-4b71-9fbb-ad719a7dacb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:55.320794 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b0b13845-8e5c-4b71-9fbb-ad719a7dacb4 None None] MFA Rules not processed for user `c9ef21c1f5b949df8230d1587c4a1fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:55.322444 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b0b13845-8e5c-4b71-9fbb-ad719a7dacb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:55.353593 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 842/1683] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:55.361856 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d62f1-c45b-4ead-a4e4-8ff7cccb5334 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:55.402859 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d62f1-c45b-4ead-a4e4-8ff7cccb5334 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:55.444509 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79567a4c-982c-4307-a5a3-ced53a9f64c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:55.445160 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79567a4c-982c-4307-a5a3-ced53a9f64c8 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:55.445444 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79567a4c-982c-4307-a5a3-ced53a9f64c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:55.445718 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79567a4c-982c-4307-a5a3-ced53a9f64c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:55.478122 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79567a4c-982c-4307-a5a3-ced53a9f64c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:55.480155 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79567a4c-982c-4307-a5a3-ced53a9f64c8 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:55.552596 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 842/1684] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:54:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:54:56.524016 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6fc57-4f75-4b6f-b626-3d69183485a0 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:56.525344 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6fc57-4f75-4b6f-b626-3d69183485a0 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:56.525776 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6fc57-4f75-4b6f-b626-3d69183485a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:56.528319 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79567a4c-982c-4307-a5a3-ced53a9f64c8 service nova] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:56.545361 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-79567a4c-982c-4307-a5a3-ced53a9f64c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:56.675144 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-79a6fc57-4f75-4b6f-b626-3d69183485a0 None None] MFA Rules not processed for user `5f227aa72915442384469ddc844198dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:56.683283 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-79a6fc57-4f75-4b6f-b626-3d69183485a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:56.710828 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:56.783076 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79567a4c-982c-4307-a5a3-ced53a9f64c8 service nova] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:56.806411 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc192fda-6d3e-45f9-8025-b82dd677fd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:56.807370 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc192fda-6d3e-45f9-8025-b82dd677fd94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:56.809806 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc192fda-6d3e-45f9-8025-b82dd677fd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:56.810424 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc192fda-6d3e-45f9-8025-b82dd677fd94 admin admin] PATH_INFO: `/v3/users/b0f3814b38c041638f080fbeb929c643` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:56.827959 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc192fda-6d3e-45f9-8025-b82dd677fd94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0f3814b38c041638f080fbeb929c643)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:56.834666 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc192fda-6d3e-45f9-8025-b82dd677fd94 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:56.901539 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:56.913067 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 843/1685] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:56.914794 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8d9cf-637d-4881-8150-f2de0c3dde51 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:56.915296 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8d9cf-637d-4881-8150-f2de0c3dde51 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:56.915988 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8d9cf-637d-4881-8150-f2de0c3dde51 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:56.917576 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 844/1686] 10.222.0.52 () {54 vars in 912 bytes} [Sun Aug 28 00:54:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:54:56.932118 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba3699-f552-48e9-859c-d2576afeff3e None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:56.932896 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba3699-f552-48e9-859c-d2576afeff3e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:56.933382 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba3699-f552-48e9-859c-d2576afeff3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:56.953813 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-dc192fda-6d3e-45f9-8025-b82dd677fd94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0f3814b38c041638f080fbeb929c643'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:56.975860 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-dc192fda-6d3e-45f9-8025-b82dd677fd94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0f3814b38c041638f080fbeb929c643'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:56.991916 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-dc192fda-6d3e-45f9-8025-b82dd677fd94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0f3814b38c041638f080fbeb929c643'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:57.021598 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-ebba3699-f552-48e9-859c-d2576afeff3e None None] MFA Rules not processed for user `0ca94d8693c64e388bd0d15db07f5fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:57.021765 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-dc192fda-6d3e-45f9-8025-b82dd677fd94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0f3814b38c041638f080fbeb929c643'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:57.023039 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-dc192fda-6d3e-45f9-8025-b82dd677fd94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0f3814b38c041638f080fbeb929c643'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:57.024541 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ebba3699-f552-48e9-859c-d2576afeff3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:57.038265 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 843/1687] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:54:56 2022] DELETE /identity/v3/users/b0f3814b38c041638f080fbeb929c643 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:54:57.039847 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc192fda-6d3e-45f9-8025-b82dd677fd94 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:57.045745 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-dc192fda-6d3e-45f9-8025-b82dd677fd94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:57.200821 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 845/1688] 10.222.0.52 () {58 vars in 1009 bytes} [Sun Aug 28 00:54:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:57.208217 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef20ae2-c1ed-44c0-a5bd-1a9ae52769db None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:57.208652 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef20ae2-c1ed-44c0-a5bd-1a9ae52769db None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:57.210485 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef20ae2-c1ed-44c0-a5bd-1a9ae52769db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:57.231175 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc192fda-6d3e-45f9-8025-b82dd677fd94 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:57.242687 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f17245-0fd2-401a-930d-a7744512c8b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:57.243326 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f17245-0fd2-401a-930d-a7744512c8b7 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:57.243604 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f17245-0fd2-401a-930d-a7744512c8b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:57.243877 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f17245-0fd2-401a-930d-a7744512c8b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:57.250803 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-65f17245-0fd2-401a-930d-a7744512c8b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:57.263903 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-0ef20ae2-c1ed-44c0-a5bd-1a9ae52769db None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:57.267264 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0ef20ae2-c1ed-44c0-a5bd-1a9ae52769db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:57.374599 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:57.402647 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 846/1689] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:57.409835 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef20ae2-c1ed-44c0-a5bd-1a9ae52769db None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:57.414462 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0ef20ae2-c1ed-44c0-a5bd-1a9ae52769db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:57.423562 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f17245-0fd2-401a-930d-a7744512c8b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:57.431210 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f17245-0fd2-401a-930d-a7744512c8b7 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:57.476820 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 844/1690] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:54:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:54:57.479503 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f17245-0fd2-401a-930d-a7744512c8b7 service nova] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:57.484116 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-65f17245-0fd2-401a-930d-a7744512c8b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:57.573537 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef20ae2-c1ed-44c0-a5bd-1a9ae52769db None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:57.579426 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee067695-cbb2-47f9-8133-a863dfccb8e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:57.580310 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee067695-cbb2-47f9-8133-a863dfccb8e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:57.580740 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee067695-cbb2-47f9-8133-a863dfccb8e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:57.581306 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee067695-cbb2-47f9-8133-a863dfccb8e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:57.596796 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee067695-cbb2-47f9-8133-a863dfccb8e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:57.598726 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee067695-cbb2-47f9-8133-a863dfccb8e4 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:57.609375 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 847/1691] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:54:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:54:57.719888 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f17245-0fd2-401a-930d-a7744512c8b7 service nova] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:57.733931 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386e417-dfa7-4491-a688-8ccca176f812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:57.734767 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386e417-dfa7-4491-a688-8ccca176f812 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:57.735232 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386e417-dfa7-4491-a688-8ccca176f812 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:57.735558 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386e417-dfa7-4491-a688-8ccca176f812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:57.762722 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386e417-dfa7-4491-a688-8ccca176f812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:57.764469 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386e417-dfa7-4491-a688-8ccca176f812 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:57.796485 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 845/1692] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:54:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:54:57.821339 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee067695-cbb2-47f9-8133-a863dfccb8e4 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:57.829227 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ee067695-cbb2-47f9-8133-a863dfccb8e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:57.855100 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee067695-cbb2-47f9-8133-a863dfccb8e4 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:57.860794 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a8094-c68e-49e8-9332-107ec2a37771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:57.861760 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a8094-c68e-49e8-9332-107ec2a37771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:57.862203 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a8094-c68e-49e8-9332-107ec2a37771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:57.863349 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a8094-c68e-49e8-9332-107ec2a37771 admin admin] PATH_INFO: `/v3/users/6bf9ff1546b949e9bdca1e03a9e244cc` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:57.865226 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a8094-c68e-49e8-9332-107ec2a37771 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bf9ff1546b949e9bdca1e03a9e244cc)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:57.868481 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a8094-c68e-49e8-9332-107ec2a37771 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:57.936496 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:57.955988 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a71a8094-c68e-49e8-9332-107ec2a37771 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bf9ff1546b949e9bdca1e03a9e244cc'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:57.973818 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a71a8094-c68e-49e8-9332-107ec2a37771 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bf9ff1546b949e9bdca1e03a9e244cc'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:57.996619 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a71a8094-c68e-49e8-9332-107ec2a37771 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bf9ff1546b949e9bdca1e03a9e244cc'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:58.015211 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a71a8094-c68e-49e8-9332-107ec2a37771 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bf9ff1546b949e9bdca1e03a9e244cc'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:58.016560 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a71a8094-c68e-49e8-9332-107ec2a37771 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bf9ff1546b949e9bdca1e03a9e244cc'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:58.033750 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 848/1693] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:54:57 2022] DELETE /identity/v3/users/6bf9ff1546b949e9bdca1e03a9e244cc => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:54:58.038869 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11066f4b-17db-461d-9bef-b54b24444a99 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:58.040030 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11066f4b-17db-461d-9bef-b54b24444a99 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:58.040493 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11066f4b-17db-461d-9bef-b54b24444a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:58.094333 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-11066f4b-17db-461d-9bef-b54b24444a99 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:58.096153 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-11066f4b-17db-461d-9bef-b54b24444a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:58.212618 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 846/1694] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:58.385440 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a8094-c68e-49e8-9332-107ec2a37771 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:58.387468 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a71a8094-c68e-49e8-9332-107ec2a37771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:58.494230 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6084e-28ef-4cc4-bf68-8c254a599636 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:58.498194 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6084e-28ef-4cc4-bf68-8c254a599636 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:58.498529 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6084e-28ef-4cc4-bf68-8c254a599636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:58.564878 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-7fc6084e-28ef-4cc4-bf68-8c254a599636 None None] MFA Rules not processed for user `687249b94db247b4b608e416559d0556`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:58.566154 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-7fc6084e-28ef-4cc4-bf68-8c254a599636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:58.574127 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a8094-c68e-49e8-9332-107ec2a37771 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:58.586740 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd622b-eed2-424c-82f2-fb9200c4dd03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:58.588424 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd622b-eed2-424c-82f2-fb9200c4dd03 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:58.589018 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd622b-eed2-424c-82f2-fb9200c4dd03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:58.589992 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd622b-eed2-424c-82f2-fb9200c4dd03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:58.618714 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd622b-eed2-424c-82f2-fb9200c4dd03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:58.623652 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd622b-eed2-424c-82f2-fb9200c4dd03 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:58.657339 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 849/1695] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:54:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:54:58.827555 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 847/1696] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:54:58.838358 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef53e4-8a49-4133-b116-203f7a449794 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:58.838635 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef53e4-8a49-4133-b116-203f7a449794 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:58.839037 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef53e4-8a49-4133-b116-203f7a449794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:58.892730 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-ddef53e4-8a49-4133-b116-203f7a449794 None None] MFA Rules not processed for user `687249b94db247b4b608e416559d0556`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:58.893993 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ddef53e4-8a49-4133-b116-203f7a449794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:58.923318 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 850/1697] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:54:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:58.934311 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6084e-28ef-4cc4-bf68-8c254a599636 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:58.937925 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-7fc6084e-28ef-4cc4-bf68-8c254a599636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:58.961875 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:59.197532 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6084e-28ef-4cc4-bf68-8c254a599636 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:59.217642 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422e3ee-21b6-4490-91dc-1dfdb71dbe44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:59.218573 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422e3ee-21b6-4490-91dc-1dfdb71dbe44 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:59.218971 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422e3ee-21b6-4490-91dc-1dfdb71dbe44 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:59.221978 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422e3ee-21b6-4490-91dc-1dfdb71dbe44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:59.264406 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422e3ee-21b6-4490-91dc-1dfdb71dbe44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:59.273392 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422e3ee-21b6-4490-91dc-1dfdb71dbe44 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:59.286260 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 848/1698] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:54:58 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:54:59.329387 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef53e4-8a49-4133-b116-203f7a449794 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:59.331130 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ddef53e4-8a49-4133-b116-203f7a449794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:59.590711 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef53e4-8a49-4133-b116-203f7a449794 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:59.603994 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0503353-2d7a-40c3-8071-cb7d7667cc26 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae87149f6ab04a9997263598737ae27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:59.614121 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0503353-2d7a-40c3-8071-cb7d7667cc26 service placement] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:59.614520 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0503353-2d7a-40c3-8071-cb7d7667cc26 service placement] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:59.614801 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0503353-2d7a-40c3-8071-cb7d7667cc26 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:59.623136 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a0503353-2d7a-40c3-8071-cb7d7667cc26 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:59.658591 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0503353-2d7a-40c3-8071-cb7d7667cc26 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:59.660146 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0503353-2d7a-40c3-8071-cb7d7667cc26 service placement] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:59.685697 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 851/1699] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:54:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:00.067381 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422e3ee-21b6-4490-91dc-1dfdb71dbe44 service nova] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:00.070041 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6422e3ee-21b6-4490-91dc-1dfdb71dbe44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:00.128968 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422e3ee-21b6-4490-91dc-1dfdb71dbe44 service nova] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:00.135190 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8828d-1e1a-46bb-9336-07b1399ca521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:00.136046 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8828d-1e1a-46bb-9336-07b1399ca521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:00.136717 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8828d-1e1a-46bb-9336-07b1399ca521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:00.137216 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8828d-1e1a-46bb-9336-07b1399ca521 admin admin] PATH_INFO: `/v3/projects/d944fe1554364235b5fd2498f98c9140` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:00.139189 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8828d-1e1a-46bb-9336-07b1399ca521 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d944fe1554364235b5fd2498f98c9140)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:00.141607 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8828d-1e1a-46bb-9336-07b1399ca521 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:00.163144 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0503353-2d7a-40c3-8071-cb7d7667cc26 service placement] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:00.164930 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a0503353-2d7a-40c3-8071-cb7d7667cc26 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:00.219974 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0503353-2d7a-40c3-8071-cb7d7667cc26 service placement] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:00.245144 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9a921-926f-4f35-90a4-1d5ac981c254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:00.255725 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9a921-926f-4f35-90a4-1d5ac981c254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:00.258078 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9a921-926f-4f35-90a4-1d5ac981c254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:00.260635 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9a921-926f-4f35-90a4-1d5ac981c254 admin admin] PATH_INFO: `/v3/projects/2391e569a11f4afeb9dc62059af36726` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:00.263974 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee9a921-926f-4f35-90a4-1d5ac981c254 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2391e569a11f4afeb9dc62059af36726)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:00.281410 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee9a921-926f-4f35-90a4-1d5ac981c254 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:00.386737 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:00.428280 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-0ba8828d-1e1a-46bb-9336-07b1399ca521 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd944fe1554364235b5fd2498f98c9140', 'request_id': 'req-0ba8828d-1e1a-46bb-9336-07b1399ca521'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:00.431130 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-cee9a921-926f-4f35-90a4-1d5ac981c254 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2391e569a11f4afeb9dc62059af36726', 'request_id': 'req-cee9a921-926f-4f35-90a4-1d5ac981c254'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:00.451535 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-0ba8828d-1e1a-46bb-9336-07b1399ca521 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd944fe1554364235b5fd2498f98c9140', 'request_id': 'req-0ba8828d-1e1a-46bb-9336-07b1399ca521'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:00.462058 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-0ba8828d-1e1a-46bb-9336-07b1399ca521 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd944fe1554364235b5fd2498f98c9140', 'request_id': 'req-0ba8828d-1e1a-46bb-9336-07b1399ca521'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:00.475614 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-cee9a921-926f-4f35-90a4-1d5ac981c254 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2391e569a11f4afeb9dc62059af36726', 'request_id': 'req-cee9a921-926f-4f35-90a4-1d5ac981c254'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:00.494566 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-cee9a921-926f-4f35-90a4-1d5ac981c254 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2391e569a11f4afeb9dc62059af36726', 'request_id': 'req-cee9a921-926f-4f35-90a4-1d5ac981c254'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:00.504413 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-0ba8828d-1e1a-46bb-9336-07b1399ca521 admin admin] The token cache is being invalidate because project d944fe1554364235b5fd2498f98c9140 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:55:00.505017 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-0ba8828d-1e1a-46bb-9336-07b1399ca521 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:00.506018 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-0ba8828d-1e1a-46bb-9336-07b1399ca521 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:00.512439 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 849/1700] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:55:00 2022] DELETE /identity/v3/projects/d944fe1554364235b5fd2498f98c9140 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:00.517238 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba01b46-b815-4b0f-9655-190287aa6258 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:00.517877 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba01b46-b815-4b0f-9655-190287aa6258 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:00.518376 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba01b46-b815-4b0f-9655-190287aa6258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:00.561800 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-cee9a921-926f-4f35-90a4-1d5ac981c254 admin admin] The token cache is being invalidate because project 2391e569a11f4afeb9dc62059af36726 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:55:00.562399 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-cee9a921-926f-4f35-90a4-1d5ac981c254 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:00.566486 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-cee9a921-926f-4f35-90a4-1d5ac981c254 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:00.579478 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 852/1701] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:55:00 2022] DELETE /identity/v3/projects/2391e569a11f4afeb9dc62059af36726 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:55:00.583913 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9a921-926f-4f35-90a4-1d5ac981c254 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:00.585741 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-0ba01b46-b815-4b0f-9655-190287aa6258 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:00.590002 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-cee9a921-926f-4f35-90a4-1d5ac981c254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:00.592951 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-0ba01b46-b815-4b0f-9655-190287aa6258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:00.784523 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 850/1702] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:00.790406 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dbfea-469d-4885-8adc-1ac238f114f3 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:00.791059 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dbfea-469d-4885-8adc-1ac238f114f3 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:00.791572 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dbfea-469d-4885-8adc-1ac238f114f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:00.831866 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9a921-926f-4f35-90a4-1d5ac981c254 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:00.861303 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd1891-e72a-4b37-8381-76d6478f96b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:00.864769 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd1891-e72a-4b37-8381-76d6478f96b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:00.866005 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd1891-e72a-4b37-8381-76d6478f96b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:00.866665 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd1891-e72a-4b37-8381-76d6478f96b5 admin admin] PATH_INFO: `/v3/users/50e3d500a6aa4a7893b951175ceccc0d` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:00.870752 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd1891-e72a-4b37-8381-76d6478f96b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50e3d500a6aa4a7893b951175ceccc0d)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:00.876803 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd1891-e72a-4b37-8381-76d6478f96b5 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:00.883949 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-829dbfea-469d-4885-8adc-1ac238f114f3 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:00.886059 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-829dbfea-469d-4885-8adc-1ac238f114f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:00.909564 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 851/1703] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:55:00.911690 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829dbfea-469d-4885-8adc-1ac238f114f3 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:00.977161 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829dbfea-469d-4885-8adc-1ac238f114f3 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:01.000721 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8de8a5-6935-4a04-bbb8-4b97085069a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:01.001373 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8de8a5-6935-4a04-bbb8-4b97085069a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:01.003151 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8de8a5-6935-4a04-bbb8-4b97085069a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:01.006765 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8de8a5-6935-4a04-bbb8-4b97085069a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:01.010391 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8de8a5-6935-4a04-bbb8-4b97085069a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:01.012970 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8de8a5-6935-4a04-bbb8-4b97085069a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:01.018388 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8de8a5-6935-4a04-bbb8-4b97085069a9 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:01.091110 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-18bd1891-e72a-4b37-8381-76d6478f96b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50e3d500a6aa4a7893b951175ceccc0d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:01.097501 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 852/1704] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:01.098688 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8de8a5-6935-4a04-bbb8-4b97085069a9 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:01.117921 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:01.141159 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8de8a5-6935-4a04-bbb8-4b97085069a9 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:01.143872 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-18bd1891-e72a-4b37-8381-76d6478f96b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50e3d500a6aa4a7893b951175ceccc0d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:01.165271 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297729f1-2454-4a13-aabe-265f18a41a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:01.166332 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297729f1-2454-4a13-aabe-265f18a41a42 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:01.167914 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297729f1-2454-4a13-aabe-265f18a41a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:01.169965 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297729f1-2454-4a13-aabe-265f18a41a42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:01.171486 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297729f1-2454-4a13-aabe-265f18a41a42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:01.175607 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-18bd1891-e72a-4b37-8381-76d6478f96b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50e3d500a6aa4a7893b951175ceccc0d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:01.180172 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297729f1-2454-4a13-aabe-265f18a41a42 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:01.203357 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-18bd1891-e72a-4b37-8381-76d6478f96b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50e3d500a6aa4a7893b951175ceccc0d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:01.204472 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-18bd1891-e72a-4b37-8381-76d6478f96b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50e3d500a6aa4a7893b951175ceccc0d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:01.234654 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 853/1705] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:55:00 2022] DELETE /identity/v3/users/50e3d500a6aa4a7893b951175ceccc0d => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:01.292420 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 853/1706] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:55:01 2022] POST /identity/v3/projects => generated 363 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:01.295386 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd1891-e72a-4b37-8381-76d6478f96b5 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:01.296896 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-18bd1891-e72a-4b37-8381-76d6478f96b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:01.421258 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:01.455283 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd1891-e72a-4b37-8381-76d6478f96b5 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:01.606187 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a076b-a052-4d59-8691-8e457648f95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:01.606822 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a076b-a052-4d59-8691-8e457648f95c admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:01.607153 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a076b-a052-4d59-8691-8e457648f95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:01.607428 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a076b-a052-4d59-8691-8e457648f95c admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:01.611511 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a076b-a052-4d59-8691-8e457648f95c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:01.615652 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a076b-a052-4d59-8691-8e457648f95c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:01.665279 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 854/1707] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:55:01 2022] POST /identity/v3/users => generated 282 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:01.668435 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297729f1-2454-4a13-aabe-265f18a41a42 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:01.683597 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297729f1-2454-4a13-aabe-265f18a41a42 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:01.714598 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8ed8b-2cec-46a0-b09c-338b825385e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:01.715242 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8ed8b-2cec-46a0-b09c-338b825385e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:01.715517 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8ed8b-2cec-46a0-b09c-338b825385e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:01.715787 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8ed8b-2cec-46a0-b09c-338b825385e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:01.726088 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da8ed8b-2cec-46a0-b09c-338b825385e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:01.738544 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da8ed8b-2cec-46a0-b09c-338b825385e2 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:01.756636 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40491b75-6778-4674-920d-f9461fc39263 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:01.756931 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40491b75-6778-4674-920d-f9461fc39263 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:01.757224 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40491b75-6778-4674-920d-f9461fc39263 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:01.759110 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 855/1708] 10.222.0.52 () {54 vars in 912 bytes} [Sun Aug 28 00:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:55:01.765372 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9c285-11d2-4a81-b11f-4fc044739877 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:01.765696 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9c285-11d2-4a81-b11f-4fc044739877 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:01.765968 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9c285-11d2-4a81-b11f-4fc044739877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:01.796656 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 854/1709] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:01.806055 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-baa9c285-11d2-4a81-b11f-4fc044739877 None None] MFA Rules not processed for user `0ca94d8693c64e388bd0d15db07f5fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:01.806929 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8ed8b-2cec-46a0-b09c-338b825385e2 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:01.812393 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-baa9c285-11d2-4a81-b11f-4fc044739877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:01.836023 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8ed8b-2cec-46a0-b09c-338b825385e2 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:01.862624 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2547e14-d225-4866-9fb4-3ce642775e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:01.864018 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2547e14-d225-4866-9fb4-3ce642775e86 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:01.864363 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2547e14-d225-4866-9fb4-3ce642775e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:01.864783 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2547e14-d225-4866-9fb4-3ce642775e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:01.865693 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2547e14-d225-4866-9fb4-3ce642775e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:01.867408 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2547e14-d225-4866-9fb4-3ce642775e86 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:01.897874 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 855/1710] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:01.903166 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2547e14-d225-4866-9fb4-3ce642775e86 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:01.928088 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2547e14-d225-4866-9fb4-3ce642775e86 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:01.948914 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24d9fb-c7d4-43b4-a2ab-c5c0a68011cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:01.949833 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24d9fb-c7d4-43b4-a2ab-c5c0a68011cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:01.950447 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24d9fb-c7d4-43b4-a2ab-c5c0a68011cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:01.950868 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24d9fb-c7d4-43b4-a2ab-c5c0a68011cb admin admin] PATH_INFO: `/v3/projects/f3e8be96e4ef46b4984210c8967c0b84/users/314d906bb5cd461283e9d17212ffc6ea/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:02.040534 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24d9fb-c7d4-43b4-a2ab-c5c0a68011cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3e8be96e4ef46b4984210c8967c0b84, user_id=314d906bb5cd461283e9d17212ffc6ea, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:02.043593 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24d9fb-c7d4-43b4-a2ab-c5c0a68011cb admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:02.052198 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 856/1711] 10.222.0.52 () {58 vars in 1009 bytes} [Sun Aug 28 00:55:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:55:02.079313 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 856/1712] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:01 2022] PUT /identity/v3/projects/f3e8be96e4ef46b4984210c8967c0b84/users/314d906bb5cd461283e9d17212ffc6ea/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:02.089579 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9c285-11d2-4a81-b11f-4fc044739877 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:02.091014 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dde3a9-ad3f-4cc6-a6de-e6b059d68ac6 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:02.091446 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dde3a9-ad3f-4cc6-a6de-e6b059d68ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:02.091548 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-baa9c285-11d2-4a81-b11f-4fc044739877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:02.092057 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dde3a9-ad3f-4cc6-a6de-e6b059d68ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:02.114703 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9c285-11d2-4a81-b11f-4fc044739877 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:02.229767 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-50dde3a9-ad3f-4cc6-a6de-e6b059d68ac6 None None] MFA Rules not processed for user `314d906bb5cd461283e9d17212ffc6ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:02.231725 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-50dde3a9-ad3f-4cc6-a6de-e6b059d68ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:02.279144 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b2771-a1c6-454b-b8b3-6a635103d265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:02.279781 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b2771-a1c6-454b-b8b3-6a635103d265 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:02.280060 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b2771-a1c6-454b-b8b3-6a635103d265 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:02.280335 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b2771-a1c6-454b-b8b3-6a635103d265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:02.296063 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b2771-a1c6-454b-b8b3-6a635103d265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:02.299189 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b2771-a1c6-454b-b8b3-6a635103d265 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:02.328002 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 857/1713] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:02.331758 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552e229-1ccf-48c4-88d2-ea366d9818c0 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:02.331999 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552e229-1ccf-48c4-88d2-ea366d9818c0 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:02.332242 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552e229-1ccf-48c4-88d2-ea366d9818c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:02.393576 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e552e229-1ccf-48c4-88d2-ea366d9818c0 None None] MFA Rules not processed for user `cc8eaa6c0af74ff3aa6e41189388dc8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:02.395495 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e552e229-1ccf-48c4-88d2-ea366d9818c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:02.425806 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:02.447138 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 857/1714] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:02.450461 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dde3a9-ad3f-4cc6-a6de-e6b059d68ac6 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:02.575788 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 858/1715] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:02 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:02.701095 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dde3a9-ad3f-4cc6-a6de-e6b059d68ac6 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:02.716435 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81acd8fb-2e9f-40e1-a7e1-96ab68df530f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:02.716619 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acd8fb-2e9f-40e1-a7e1-96ab68df530f admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:02.716769 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acd8fb-2e9f-40e1-a7e1-96ab68df530f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:02.717050 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acd8fb-2e9f-40e1-a7e1-96ab68df530f admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:02.726693 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81acd8fb-2e9f-40e1-a7e1-96ab68df530f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:02.732075 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81acd8fb-2e9f-40e1-a7e1-96ab68df530f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:02.808253 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 858/1716] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:55:02 2022] POST /identity/v3/projects => generated 363 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:55:02.812967 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552e229-1ccf-48c4-88d2-ea366d9818c0 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:02.832510 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552e229-1ccf-48c4-88d2-ea366d9818c0 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:03.092376 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b90647-2588-405f-a20a-224edea47f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:03.093185 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b90647-2588-405f-a20a-224edea47f53 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:03.093185 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b90647-2588-405f-a20a-224edea47f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:03.093185 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b90647-2588-405f-a20a-224edea47f53 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:03.099199 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b90647-2588-405f-a20a-224edea47f53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:03.108710 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b90647-2588-405f-a20a-224edea47f53 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:03.122422 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81acd8fb-2e9f-40e1-a7e1-96ab68df530f admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:03.125673 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-81acd8fb-2e9f-40e1-a7e1-96ab68df530f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:03.165812 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 859/1717] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:55:02 2022] POST /identity/v3/users => generated 288 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:03.170471 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b90647-2588-405f-a20a-224edea47f53 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:03.177245 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:03.197513 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b90647-2588-405f-a20a-224edea47f53 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:03.224038 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02704e-0244-4f7c-adfb-8274e47ad5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:03.225150 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02704e-0244-4f7c-adfb-8274e47ad5ef admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:03.228015 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02704e-0244-4f7c-adfb-8274e47ad5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:03.228299 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02704e-0244-4f7c-adfb-8274e47ad5ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:03.228994 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02704e-0244-4f7c-adfb-8274e47ad5ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:03.233698 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02704e-0244-4f7c-adfb-8274e47ad5ef admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:03.279394 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 860/1718] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:55:03.285312 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02704e-0244-4f7c-adfb-8274e47ad5ef admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:03.316204 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02704e-0244-4f7c-adfb-8274e47ad5ef admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:03.333831 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30bf75-7792-4098-855b-d8771ed4a302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:03.334828 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30bf75-7792-4098-855b-d8771ed4a302 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:03.335378 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30bf75-7792-4098-855b-d8771ed4a302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:03.335790 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30bf75-7792-4098-855b-d8771ed4a302 admin admin] PATH_INFO: `/v3/projects/c815d7710a2b4eca97827bd91e9d8b55/users/630978ed5dca422c967c0aac2c8eb0de/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:03.371773 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81acd8fb-2e9f-40e1-a7e1-96ab68df530f admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:03.373303 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f30bf75-7792-4098-855b-d8771ed4a302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c815d7710a2b4eca97827bd91e9d8b55, user_id=630978ed5dca422c967c0aac2c8eb0de, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:03.377860 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f30bf75-7792-4098-855b-d8771ed4a302 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:03.389183 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ab813-9e01-4684-ba06-9558e3bd801c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:03.390001 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ab813-9e01-4684-ba06-9558e3bd801c service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:03.390287 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ab813-9e01-4684-ba06-9558e3bd801c service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:03.390555 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ab813-9e01-4684-ba06-9558e3bd801c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:03.412248 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 861/1719] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:03 2022] PUT /identity/v3/projects/c815d7710a2b4eca97827bd91e9d8b55/users/630978ed5dca422c967c0aac2c8eb0de/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:03.413195 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30bf75-7792-4098-855b-d8771ed4a302 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:03.590470 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30bf75-7792-4098-855b-d8771ed4a302 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:03.631188 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc46cb5-192f-4381-8ee2-fbae08d98536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:03.631962 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc46cb5-192f-4381-8ee2-fbae08d98536 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:03.632241 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc46cb5-192f-4381-8ee2-fbae08d98536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:03.632512 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc46cb5-192f-4381-8ee2-fbae08d98536 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:03.633163 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc46cb5-192f-4381-8ee2-fbae08d98536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:03.650924 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc46cb5-192f-4381-8ee2-fbae08d98536 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:03.660128 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ab813-9e01-4684-ba06-9558e3bd801c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:03.663878 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ab813-9e01-4684-ba06-9558e3bd801c service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:03.681120 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 859/1720] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:03 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:03.714025 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 862/1721] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:03.717431 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ab813-9e01-4684-ba06-9558e3bd801c service nova] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:03.736594 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ab813-9e01-4684-ba06-9558e3bd801c service nova] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:03.743624 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a237a2e-bf5b-413a-ab73-3dc1641f59fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:03.744788 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a237a2e-bf5b-413a-ab73-3dc1641f59fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:03.745356 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a237a2e-bf5b-413a-ab73-3dc1641f59fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:03.745829 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a237a2e-bf5b-413a-ab73-3dc1641f59fe admin admin] PATH_INFO: `/v3/projects/c815d7710a2b4eca97827bd91e9d8b55/users/630978ed5dca422c967c0aac2c8eb0de/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:03.748213 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a237a2e-bf5b-413a-ab73-3dc1641f59fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c815d7710a2b4eca97827bd91e9d8b55, user_id=630978ed5dca422c967c0aac2c8eb0de, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:03.752409 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a237a2e-bf5b-413a-ab73-3dc1641f59fe admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:03.788573 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 860/1722] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:03 2022] PUT /identity/v3/projects/c815d7710a2b4eca97827bd91e9d8b55/users/630978ed5dca422c967c0aac2c8eb0de/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:03.804870 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf514c82-8ac7-42b5-974f-7e98b1a40942 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:03.807031 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf514c82-8ac7-42b5-974f-7e98b1a40942 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:03.807618 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf514c82-8ac7-42b5-974f-7e98b1a40942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:03.831562 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:03.855408 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-cf514c82-8ac7-42b5-974f-7e98b1a40942 None None] MFA Rules not processed for user `630978ed5dca422c967c0aac2c8eb0de`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:03.857554 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-cf514c82-8ac7-42b5-974f-7e98b1a40942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:04.054756 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a237a2e-bf5b-413a-ab73-3dc1641f59fe admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:04.056598 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1a237a2e-bf5b-413a-ab73-3dc1641f59fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:04.088475 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 863/1723] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:04.112685 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf514c82-8ac7-42b5-974f-7e98b1a40942 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:04.117413 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-cf514c82-8ac7-42b5-974f-7e98b1a40942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:04.290273 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf514c82-8ac7-42b5-974f-7e98b1a40942 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:04.306626 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a237a2e-bf5b-413a-ab73-3dc1641f59fe admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:04.308047 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41952b2d-e2a0-4a13-ad49-f4bb0039ea65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:04.308687 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41952b2d-e2a0-4a13-ad49-f4bb0039ea65 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:04.308959 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41952b2d-e2a0-4a13-ad49-f4bb0039ea65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:04.309226 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41952b2d-e2a0-4a13-ad49-f4bb0039ea65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:04.334986 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cf5c9-7e73-4133-a6fb-5aa4393dd071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:04.335758 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cf5c9-7e73-4133-a6fb-5aa4393dd071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:04.335917 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cf5c9-7e73-4133-a6fb-5aa4393dd071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:04.336276 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cf5c9-7e73-4133-a6fb-5aa4393dd071 admin admin] PATH_INFO: `/v3/projects/7db748abad384d5b9e818174d70b199c` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:04.337409 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8cf5c9-7e73-4133-a6fb-5aa4393dd071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7db748abad384d5b9e818174d70b199c)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:04.339633 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8cf5c9-7e73-4133-a6fb-5aa4393dd071 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:04.345291 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41952b2d-e2a0-4a13-ad49-f4bb0039ea65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:04.346783 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41952b2d-e2a0-4a13-ad49-f4bb0039ea65 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:04.411114 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 864/1724] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:55:04.412756 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80751cda-e4af-4a91-a1d1-72bd6aaf98fd None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:04.418343 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80751cda-e4af-4a91-a1d1-72bd6aaf98fd None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:04.418776 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80751cda-e4af-4a91-a1d1-72bd6aaf98fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:04.476459 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:04.502996 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-80751cda-e4af-4a91-a1d1-72bd6aaf98fd None None] MFA Rules not processed for user `1810e64573d145d48b13c774b7a07e60`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:04.505952 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-80751cda-e4af-4a91-a1d1-72bd6aaf98fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:04.506986 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8d8cf5c9-7e73-4133-a6fb-5aa4393dd071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7db748abad384d5b9e818174d70b199c', 'request_id': 'req-8d8cf5c9-7e73-4133-a6fb-5aa4393dd071'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:04.526489 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8d8cf5c9-7e73-4133-a6fb-5aa4393dd071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7db748abad384d5b9e818174d70b199c', 'request_id': 'req-8d8cf5c9-7e73-4133-a6fb-5aa4393dd071'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:04.576993 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8d8cf5c9-7e73-4133-a6fb-5aa4393dd071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7db748abad384d5b9e818174d70b199c', 'request_id': 'req-8d8cf5c9-7e73-4133-a6fb-5aa4393dd071'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:04.619774 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8d8cf5c9-7e73-4133-a6fb-5aa4393dd071 admin admin] The token cache is being invalidate because project 7db748abad384d5b9e818174d70b199c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:55:04.622680 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8d8cf5c9-7e73-4133-a6fb-5aa4393dd071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:04.624573 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8d8cf5c9-7e73-4133-a6fb-5aa4393dd071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:04.636120 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 861/1725] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:55:04 2022] DELETE /identity/v3/projects/7db748abad384d5b9e818174d70b199c => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:55:04.639786 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a2684-0db2-4bb3-8c7b-4a28e929e140 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:04.640524 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a2684-0db2-4bb3-8c7b-4a28e929e140 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:04.642093 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a2684-0db2-4bb3-8c7b-4a28e929e140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:04.713917 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 865/1726] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:04.736723 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce103d6d-750c-4a52-9cf5-8cf9bbe4754d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:04.737159 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce103d6d-750c-4a52-9cf5-8cf9bbe4754d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:04.737780 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce103d6d-750c-4a52-9cf5-8cf9bbe4754d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:04.737976 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-9e5a2684-0db2-4bb3-8c7b-4a28e929e140 None None] MFA Rules not processed for user `687249b94db247b4b608e416559d0556`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:04.742817 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9e5a2684-0db2-4bb3-8c7b-4a28e929e140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:04.882577 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:04.935039 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-ce103d6d-750c-4a52-9cf5-8cf9bbe4754d None None] MFA Rules not processed for user `3302fdf33b5b4583a10e7c760c577cda`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:04.940627 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 862/1727] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:04.941563 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a2684-0db2-4bb3-8c7b-4a28e929e140 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:04.942577 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ce103d6d-750c-4a52-9cf5-8cf9bbe4754d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:04.943317 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9e5a2684-0db2-4bb3-8c7b-4a28e929e140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:05.102007 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a2684-0db2-4bb3-8c7b-4a28e929e140 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:05.107157 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67693730-ef88-445b-aa1e-3d32d6327c62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:05.108050 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67693730-ef88-445b-aa1e-3d32d6327c62 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:05.108509 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67693730-ef88-445b-aa1e-3d32d6327c62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:05.109186 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67693730-ef88-445b-aa1e-3d32d6327c62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:05.111591 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-67693730-ef88-445b-aa1e-3d32d6327c62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:05.182896 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 866/1728] 10.222.0.52 () {58 vars in 1009 bytes} [Sun Aug 28 00:55:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:05.185151 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f39ecc-a9ff-400c-bf8b-1153b1d22435 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:05.186730 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f39ecc-a9ff-400c-bf8b-1153b1d22435 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:05.187713 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f39ecc-a9ff-400c-bf8b-1153b1d22435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:05.238619 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e6f39ecc-a9ff-400c-bf8b-1153b1d22435 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:05.247707 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e6f39ecc-a9ff-400c-bf8b-1153b1d22435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:05.316376 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67693730-ef88-445b-aa1e-3d32d6327c62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:05.318174 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67693730-ef88-445b-aa1e-3d32d6327c62 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:05.340290 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 863/1729] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:05.341653 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67693730-ef88-445b-aa1e-3d32d6327c62 service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:05.342447 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 867/1730] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:05.343994 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17daff7-afd9-4b10-9a57-2a4432738c1f None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:05.344358 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17daff7-afd9-4b10-9a57-2a4432738c1f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:05.344791 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17daff7-afd9-4b10-9a57-2a4432738c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:05.346949 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-67693730-ef88-445b-aa1e-3d32d6327c62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:05.398302 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c17daff7-afd9-4b10-9a57-2a4432738c1f None None] MFA Rules not processed for user `5f227aa72915442384469ddc844198dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:05.403927 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c17daff7-afd9-4b10-9a57-2a4432738c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:05.414801 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:05.618570 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 868/1731] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:05.622639 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d92b83-3205-4fc0-a987-100a53f215cf None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:05.623180 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d92b83-3205-4fc0-a987-100a53f215cf None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:05.623604 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d92b83-3205-4fc0-a987-100a53f215cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:05.650108 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67693730-ef88-445b-aa1e-3d32d6327c62 service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:05.705653 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c899fd5-d583-437f-a9bc-0fccf407244d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:05.710329 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c899fd5-d583-437f-a9bc-0fccf407244d service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:05.712980 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c899fd5-d583-437f-a9bc-0fccf407244d service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:05.716622 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c899fd5-d583-437f-a9bc-0fccf407244d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:05.750099 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a3d92b83-3205-4fc0-a987-100a53f215cf None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:05.760077 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c899fd5-d583-437f-a9bc-0fccf407244d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:05.760961 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a3d92b83-3205-4fc0-a987-100a53f215cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:05.769585 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c899fd5-d583-437f-a9bc-0fccf407244d service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:05.801438 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 869/1732] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:05.802496 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d92b83-3205-4fc0-a987-100a53f215cf None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:05.806756 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a3d92b83-3205-4fc0-a987-100a53f215cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:05.807302 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 864/1733] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:05.808665 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c899fd5-d583-437f-a9bc-0fccf407244d service nova] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:05.836975 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c899fd5-d583-437f-a9bc-0fccf407244d service nova] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:05.844710 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b779aac-e1f6-4852-a425-5478e2edc345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:05.846666 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b779aac-e1f6-4852-a425-5478e2edc345 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:05.846666 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b779aac-e1f6-4852-a425-5478e2edc345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:05.846666 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b779aac-e1f6-4852-a425-5478e2edc345 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:05.847188 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b779aac-e1f6-4852-a425-5478e2edc345 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:05.847656 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b779aac-e1f6-4852-a425-5478e2edc345 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:05.850084 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b779aac-e1f6-4852-a425-5478e2edc345 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:05.870143 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 865/1734] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:05.874757 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b779aac-e1f6-4852-a425-5478e2edc345 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:05.886706 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b779aac-e1f6-4852-a425-5478e2edc345 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:05.894465 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0627b2-d3a3-4f8e-bc0a-0f43e95b926a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:05.899158 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0627b2-d3a3-4f8e-bc0a-0f43e95b926a admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:05.899834 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0627b2-d3a3-4f8e-bc0a-0f43e95b926a admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:05.900255 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0627b2-d3a3-4f8e-bc0a-0f43e95b926a admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:05.901491 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0627b2-d3a3-4f8e-bc0a-0f43e95b926a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:05.909405 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0627b2-d3a3-4f8e-bc0a-0f43e95b926a admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:05.968979 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:05.972565 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 866/1735] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:55:05 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:55:05.973809 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0627b2-d3a3-4f8e-bc0a-0f43e95b926a admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:06.215664 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0627b2-d3a3-4f8e-bc0a-0f43e95b926a admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:06.217434 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d92b83-3205-4fc0-a987-100a53f215cf None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:06.241518 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f1db2-135c-4cd0-993d-bce50e447bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:06.243323 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f1db2-135c-4cd0-993d-bce50e447bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:06.261690 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f1db2-135c-4cd0-993d-bce50e447bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:06.266312 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f1db2-135c-4cd0-993d-bce50e447bc8 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:06.272973 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f1db2-135c-4cd0-993d-bce50e447bc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:06.284645 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f1db2-135c-4cd0-993d-bce50e447bc8 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:06.377295 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 867/1736] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:55:05 2022] POST /identity/v3/users => generated 293 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:06.381252 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f1db2-135c-4cd0-993d-bce50e447bc8 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:06.427320 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f1db2-135c-4cd0-993d-bce50e447bc8 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:06.455485 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c36ea1-097a-467b-9ac0-34d724191c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:06.460459 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c36ea1-097a-467b-9ac0-34d724191c61 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:06.463519 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c36ea1-097a-467b-9ac0-34d724191c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:06.466765 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c36ea1-097a-467b-9ac0-34d724191c61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:06.468969 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c36ea1-097a-467b-9ac0-34d724191c61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:06.476316 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c36ea1-097a-467b-9ac0-34d724191c61 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:06.488486 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c13292-19e1-4fc8-8610-0b1bef43f300 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80a6019cf424c16a1d461a632cf8568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:06.491753 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c13292-19e1-4fc8-8610-0b1bef43f300 service swift] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:06.492042 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c13292-19e1-4fc8-8610-0b1bef43f300 service swift] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:06.492306 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c13292-19e1-4fc8-8610-0b1bef43f300 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:06.512991 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 868/1737] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:06.515272 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c36ea1-097a-467b-9ac0-34d724191c61 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:06.538458 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c36ea1-097a-467b-9ac0-34d724191c61 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:06.553833 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f8421-ea53-4d41-a634-8ea4fa46d169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:06.557011 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f8421-ea53-4d41-a634-8ea4fa46d169 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:06.558187 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f8421-ea53-4d41-a634-8ea4fa46d169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:06.558660 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f8421-ea53-4d41-a634-8ea4fa46d169 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:06.561424 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f8421-ea53-4d41-a634-8ea4fa46d169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:06.577486 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f8421-ea53-4d41-a634-8ea4fa46d169 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:06.625197 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 869/1738] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:06.627466 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f8421-ea53-4d41-a634-8ea4fa46d169 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:06.654757 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f8421-ea53-4d41-a634-8ea4fa46d169 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:06.668780 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2feb7-08d8-4ef1-a89e-4232097f139c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:06.671846 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2feb7-08d8-4ef1-a89e-4232097f139c admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:06.672143 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2feb7-08d8-4ef1-a89e-4232097f139c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:06.673177 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2feb7-08d8-4ef1-a89e-4232097f139c admin admin] PATH_INFO: `/v3/projects/b6ca27acebe04e02b09cdeca61524188/users/8fee290b864648e3b3153537824a7297/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:06.699589 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c13292-19e1-4fc8-8610-0b1bef43f300 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:06.701525 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c13292-19e1-4fc8-8610-0b1bef43f300 service swift] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:06.712713 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a2feb7-08d8-4ef1-a89e-4232097f139c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ca27acebe04e02b09cdeca61524188, user_id=8fee290b864648e3b3153537824a7297, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:06.721734 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a2feb7-08d8-4ef1-a89e-4232097f139c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:06.726517 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 870/1739] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Aug 28 00:55:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 924 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 00:55:06.746559 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 870/1740] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:06 2022] PUT /identity/v3/projects/b6ca27acebe04e02b09cdeca61524188/users/8fee290b864648e3b3153537824a7297/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:06.757550 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52605a-beef-4eb2-bb0f-48f5143009bc None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:06.757868 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52605a-beef-4eb2-bb0f-48f5143009bc None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:06.758202 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52605a-beef-4eb2-bb0f-48f5143009bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:06.831102 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-ab52605a-beef-4eb2-bb0f-48f5143009bc None None] MFA Rules not processed for user `8fee290b864648e3b3153537824a7297`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:06.832546 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ab52605a-beef-4eb2-bb0f-48f5143009bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:06.950831 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:07.021649 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 871/1741] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:07.022775 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2feb7-08d8-4ef1-a89e-4232097f139c admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:07.075244 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:07.318931 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2feb7-08d8-4ef1-a89e-4232097f139c admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:07.349054 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d43c6d-4315-497d-ae77-65cd72b5044a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:07.374156 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d43c6d-4315-497d-ae77-65cd72b5044a admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:07.376931 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d43c6d-4315-497d-ae77-65cd72b5044a admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:07.377307 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d43c6d-4315-497d-ae77-65cd72b5044a admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:07.378330 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d43c6d-4315-497d-ae77-65cd72b5044a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:07.382995 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d43c6d-4315-497d-ae77-65cd72b5044a admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:07.518747 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259c246-a62c-49cf-877c-dc1f193530d6 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:07.519659 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259c246-a62c-49cf-877c-dc1f193530d6 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:07.520134 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259c246-a62c-49cf-877c-dc1f193530d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:07.570328 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 871/1742] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:55:07 2022] POST /identity/v3/projects => generated 385 bytes in 548 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:07.577965 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d43c6d-4315-497d-ae77-65cd72b5044a admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:07.640190 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-4259c246-a62c-49cf-877c-dc1f193530d6 None None] MFA Rules not processed for user `0ca94d8693c64e388bd0d15db07f5fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:07.658739 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4259c246-a62c-49cf-877c-dc1f193530d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:07.917256 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 872/1743] 10.222.0.62 () {58 vars in 1015 bytes} [Sun Aug 28 00:55:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:55:07.945926 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d43c6d-4315-497d-ae77-65cd72b5044a admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:07.957595 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23773c4-c26d-44ae-8c37-1702e4f3f490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:07.962558 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23773c4-c26d-44ae-8c37-1702e4f3f490 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:07.962852 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23773c4-c26d-44ae-8c37-1702e4f3f490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:07.963130 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23773c4-c26d-44ae-8c37-1702e4f3f490 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:07.965477 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23773c4-c26d-44ae-8c37-1702e4f3f490 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:07.970876 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23773c4-c26d-44ae-8c37-1702e4f3f490 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:07.990567 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259c246-a62c-49cf-877c-dc1f193530d6 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:07.992517 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4259c246-a62c-49cf-877c-dc1f193530d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:08.026595 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259c246-a62c-49cf-877c-dc1f193530d6 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:08.039357 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 872/1744] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:55:07 2022] POST /identity/v3/users => generated 299 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:08.042300 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23773c4-c26d-44ae-8c37-1702e4f3f490 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:08.051150 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8156f-f6c3-439f-8e84-159ce1b29243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:08.051402 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8156f-f6c3-439f-8e84-159ce1b29243 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:08.051602 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8156f-f6c3-439f-8e84-159ce1b29243 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:08.051876 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8156f-f6c3-439f-8e84-159ce1b29243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:08.071235 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23773c4-c26d-44ae-8c37-1702e4f3f490 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:08.082618 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a6460-4e9f-4fe9-95dc-920f68fac9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:08.083494 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a6460-4e9f-4fe9-95dc-920f68fac9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:08.084871 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a6460-4e9f-4fe9-95dc-920f68fac9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:08.085823 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a6460-4e9f-4fe9-95dc-920f68fac9e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:08.087631 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a6460-4e9f-4fe9-95dc-920f68fac9e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:08.093224 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a6460-4e9f-4fe9-95dc-920f68fac9e6 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:08.106140 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8156f-f6c3-439f-8e84-159ce1b29243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:08.112039 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8156f-f6c3-439f-8e84-159ce1b29243 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:08.126396 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 873/1745] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:08.127296 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a6460-4e9f-4fe9-95dc-920f68fac9e6 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:08.167402 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a6460-4e9f-4fe9-95dc-920f68fac9e6 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:08.178132 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 873/1746] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:55:08.191913 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fe013-2b16-4652-8c20-6d814a84f11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:08.196036 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fe013-2b16-4652-8c20-6d814a84f11c admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:08.197417 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fe013-2b16-4652-8c20-6d814a84f11c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:08.197972 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fe013-2b16-4652-8c20-6d814a84f11c admin admin] PATH_INFO: `/v3/projects/7b3560ba4e0c4bf78f3603587233944e/users/97a810ad31dc4d449efd9238eb00b9fe/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:08.276935 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118fe013-2b16-4652-8c20-6d814a84f11c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b3560ba4e0c4bf78f3603587233944e, user_id=97a810ad31dc4d449efd9238eb00b9fe, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:08.295933 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118fe013-2b16-4652-8c20-6d814a84f11c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:08.343703 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 874/1747] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:08 2022] PUT /identity/v3/projects/7b3560ba4e0c4bf78f3603587233944e/users/97a810ad31dc4d449efd9238eb00b9fe/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:08.348146 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8156f-f6c3-439f-8e84-159ce1b29243 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:08.377866 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8156f-f6c3-439f-8e84-159ce1b29243 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:08.575734 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b517c72-ccee-4318-b974-fe0c16a26909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:08.577289 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b517c72-ccee-4318-b974-fe0c16a26909 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:08.578767 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b517c72-ccee-4318-b974-fe0c16a26909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:08.579467 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b517c72-ccee-4318-b974-fe0c16a26909 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:08.580500 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b517c72-ccee-4318-b974-fe0c16a26909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:08.593543 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b517c72-ccee-4318-b974-fe0c16a26909 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:08.625584 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fe013-2b16-4652-8c20-6d814a84f11c admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:08.626938 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 874/1748] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:08.657474 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fe013-2b16-4652-8c20-6d814a84f11c admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:08.675396 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badf87c-7138-47ec-b556-2468482ca71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:08.676614 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badf87c-7138-47ec-b556-2468482ca71c admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:08.677062 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badf87c-7138-47ec-b556-2468482ca71c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:08.677513 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badf87c-7138-47ec-b556-2468482ca71c admin admin] PATH_INFO: `/v3/projects/7b3560ba4e0c4bf78f3603587233944e/users/97a810ad31dc4d449efd9238eb00b9fe/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:08.684459 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badf87c-7138-47ec-b556-2468482ca71c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b3560ba4e0c4bf78f3603587233944e, user_id=97a810ad31dc4d449efd9238eb00b9fe, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:08.689116 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badf87c-7138-47ec-b556-2468482ca71c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:08.724986 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 875/1749] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:08 2022] PUT /identity/v3/projects/7b3560ba4e0c4bf78f3603587233944e/users/97a810ad31dc4d449efd9238eb00b9fe/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:55:08.741966 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d50b6-d6e1-4c67-b105-e313a728bb8f None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:08.742261 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d50b6-d6e1-4c67-b105-e313a728bb8f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:08.742975 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d50b6-d6e1-4c67-b105-e313a728bb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:08.830610 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-5b1d50b6-d6e1-4c67-b105-e313a728bb8f None None] MFA Rules not processed for user `97a810ad31dc4d449efd9238eb00b9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:08.833280 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5b1d50b6-d6e1-4c67-b105-e313a728bb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:09.102287 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 875/1750] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:09.116334 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badf87c-7138-47ec-b556-2468482ca71c admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:09.269236 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:09.331841 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badf87c-7138-47ec-b556-2468482ca71c admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:09.367003 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517c47b-0807-4d86-a5e9-2df054573fa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:09.368480 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517c47b-0807-4d86-a5e9-2df054573fa5 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:09.370224 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517c47b-0807-4d86-a5e9-2df054573fa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:09.379107 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517c47b-0807-4d86-a5e9-2df054573fa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:09.461255 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517c47b-0807-4d86-a5e9-2df054573fa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:09.464267 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517c47b-0807-4d86-a5e9-2df054573fa5 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:09.497398 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 876/1751] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:55:09.578370 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d50b6-d6e1-4c67-b105-e313a728bb8f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:09.601896 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:09.789278 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d50b6-d6e1-4c67-b105-e313a728bb8f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:09.801239 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084f30d-b036-407e-a04a-1fa67dd5c007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:09.802170 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084f30d-b036-407e-a04a-1fa67dd5c007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:09.803230 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084f30d-b036-407e-a04a-1fa67dd5c007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:09.803514 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084f30d-b036-407e-a04a-1fa67dd5c007 admin admin] PATH_INFO: `/v3/users/8fee290b864648e3b3153537824a7297` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:09.804923 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084f30d-b036-407e-a04a-1fa67dd5c007 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fee290b864648e3b3153537824a7297)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:09.808808 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084f30d-b036-407e-a04a-1fa67dd5c007 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:09.990918 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9084f30d-b036-407e-a04a-1fa67dd5c007 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fee290b864648e3b3153537824a7297'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:10.045688 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9084f30d-b036-407e-a04a-1fa67dd5c007 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fee290b864648e3b3153537824a7297'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:10.073364 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9084f30d-b036-407e-a04a-1fa67dd5c007 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fee290b864648e3b3153537824a7297'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:10.090728 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9084f30d-b036-407e-a04a-1fa67dd5c007 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fee290b864648e3b3153537824a7297'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:10.091786 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9084f30d-b036-407e-a04a-1fa67dd5c007 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fee290b864648e3b3153537824a7297'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:10.113900 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 876/1752] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:55:09 2022] DELETE /identity/v3/users/8fee290b864648e3b3153537824a7297 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:10.120737 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb0169-3023-4c89-a445-63ca4051c548 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:10.121337 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb0169-3023-4c89-a445-63ca4051c548 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:10.121337 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb0169-3023-4c89-a445-63ca4051c548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:10.211616 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-aebb0169-3023-4c89-a445-63ca4051c548 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:10.212928 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-aebb0169-3023-4c89-a445-63ca4051c548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:10.473505 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 877/1753] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:11.414467 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084f30d-b036-407e-a04a-1fa67dd5c007 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:11.417569 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9084f30d-b036-407e-a04a-1fa67dd5c007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:11.816789 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084f30d-b036-407e-a04a-1fa67dd5c007 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:11.834116 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480b764-28ae-43c6-a35e-d2e9bacef7d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:11.834116 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480b764-28ae-43c6-a35e-d2e9bacef7d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:11.834116 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480b764-28ae-43c6-a35e-d2e9bacef7d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:11.841240 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480b764-28ae-43c6-a35e-d2e9bacef7d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:11.878764 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480b764-28ae-43c6-a35e-d2e9bacef7d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:11.880376 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480b764-28ae-43c6-a35e-d2e9bacef7d7 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:11.927286 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 877/1754] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:55:12.460838 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01a5bd-ce7b-447d-bcd1-2c44340b4d80 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:12.462212 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01a5bd-ce7b-447d-bcd1-2c44340b4d80 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:12.462933 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01a5bd-ce7b-447d-bcd1-2c44340b4d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:12.542248 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-9f01a5bd-ce7b-447d-bcd1-2c44340b4d80 None None] MFA Rules not processed for user `cc8eaa6c0af74ff3aa6e41189388dc8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:12.550680 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9f01a5bd-ce7b-447d-bcd1-2c44340b4d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:12.803334 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 878/1755] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:14.006797 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25771aa9-cf70-4da3-8e86-2665735f2d3d None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:14.007449 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25771aa9-cf70-4da3-8e86-2665735f2d3d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:14.007543 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25771aa9-cf70-4da3-8e86-2665735f2d3d None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:14.009024 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 878/1756] 10.222.0.52 () {54 vars in 921 bytes} [Sun Aug 28 00:55:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:55:14.471089 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcb080-95e5-4b90-80f0-8ce61f077a70 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:14.471689 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcb080-95e5-4b90-80f0-8ce61f077a70 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:14.471938 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcb080-95e5-4b90-80f0-8ce61f077a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:14.598825 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-10dcb080-95e5-4b90-80f0-8ce61f077a70 None None] MFA Rules not processed for user `f890ff4e7807477db7f17c2f6434dce8`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:14.602257 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-10dcb080-95e5-4b90-80f0-8ce61f077a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:14.895617 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 879/1757] 10.222.0.52 () {58 vars in 1018 bytes} [Sun Aug 28 00:55:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:15.874249 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25771aa9-cf70-4da3-8e86-2665735f2d3d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:15.876129 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-25771aa9-cf70-4da3-8e86-2665735f2d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:15.942749 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25771aa9-cf70-4da3-8e86-2665735f2d3d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:15.970577 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd49e3a-0424-4ed8-b6e9-eee5f555ceb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:15.971325 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd49e3a-0424-4ed8-b6e9-eee5f555ceb3 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:15.971553 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd49e3a-0424-4ed8-b6e9-eee5f555ceb3 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:15.971834 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd49e3a-0424-4ed8-b6e9-eee5f555ceb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:16.025113 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd49e3a-0424-4ed8-b6e9-eee5f555ceb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:16.026954 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd49e3a-0424-4ed8-b6e9-eee5f555ceb3 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:16.076862 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 879/1758] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:55:16.087345 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcb080-95e5-4b90-80f0-8ce61f077a70 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:16.089800 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-10dcb080-95e5-4b90-80f0-8ce61f077a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:16.117091 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcb080-95e5-4b90-80f0-8ce61f077a70 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:16.139639 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c6b87-08b8-46f7-af6d-5c2db9ae46da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:16.142814 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c6b87-08b8-46f7-af6d-5c2db9ae46da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:16.144582 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c6b87-08b8-46f7-af6d-5c2db9ae46da admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:16.157381 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c6b87-08b8-46f7-af6d-5c2db9ae46da admin admin] PATH_INFO: `/v3/projects/b6ca27acebe04e02b09cdeca61524188` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:16.169301 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c6b87-08b8-46f7-af6d-5c2db9ae46da admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6ca27acebe04e02b09cdeca61524188)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:16.202708 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c6b87-08b8-46f7-af6d-5c2db9ae46da admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:16.306191 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:16.467359 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6b6c6b87-08b8-46f7-af6d-5c2db9ae46da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6ca27acebe04e02b09cdeca61524188', 'request_id': 'req-6b6c6b87-08b8-46f7-af6d-5c2db9ae46da'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:16.506621 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6b6c6b87-08b8-46f7-af6d-5c2db9ae46da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6ca27acebe04e02b09cdeca61524188', 'request_id': 'req-6b6c6b87-08b8-46f7-af6d-5c2db9ae46da'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:16.515181 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd49e3a-0424-4ed8-b6e9-eee5f555ceb3 service nova] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:16.516762 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3bd49e3a-0424-4ed8-b6e9-eee5f555ceb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:16.573285 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6b6c6b87-08b8-46f7-af6d-5c2db9ae46da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6ca27acebe04e02b09cdeca61524188', 'request_id': 'req-6b6c6b87-08b8-46f7-af6d-5c2db9ae46da'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:16.585717 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd49e3a-0424-4ed8-b6e9-eee5f555ceb3 service nova] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:16.633614 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6b6c6b87-08b8-46f7-af6d-5c2db9ae46da admin admin] The token cache is being invalidate because project b6ca27acebe04e02b09cdeca61524188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:55:16.634167 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6b6c6b87-08b8-46f7-af6d-5c2db9ae46da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:16.638303 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6b6c6b87-08b8-46f7-af6d-5c2db9ae46da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:16.640238 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 880/1759] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:55:16 2022] DELETE /identity/v3/projects/b6ca27acebe04e02b09cdeca61524188 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:16.643577 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:16.644634 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c6b87-08b8-46f7-af6d-5c2db9ae46da admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:16.656830 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6b6c6b87-08b8-46f7-af6d-5c2db9ae46da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:16.855707 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0d742-8eda-4093-adb1-e4cbadc2eed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:16.856378 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0d742-8eda-4093-adb1-e4cbadc2eed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:16.856656 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0d742-8eda-4093-adb1-e4cbadc2eed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:16.856922 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0d742-8eda-4093-adb1-e4cbadc2eed7 admin admin] PATH_INFO: `/v3/users/314d906bb5cd461283e9d17212ffc6ea` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:16.864931 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0d742-8eda-4093-adb1-e4cbadc2eed7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=314d906bb5cd461283e9d17212ffc6ea)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:16.875441 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0d742-8eda-4093-adb1-e4cbadc2eed7 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:16.968786 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c6b87-08b8-46f7-af6d-5c2db9ae46da admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:16.994068 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931e6cb-f480-491d-88c4-c72ea45ee55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:16.995078 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931e6cb-f480-491d-88c4-c72ea45ee55d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:17.000376 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931e6cb-f480-491d-88c4-c72ea45ee55d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:17.000722 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931e6cb-f480-491d-88c4-c72ea45ee55d admin admin] PATH_INFO: `/v3/users/97a810ad31dc4d449efd9238eb00b9fe` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:17.002376 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f931e6cb-f480-491d-88c4-c72ea45ee55d admin admin] RBAC: Authorizing `identity:delete_user(user_id=97a810ad31dc4d449efd9238eb00b9fe)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:17.009791 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f931e6cb-f480-491d-88c4-c72ea45ee55d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:17.086059 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0af0d742-8eda-4093-adb1-e4cbadc2eed7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '314d906bb5cd461283e9d17212ffc6ea'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:17.141593 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0af0d742-8eda-4093-adb1-e4cbadc2eed7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '314d906bb5cd461283e9d17212ffc6ea'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:17.152336 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f931e6cb-f480-491d-88c4-c72ea45ee55d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97a810ad31dc4d449efd9238eb00b9fe'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:17.171327 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f931e6cb-f480-491d-88c4-c72ea45ee55d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97a810ad31dc4d449efd9238eb00b9fe'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:17.188041 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0af0d742-8eda-4093-adb1-e4cbadc2eed7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '314d906bb5cd461283e9d17212ffc6ea'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:17.190947 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f931e6cb-f480-491d-88c4-c72ea45ee55d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97a810ad31dc4d449efd9238eb00b9fe'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:17.212665 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f931e6cb-f480-491d-88c4-c72ea45ee55d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97a810ad31dc4d449efd9238eb00b9fe'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:17.213698 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f931e6cb-f480-491d-88c4-c72ea45ee55d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97a810ad31dc4d449efd9238eb00b9fe'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:17.231337 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 881/1760] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:55:16 2022] DELETE /identity/v3/users/97a810ad31dc4d449efd9238eb00b9fe => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:17.231553 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0af0d742-8eda-4093-adb1-e4cbadc2eed7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '314d906bb5cd461283e9d17212ffc6ea'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:17.232345 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0af0d742-8eda-4093-adb1-e4cbadc2eed7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '314d906bb5cd461283e9d17212ffc6ea'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:17.270034 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 880/1761] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:55:16 2022] DELETE /identity/v3/users/314d906bb5cd461283e9d17212ffc6ea => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:55:17.290916 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0588e0-1f9b-479c-b8a5-102798b11ce0 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:17.313532 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0588e0-1f9b-479c-b8a5-102798b11ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:17.313532 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0588e0-1f9b-479c-b8a5-102798b11ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:17.354921 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-ae0588e0-1f9b-479c-b8a5-102798b11ce0 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:17.356238 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ae0588e0-1f9b-479c-b8a5-102798b11ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:17.446981 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:17.598574 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 882/1762] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:17.713749 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0d742-8eda-4093-adb1-e4cbadc2eed7 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:17.715804 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0af0d742-8eda-4093-adb1-e4cbadc2eed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:17.876768 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0d742-8eda-4093-adb1-e4cbadc2eed7 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:17.887840 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72188774-c11b-4cce-9ae8-f9470d87ae51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:17.888528 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72188774-c11b-4cce-9ae8-f9470d87ae51 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:17.890001 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72188774-c11b-4cce-9ae8-f9470d87ae51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:17.890499 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72188774-c11b-4cce-9ae8-f9470d87ae51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:17.920111 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72188774-c11b-4cce-9ae8-f9470d87ae51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:17.926077 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72188774-c11b-4cce-9ae8-f9470d87ae51 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:17.961958 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 881/1763] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:19.871067 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0588e0-1f9b-479c-b8a5-102798b11ce0 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:19.873177 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ae0588e0-1f9b-479c-b8a5-102798b11ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:19.891723 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0588e0-1f9b-479c-b8a5-102798b11ce0 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:19.907721 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42695d83-2b53-43f8-b35a-6e6e3d2d3fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:19.908666 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42695d83-2b53-43f8-b35a-6e6e3d2d3fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:19.909343 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42695d83-2b53-43f8-b35a-6e6e3d2d3fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:19.909774 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42695d83-2b53-43f8-b35a-6e6e3d2d3fdb admin admin] PATH_INFO: `/v3/projects/7b3560ba4e0c4bf78f3603587233944e` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:19.913393 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42695d83-2b53-43f8-b35a-6e6e3d2d3fdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b3560ba4e0c4bf78f3603587233944e)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:19.915778 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42695d83-2b53-43f8-b35a-6e6e3d2d3fdb admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:20.094956 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-42695d83-2b53-43f8-b35a-6e6e3d2d3fdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b3560ba4e0c4bf78f3603587233944e', 'request_id': 'req-42695d83-2b53-43f8-b35a-6e6e3d2d3fdb'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:20.125138 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-42695d83-2b53-43f8-b35a-6e6e3d2d3fdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b3560ba4e0c4bf78f3603587233944e', 'request_id': 'req-42695d83-2b53-43f8-b35a-6e6e3d2d3fdb'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:20.156961 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-42695d83-2b53-43f8-b35a-6e6e3d2d3fdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b3560ba4e0c4bf78f3603587233944e', 'request_id': 'req-42695d83-2b53-43f8-b35a-6e6e3d2d3fdb'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:20.213776 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-42695d83-2b53-43f8-b35a-6e6e3d2d3fdb admin admin] The token cache is being invalidate because project 7b3560ba4e0c4bf78f3603587233944e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:55:20.217229 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-42695d83-2b53-43f8-b35a-6e6e3d2d3fdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:20.224000 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-42695d83-2b53-43f8-b35a-6e6e3d2d3fdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:20.225735 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 883/1764] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:55:19 2022] DELETE /identity/v3/projects/7b3560ba4e0c4bf78f3603587233944e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:20.231527 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57863e4d-7664-4194-856c-35f30c73ecfa None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:20.232612 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57863e4d-7664-4194-856c-35f30c73ecfa None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:20.233096 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57863e4d-7664-4194-856c-35f30c73ecfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:20.287846 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-57863e4d-7664-4194-856c-35f30c73ecfa None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:20.289081 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-57863e4d-7664-4194-856c-35f30c73ecfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:20.340051 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4e64e-c628-43a4-ace3-e2ef131b15f2 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:20.342241 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4e64e-c628-43a4-ace3-e2ef131b15f2 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:20.342900 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4e64e-c628-43a4-ace3-e2ef131b15f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:20.376507 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:20.404165 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-64e4e64e-c628-43a4-ace3-e2ef131b15f2 None None] MFA Rules not processed for user `1810e64573d145d48b13c774b7a07e60`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:20.410227 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-64e4e64e-c628-43a4-ace3-e2ef131b15f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:20.446598 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 882/1765] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:20.453947 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff930f6-f74c-4852-9784-db21488db9e8 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:20.454450 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff930f6-f74c-4852-9784-db21488db9e8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:20.454905 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff930f6-f74c-4852-9784-db21488db9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:20.514292 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-8ff930f6-f74c-4852-9784-db21488db9e8 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:20.518190 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8ff930f6-f74c-4852-9784-db21488db9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:20.592428 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 883/1766] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:55:20.603189 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff930f6-f74c-4852-9784-db21488db9e8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:20.641056 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 884/1767] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:55:20.659338 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff930f6-f74c-4852-9784-db21488db9e8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:20.693936 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadcaf23-6962-49b8-801f-fefa6b7efd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:20.694833 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadcaf23-6962-49b8-801f-fefa6b7efd8c admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:20.697540 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadcaf23-6962-49b8-801f-fefa6b7efd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:20.698313 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadcaf23-6962-49b8-801f-fefa6b7efd8c admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:20.704552 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadcaf23-6962-49b8-801f-fefa6b7efd8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:20.706520 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadcaf23-6962-49b8-801f-fefa6b7efd8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:20.711731 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadcaf23-6962-49b8-801f-fefa6b7efd8c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:20.749499 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 884/1768] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:55:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:20.754706 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4e64e-c628-43a4-ace3-e2ef131b15f2 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:20.788970 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4e64e-c628-43a4-ace3-e2ef131b15f2 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:20.812792 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdf8d1-f752-434b-9df8-ea2430142f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:20.814095 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdf8d1-f752-434b-9df8-ea2430142f90 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:20.815612 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdf8d1-f752-434b-9df8-ea2430142f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:20.815891 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdf8d1-f752-434b-9df8-ea2430142f90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:20.818171 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdf8d1-f752-434b-9df8-ea2430142f90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:20.827840 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdf8d1-f752-434b-9df8-ea2430142f90 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:20.867586 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadcaf23-6962-49b8-801f-fefa6b7efd8c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:20.870175 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-eadcaf23-6962-49b8-801f-fefa6b7efd8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:20.954392 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadcaf23-6962-49b8-801f-fefa6b7efd8c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:20.959525 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 885/1769] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:55:20 2022] POST /identity/v3/projects => generated 387 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:20.961119 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdf8d1-f752-434b-9df8-ea2430142f90 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:21.100569 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:21.143844 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c9c7d-e114-41e9-a4e5-00f1751a0459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:21.144548 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c9c7d-e114-41e9-a4e5-00f1751a0459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:21.146097 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c9c7d-e114-41e9-a4e5-00f1751a0459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:21.146399 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c9c7d-e114-41e9-a4e5-00f1751a0459 admin admin] PATH_INFO: `/v3/projects/f3e8be96e4ef46b4984210c8967c0b84` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:21.148414 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c9c7d-e114-41e9-a4e5-00f1751a0459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3e8be96e4ef46b4984210c8967c0b84)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:21.158026 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c9c7d-e114-41e9-a4e5-00f1751a0459 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:21.170032 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdf8d1-f752-434b-9df8-ea2430142f90 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:21.183421 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ff651-a526-4282-a1e5-d52c147f7ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:21.184062 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ff651-a526-4282-a1e5-d52c147f7ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:21.184381 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ff651-a526-4282-a1e5-d52c147f7ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:21.184662 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ff651-a526-4282-a1e5-d52c147f7ab1 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:21.185374 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ff651-a526-4282-a1e5-d52c147f7ab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:21.187841 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ff651-a526-4282-a1e5-d52c147f7ab1 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:21.249086 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 886/1770] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:55:20 2022] POST /identity/v3/users => generated 294 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:21.253134 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ff651-a526-4282-a1e5-d52c147f7ab1 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:21.284255 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ff651-a526-4282-a1e5-d52c147f7ab1 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:21.286583 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-257c9c7d-e114-41e9-a4e5-00f1751a0459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3e8be96e4ef46b4984210c8967c0b84', 'request_id': 'req-257c9c7d-e114-41e9-a4e5-00f1751a0459'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:21.307259 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-257c9c7d-e114-41e9-a4e5-00f1751a0459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3e8be96e4ef46b4984210c8967c0b84', 'request_id': 'req-257c9c7d-e114-41e9-a4e5-00f1751a0459'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:21.328043 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-257c9c7d-e114-41e9-a4e5-00f1751a0459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3e8be96e4ef46b4984210c8967c0b84', 'request_id': 'req-257c9c7d-e114-41e9-a4e5-00f1751a0459'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:21.368429 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-257c9c7d-e114-41e9-a4e5-00f1751a0459 admin admin] The token cache is being invalidate because project f3e8be96e4ef46b4984210c8967c0b84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:55:21.370165 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-257c9c7d-e114-41e9-a4e5-00f1751a0459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:21.375011 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-257c9c7d-e114-41e9-a4e5-00f1751a0459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:21.380920 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 885/1771] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:55:20 2022] DELETE /identity/v3/projects/f3e8be96e4ef46b4984210c8967c0b84 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:21.384807 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c9c7d-e114-41e9-a4e5-00f1751a0459 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:21.388662 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-257c9c7d-e114-41e9-a4e5-00f1751a0459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:21.429348 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06332bd-c2cf-40ab-b6b9-20254b47a925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:21.430715 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06332bd-c2cf-40ab-b6b9-20254b47a925 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:21.431028 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06332bd-c2cf-40ab-b6b9-20254b47a925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:21.431306 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06332bd-c2cf-40ab-b6b9-20254b47a925 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:21.432335 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06332bd-c2cf-40ab-b6b9-20254b47a925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:21.438589 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06332bd-c2cf-40ab-b6b9-20254b47a925 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:21.464803 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 887/1772] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:21.465767 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06332bd-c2cf-40ab-b6b9-20254b47a925 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:21.468276 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c06332bd-c2cf-40ab-b6b9-20254b47a925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:21.484644 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06332bd-c2cf-40ab-b6b9-20254b47a925 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:21.490625 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed80c31-f4cb-4249-adf1-d77086ced214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:21.492589 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed80c31-f4cb-4249-adf1-d77086ced214 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:21.493058 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed80c31-f4cb-4249-adf1-d77086ced214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:21.493537 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed80c31-f4cb-4249-adf1-d77086ced214 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:21.494463 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed80c31-f4cb-4249-adf1-d77086ced214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:21.496932 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed80c31-f4cb-4249-adf1-d77086ced214 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:21.517886 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 888/1773] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:21.520992 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed80c31-f4cb-4249-adf1-d77086ced214 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:21.556141 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed80c31-f4cb-4249-adf1-d77086ced214 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:21.563201 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36e540-06fd-4c34-b6e9-b58d10fc8d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:21.564688 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36e540-06fd-4c34-b6e9-b58d10fc8d6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:21.565323 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36e540-06fd-4c34-b6e9-b58d10fc8d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:21.565758 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36e540-06fd-4c34-b6e9-b58d10fc8d6a admin admin] PATH_INFO: `/v3/projects/8b69de39362e4942b6e2285f0f32dd44/users/fa4734de2c5241c798497732a13e4e64/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:21.587044 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:21.592249 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36e540-06fd-4c34-b6e9-b58d10fc8d6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b69de39362e4942b6e2285f0f32dd44, user_id=fa4734de2c5241c798497732a13e4e64, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:21.598084 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36e540-06fd-4c34-b6e9-b58d10fc8d6a admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:21.622558 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 889/1774] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:21 2022] PUT /identity/v3/projects/8b69de39362e4942b6e2285f0f32dd44/users/fa4734de2c5241c798497732a13e4e64/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:21.634962 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddcc8a-3e5c-4daa-94e1-ec2dec0b5330 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:21.635481 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddcc8a-3e5c-4daa-94e1-ec2dec0b5330 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:21.635972 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddcc8a-3e5c-4daa-94e1-ec2dec0b5330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:21.641569 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c9c7d-e114-41e9-a4e5-00f1751a0459 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:21.716899 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-08ddcc8a-3e5c-4daa-94e1-ec2dec0b5330 None None] MFA Rules not processed for user `fa4734de2c5241c798497732a13e4e64`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:21.721119 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-08ddcc8a-3e5c-4daa-94e1-ec2dec0b5330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:21.822643 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19148668-d2c7-40de-bc24-dfd590e37354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:21.823380 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19148668-d2c7-40de-bc24-dfd590e37354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:21.823654 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19148668-d2c7-40de-bc24-dfd590e37354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:21.824092 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19148668-d2c7-40de-bc24-dfd590e37354 admin admin] PATH_INFO: `/v3/users/630978ed5dca422c967c0aac2c8eb0de` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:21.825135 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19148668-d2c7-40de-bc24-dfd590e37354 admin admin] RBAC: Authorizing `identity:delete_user(user_id=630978ed5dca422c967c0aac2c8eb0de)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:21.827199 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19148668-d2c7-40de-bc24-dfd590e37354 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:21.977544 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 890/1775] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:21.981162 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ddcc8a-3e5c-4daa-94e1-ec2dec0b5330 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:22.004004 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-19148668-d2c7-40de-bc24-dfd590e37354 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '630978ed5dca422c967c0aac2c8eb0de'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:22.022776 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ddcc8a-3e5c-4daa-94e1-ec2dec0b5330 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:22.038397 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8335b0-9d87-46fe-ba02-7c875d9e0c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:22.038790 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8335b0-9d87-46fe-ba02-7c875d9e0c2d admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:22.039095 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8335b0-9d87-46fe-ba02-7c875d9e0c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:22.039374 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8335b0-9d87-46fe-ba02-7c875d9e0c2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:22.040166 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8335b0-9d87-46fe-ba02-7c875d9e0c2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:22.049384 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8335b0-9d87-46fe-ba02-7c875d9e0c2d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:22.053446 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-19148668-d2c7-40de-bc24-dfd590e37354 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '630978ed5dca422c967c0aac2c8eb0de'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:22.071397 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-19148668-d2c7-40de-bc24-dfd590e37354 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '630978ed5dca422c967c0aac2c8eb0de'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:22.091830 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:22.098982 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-19148668-d2c7-40de-bc24-dfd590e37354 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '630978ed5dca422c967c0aac2c8eb0de'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:22.100578 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-19148668-d2c7-40de-bc24-dfd590e37354 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '630978ed5dca422c967c0aac2c8eb0de'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:22.129802 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 886/1776] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:55:21 2022] DELETE /identity/v3/users/630978ed5dca422c967c0aac2c8eb0de => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:22.155304 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 891/1777] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:55:21 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:22.156736 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19148668-d2c7-40de-bc24-dfd590e37354 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:22.158819 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-19148668-d2c7-40de-bc24-dfd590e37354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:22.292237 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19148668-d2c7-40de-bc24-dfd590e37354 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:22.332540 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:22.378601 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7cfc0-baee-4ca1-89ea-81eaf01b8a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:22.379715 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7cfc0-baee-4ca1-89ea-81eaf01b8a0c admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:22.380234 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7cfc0-baee-4ca1-89ea-81eaf01b8a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:22.380720 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7cfc0-baee-4ca1-89ea-81eaf01b8a0c admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:22.381591 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7cfc0-baee-4ca1-89ea-81eaf01b8a0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:22.383995 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7cfc0-baee-4ca1-89ea-81eaf01b8a0c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:22.411343 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 887/1778] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:55:22 2022] POST /identity/v3/users => generated 293 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:22.417620 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8335b0-9d87-46fe-ba02-7c875d9e0c2d admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:22.429613 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8335b0-9d87-46fe-ba02-7c875d9e0c2d admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:22.435471 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98c8ec-2f27-40bc-8cf4-cd2c4ec5abc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:22.436408 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98c8ec-2f27-40bc-8cf4-cd2c4ec5abc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:22.436805 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98c8ec-2f27-40bc-8cf4-cd2c4ec5abc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:22.437217 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98c8ec-2f27-40bc-8cf4-cd2c4ec5abc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:22.437897 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98c8ec-2f27-40bc-8cf4-cd2c4ec5abc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:22.439815 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98c8ec-2f27-40bc-8cf4-cd2c4ec5abc1 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:22.451872 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 892/1779] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:22.455682 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7cfc0-baee-4ca1-89ea-81eaf01b8a0c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:22.471286 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7cfc0-baee-4ca1-89ea-81eaf01b8a0c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:22.480634 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998adee9-f340-4a63-bb1d-527c2bec4543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:22.481389 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998adee9-f340-4a63-bb1d-527c2bec4543 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:22.481676 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998adee9-f340-4a63-bb1d-527c2bec4543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:22.482010 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998adee9-f340-4a63-bb1d-527c2bec4543 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:22.482967 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998adee9-f340-4a63-bb1d-527c2bec4543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:22.485298 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998adee9-f340-4a63-bb1d-527c2bec4543 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:22.513620 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98c8ec-2f27-40bc-8cf4-cd2c4ec5abc1 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:22.523781 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 888/1780] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:22.528233 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98c8ec-2f27-40bc-8cf4-cd2c4ec5abc1 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:22.534465 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ef644-c390-4c79-b9d8-d6aacc93ac39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:22.535245 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ef644-c390-4c79-b9d8-d6aacc93ac39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:22.535688 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ef644-c390-4c79-b9d8-d6aacc93ac39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:22.535965 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ef644-c390-4c79-b9d8-d6aacc93ac39 admin admin] PATH_INFO: `/v3/projects/aa486a31f8474a979afb23034842496e/users/fe3789fbc33949a69da53740ec93c9ff/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:22.561088 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ef644-c390-4c79-b9d8-d6aacc93ac39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa486a31f8474a979afb23034842496e, user_id=fe3789fbc33949a69da53740ec93c9ff, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:22.571077 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ef644-c390-4c79-b9d8-d6aacc93ac39 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:22.616118 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae51cd3-5f80-437a-9715-b01c813fac72 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:22.616624 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae51cd3-5f80-437a-9715-b01c813fac72 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:22.616961 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae51cd3-5f80-437a-9715-b01c813fac72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:22.621314 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 893/1781] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:22 2022] PUT /identity/v3/projects/aa486a31f8474a979afb23034842496e/users/fe3789fbc33949a69da53740ec93c9ff/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:22.666299 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-aae51cd3-5f80-437a-9715-b01c813fac72 None None] MFA Rules not processed for user `fe3789fbc33949a69da53740ec93c9ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:22.681493 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-aae51cd3-5f80-437a-9715-b01c813fac72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:22.796012 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 889/1782] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:22.803057 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3df51-40af-41ac-8b75-60f5ddfe6083 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:22.803402 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3df51-40af-41ac-8b75-60f5ddfe6083 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:22.803757 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3df51-40af-41ac-8b75-60f5ddfe6083 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:22.805260 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ef644-c390-4c79-b9d8-d6aacc93ac39 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:22.805736 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 890/1783] 10.222.0.52 () {54 vars in 921 bytes} [Sun Aug 28 00:55:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:55:22.840690 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c719cb-d3f2-4b33-9e57-4f0cd30f6486 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:22.841285 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c719cb-d3f2-4b33-9e57-4f0cd30f6486 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:22.841920 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c719cb-d3f2-4b33-9e57-4f0cd30f6486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:22.885923 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a6c719cb-d3f2-4b33-9e57-4f0cd30f6486 None None] MFA Rules not processed for user `f890ff4e7807477db7f17c2f6434dce8`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:22.891453 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a6c719cb-d3f2-4b33-9e57-4f0cd30f6486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:22.973645 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ef644-c390-4c79-b9d8-d6aacc93ac39 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:22.984709 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ece9f-6f08-484f-bf85-88bc950bd7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:22.987517 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ece9f-6f08-484f-bf85-88bc950bd7e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:22.987874 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ece9f-6f08-484f-bf85-88bc950bd7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:22.988813 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ece9f-6f08-484f-bf85-88bc950bd7e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:22.990401 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ece9f-6f08-484f-bf85-88bc950bd7e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:22.995129 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ece9f-6f08-484f-bf85-88bc950bd7e7 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:23.069425 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 894/1784] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:55:22 2022] POST /identity/v3/projects => generated 385 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:23.076099 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ece9f-6f08-484f-bf85-88bc950bd7e7 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:23.080969 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 891/1785] 10.222.0.52 () {58 vars in 1018 bytes} [Sun Aug 28 00:55:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:23.163137 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ece9f-6f08-484f-bf85-88bc950bd7e7 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:23.171688 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae40a2-722b-41e6-b90c-a14556d72130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:23.173670 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae40a2-722b-41e6-b90c-a14556d72130 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:23.174289 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae40a2-722b-41e6-b90c-a14556d72130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:23.178242 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae40a2-722b-41e6-b90c-a14556d72130 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:23.178920 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ae40a2-722b-41e6-b90c-a14556d72130 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:23.180953 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ae40a2-722b-41e6-b90c-a14556d72130 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:23.211512 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 895/1786] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:55:23 2022] POST /identity/v3/users => generated 299 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:23.214895 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c719cb-d3f2-4b33-9e57-4f0cd30f6486 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:23.229384 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c719cb-d3f2-4b33-9e57-4f0cd30f6486 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:23.236743 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e95557-8351-4fdf-9894-a343f7e0d969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:23.242270 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e95557-8351-4fdf-9894-a343f7e0d969 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:23.242681 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e95557-8351-4fdf-9894-a343f7e0d969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:23.243119 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e95557-8351-4fdf-9894-a343f7e0d969 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:23.243925 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e95557-8351-4fdf-9894-a343f7e0d969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:23.245912 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e95557-8351-4fdf-9894-a343f7e0d969 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:23.259194 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae40a2-722b-41e6-b90c-a14556d72130 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:23.261345 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a4ae40a2-722b-41e6-b90c-a14556d72130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:23.265049 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 892/1787] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:23.266203 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e95557-8351-4fdf-9894-a343f7e0d969 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:23.295076 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e95557-8351-4fdf-9894-a343f7e0d969 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:23.303646 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0336f0-8f9f-4b20-9983-49e7f810bec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:23.304315 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0336f0-8f9f-4b20-9983-49e7f810bec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:23.304590 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0336f0-8f9f-4b20-9983-49e7f810bec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:23.304859 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0336f0-8f9f-4b20-9983-49e7f810bec4 admin admin] PATH_INFO: `/v3/projects/4da777624e2f4f5e9432b7ff0842cad2/users/07b9f59bef454fb19a5ceb5703613cc5/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:23.312183 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:23.316286 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:23.328565 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0336f0-8f9f-4b20-9983-49e7f810bec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da777624e2f4f5e9432b7ff0842cad2, user_id=07b9f59bef454fb19a5ceb5703613cc5, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:23.331940 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0336f0-8f9f-4b20-9983-49e7f810bec4 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:23.348953 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 893/1788] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:23 2022] PUT /identity/v3/projects/4da777624e2f4f5e9432b7ff0842cad2/users/07b9f59bef454fb19a5ceb5703613cc5/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:23.353686 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0336f0-8f9f-4b20-9983-49e7f810bec4 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:23.368180 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae40a2-722b-41e6-b90c-a14556d72130 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:23.429308 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0336f0-8f9f-4b20-9983-49e7f810bec4 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:23.435939 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fdccec-e73d-4272-b2f3-f3eeafe2c044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:23.436679 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdccec-e73d-4272-b2f3-f3eeafe2c044 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:23.437118 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdccec-e73d-4272-b2f3-f3eeafe2c044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:23.437539 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdccec-e73d-4272-b2f3-f3eeafe2c044 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:23.438132 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fdccec-e73d-4272-b2f3-f3eeafe2c044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:23.439825 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fdccec-e73d-4272-b2f3-f3eeafe2c044 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:23.449453 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93751435-8961-4caf-8619-f642601fc2e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:23.450334 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93751435-8961-4caf-8619-f642601fc2e6 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:23.450679 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93751435-8961-4caf-8619-f642601fc2e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:23.451486 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93751435-8961-4caf-8619-f642601fc2e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:23.454028 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 894/1789] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:23.458722 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fdccec-e73d-4272-b2f3-f3eeafe2c044 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:23.462644 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93751435-8961-4caf-8619-f642601fc2e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:23.464487 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93751435-8961-4caf-8619-f642601fc2e6 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:23.469099 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fdccec-e73d-4272-b2f3-f3eeafe2c044 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:23.474009 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0fda2-3226-4048-b11a-77c8a809c59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:23.474667 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0fda2-3226-4048-b11a-77c8a809c59c admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:23.475249 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0fda2-3226-4048-b11a-77c8a809c59c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:23.475521 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0fda2-3226-4048-b11a-77c8a809c59c admin admin] PATH_INFO: `/v3/projects/4da777624e2f4f5e9432b7ff0842cad2/users/07b9f59bef454fb19a5ceb5703613cc5/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:23.476299 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 896/1790] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:23.478027 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0fda2-3226-4048-b11a-77c8a809c59c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da777624e2f4f5e9432b7ff0842cad2, user_id=07b9f59bef454fb19a5ceb5703613cc5, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:23.481493 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0fda2-3226-4048-b11a-77c8a809c59c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:23.494729 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 895/1791] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:23 2022] PUT /identity/v3/projects/4da777624e2f4f5e9432b7ff0842cad2/users/07b9f59bef454fb19a5ceb5703613cc5/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:23.505227 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a89d8-fb1f-4ad8-8689-d15f08d7aa98 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:23.505460 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a89d8-fb1f-4ad8-8689-d15f08d7aa98 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:23.505734 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a89d8-fb1f-4ad8-8689-d15f08d7aa98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:23.570552 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-675a89d8-fb1f-4ad8-8689-d15f08d7aa98 None None] MFA Rules not processed for user `07b9f59bef454fb19a5ceb5703613cc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:23.572051 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-675a89d8-fb1f-4ad8-8689-d15f08d7aa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:23.718327 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 897/1792] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:23.729197 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0fda2-3226-4048-b11a-77c8a809c59c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:23.731888 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-67b0fda2-3226-4048-b11a-77c8a809c59c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:23.763985 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a89d8-fb1f-4ad8-8689-d15f08d7aa98 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:23.767188 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-675a89d8-fb1f-4ad8-8689-d15f08d7aa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:23.871885 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:23.874612 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0fda2-3226-4048-b11a-77c8a809c59c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:23.887041 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c932dc-871d-4eb0-a53d-ab70fb46df9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:23.889228 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c932dc-871d-4eb0-a53d-ab70fb46df9c service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:23.889591 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c932dc-871d-4eb0-a53d-ab70fb46df9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:23.892357 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c932dc-871d-4eb0-a53d-ab70fb46df9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:23.914923 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c932dc-871d-4eb0-a53d-ab70fb46df9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:23.917620 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a89d8-fb1f-4ad8-8689-d15f08d7aa98 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:23.918693 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c932dc-871d-4eb0-a53d-ab70fb46df9c service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:23.923809 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c65efe-17d3-4d0c-be47-c019291c15b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:23.924453 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c65efe-17d3-4d0c-be47-c019291c15b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:23.924734 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c65efe-17d3-4d0c-be47-c019291c15b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:23.925018 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c65efe-17d3-4d0c-be47-c019291c15b2 admin admin] PATH_INFO: `/v3/projects/c815d7710a2b4eca97827bd91e9d8b55` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:23.927066 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c65efe-17d3-4d0c-be47-c019291c15b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c815d7710a2b4eca97827bd91e9d8b55)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:23.929355 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c65efe-17d3-4d0c-be47-c019291c15b2 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:23.942081 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 896/1793] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:23 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:24.031859 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-79c65efe-17d3-4d0c-be47-c019291c15b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c815d7710a2b4eca97827bd91e9d8b55', 'request_id': 'req-79c65efe-17d3-4d0c-be47-c019291c15b2'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:24.048263 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-79c65efe-17d3-4d0c-be47-c019291c15b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c815d7710a2b4eca97827bd91e9d8b55', 'request_id': 'req-79c65efe-17d3-4d0c-be47-c019291c15b2'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:24.060545 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-79c65efe-17d3-4d0c-be47-c019291c15b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c815d7710a2b4eca97827bd91e9d8b55', 'request_id': 'req-79c65efe-17d3-4d0c-be47-c019291c15b2'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:24.086462 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-79c65efe-17d3-4d0c-be47-c019291c15b2 admin admin] The token cache is being invalidate because project c815d7710a2b4eca97827bd91e9d8b55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:55:24.086989 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-79c65efe-17d3-4d0c-be47-c019291c15b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:24.088359 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-79c65efe-17d3-4d0c-be47-c019291c15b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:24.092154 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 898/1794] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:55:23 2022] DELETE /identity/v3/projects/c815d7710a2b4eca97827bd91e9d8b55 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:24.100480 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594de922-fa5f-4154-b431-69e6af212292 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:24.100914 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594de922-fa5f-4154-b431-69e6af212292 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:24.101304 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594de922-fa5f-4154-b431-69e6af212292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:24.143013 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-594de922-fa5f-4154-b431-69e6af212292 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:24.145154 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-594de922-fa5f-4154-b431-69e6af212292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:24.338498 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 897/1795] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:24.339469 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fd03b-cb8a-4f73-a8d1-b0f555934bc1 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:24.339469 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fd03b-cb8a-4f73-a8d1-b0f555934bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:24.339469 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fd03b-cb8a-4f73-a8d1-b0f555934bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:24.389036 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594de922-fa5f-4154-b431-69e6af212292 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:24.390714 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-594de922-fa5f-4154-b431-69e6af212292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:24.399867 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-e27fd03b-cb8a-4f73-a8d1-b0f555934bc1 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:24.401198 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e27fd03b-cb8a-4f73-a8d1-b0f555934bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:24.407306 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594de922-fa5f-4154-b431-69e6af212292 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:24.415926 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 899/1796] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:55:24.420887 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fd03b-cb8a-4f73-a8d1-b0f555934bc1 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:24.423708 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3e01e-487d-4a92-8588-bdb1fd1801a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:24.425812 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3e01e-487d-4a92-8588-bdb1fd1801a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:24.426949 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3e01e-487d-4a92-8588-bdb1fd1801a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:24.427286 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3e01e-487d-4a92-8588-bdb1fd1801a1 admin admin] PATH_INFO: `/v3/users/bb9a97f64c184e258a45e1137e405d68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:24.428740 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b3e01e-487d-4a92-8588-bdb1fd1801a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb9a97f64c184e258a45e1137e405d68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:24.432714 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b3e01e-487d-4a92-8588-bdb1fd1801a1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:24.440804 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:24.447448 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fd03b-cb8a-4f73-a8d1-b0f555934bc1 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:24.485795 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6237f4d-ff03-4519-a407-2edfae45a6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:24.486610 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6237f4d-ff03-4519-a407-2edfae45a6bf admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:24.489940 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6237f4d-ff03-4519-a407-2edfae45a6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:24.490665 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6237f4d-ff03-4519-a407-2edfae45a6bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:24.491748 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-74b3e01e-487d-4a92-8588-bdb1fd1801a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb9a97f64c184e258a45e1137e405d68'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:24.493243 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6237f4d-ff03-4519-a407-2edfae45a6bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:24.494514 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6237f4d-ff03-4519-a407-2edfae45a6bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:24.497057 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6237f4d-ff03-4519-a407-2edfae45a6bf admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:24.507704 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-74b3e01e-487d-4a92-8588-bdb1fd1801a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb9a97f64c184e258a45e1137e405d68'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:24.517017 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-74b3e01e-487d-4a92-8588-bdb1fd1801a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb9a97f64c184e258a45e1137e405d68'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:24.528940 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-74b3e01e-487d-4a92-8588-bdb1fd1801a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb9a97f64c184e258a45e1137e405d68'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:24.530289 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-74b3e01e-487d-4a92-8588-bdb1fd1801a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb9a97f64c184e258a45e1137e405d68'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:24.544652 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 900/1797] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:24.551891 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6237f4d-ff03-4519-a407-2edfae45a6bf admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:24.557694 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e6237f4d-ff03-4519-a407-2edfae45a6bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:24.568621 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 898/1798] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:55:24 2022] DELETE /identity/v3/users/bb9a97f64c184e258a45e1137e405d68 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:55:24.573274 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50abc14-f843-412a-8a77-d3f3db8e5cf1 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:24.576896 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50abc14-f843-412a-8a77-d3f3db8e5cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:24.578397 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50abc14-f843-412a-8a77-d3f3db8e5cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:24.592617 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6237f4d-ff03-4519-a407-2edfae45a6bf admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:24.625069 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e50abc14-f843-412a-8a77-d3f3db8e5cf1 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:24.626765 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e50abc14-f843-412a-8a77-d3f3db8e5cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:24.727371 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 899/1799] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:24.744066 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018bd4b-c068-42c0-ae3d-e5f2514d2c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:24.746084 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018bd4b-c068-42c0-ae3d-e5f2514d2c3b admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:24.746819 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018bd4b-c068-42c0-ae3d-e5f2514d2c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:24.747146 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018bd4b-c068-42c0-ae3d-e5f2514d2c3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:24.747921 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018bd4b-c068-42c0-ae3d-e5f2514d2c3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:24.750559 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018bd4b-c068-42c0-ae3d-e5f2514d2c3b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:24.760378 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50abc14-f843-412a-8a77-d3f3db8e5cf1 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:24.762903 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e50abc14-f843-412a-8a77-d3f3db8e5cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:24.814149 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 901/1800] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:55:24 2022] POST /identity/v3/projects => generated 381 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:24.816315 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018bd4b-c068-42c0-ae3d-e5f2514d2c3b admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:24.904852 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:24.961112 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50abc14-f843-412a-8a77-d3f3db8e5cf1 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:25.003288 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018bd4b-c068-42c0-ae3d-e5f2514d2c3b admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:25.011246 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3557b-daa9-4fc6-ad6f-c0f9220ceaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:25.012241 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3557b-daa9-4fc6-ad6f-c0f9220ceaf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:25.012731 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3557b-daa9-4fc6-ad6f-c0f9220ceaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:25.013156 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3557b-daa9-4fc6-ad6f-c0f9220ceaf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:25.014334 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3557b-daa9-4fc6-ad6f-c0f9220ceaf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:25.017952 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3557b-daa9-4fc6-ad6f-c0f9220ceaf1 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:25.061345 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 902/1801] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:55:24 2022] POST /identity/v3/users => generated 291 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:25.066656 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3557b-daa9-4fc6-ad6f-c0f9220ceaf1 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:25.070294 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:25.083118 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3557b-daa9-4fc6-ad6f-c0f9220ceaf1 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:25.096894 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8435286-7442-4890-b4c7-7219c9ef1867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:25.098854 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e564f91-40f7-4397-bfc6-bda561cf5487 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:25.099474 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8435286-7442-4890-b4c7-7219c9ef1867 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:25.101635 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8435286-7442-4890-b4c7-7219c9ef1867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:25.101785 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e564f91-40f7-4397-bfc6-bda561cf5487 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:25.101785 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e564f91-40f7-4397-bfc6-bda561cf5487 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:25.101994 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8435286-7442-4890-b4c7-7219c9ef1867 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:25.102632 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8435286-7442-4890-b4c7-7219c9ef1867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:25.106793 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8435286-7442-4890-b4c7-7219c9ef1867 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:25.119454 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e564f91-40f7-4397-bfc6-bda561cf5487 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:25.142075 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 903/1802] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:25.143074 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8435286-7442-4890-b4c7-7219c9ef1867 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:25.143896 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e564f91-40f7-4397-bfc6-bda561cf5487 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:25.149089 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e564f91-40f7-4397-bfc6-bda561cf5487 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:25.172721 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8435286-7442-4890-b4c7-7219c9ef1867 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:25.185225 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3186f4-baa9-40fb-a943-3610361a3a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:25.194340 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3186f4-baa9-40fb-a943-3610361a3a44 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:25.194340 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3186f4-baa9-40fb-a943-3610361a3a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:25.194340 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3186f4-baa9-40fb-a943-3610361a3a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:25.194340 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3186f4-baa9-40fb-a943-3610361a3a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:25.194730 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 900/1803] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:25.194730 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e564f91-40f7-4397-bfc6-bda561cf5487 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:25.194910 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3186f4-baa9-40fb-a943-3610361a3a44 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:25.194998 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8e564f91-40f7-4397-bfc6-bda561cf5487 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:25.204938 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 904/1804] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:25.210443 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3186f4-baa9-40fb-a943-3610361a3a44 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:25.234017 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3186f4-baa9-40fb-a943-3610361a3a44 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:25.248719 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a378da-6b46-44aa-b913-a129fc6fb3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:25.250081 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a378da-6b46-44aa-b913-a129fc6fb3dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:25.250469 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a378da-6b46-44aa-b913-a129fc6fb3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:25.250849 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a378da-6b46-44aa-b913-a129fc6fb3dd admin admin] PATH_INFO: `/v3/projects/210b7b58d4ec4231a3fe788185ffc1f5/users/d4f1e68b74e34352ac22213f841133fb/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:25.274984 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a378da-6b46-44aa-b913-a129fc6fb3dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=210b7b58d4ec4231a3fe788185ffc1f5, user_id=d4f1e68b74e34352ac22213f841133fb, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:25.280135 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a378da-6b46-44aa-b913-a129fc6fb3dd admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:25.299378 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 905/1805] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:25 2022] PUT /identity/v3/projects/210b7b58d4ec4231a3fe788185ffc1f5/users/d4f1e68b74e34352ac22213f841133fb/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:25.312742 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f06c9-456b-4306-97b5-330d62f78238 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:25.315205 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f06c9-456b-4306-97b5-330d62f78238 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:25.316836 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f06c9-456b-4306-97b5-330d62f78238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:25.318967 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e564f91-40f7-4397-bfc6-bda561cf5487 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:25.393303 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-dc5f06c9-456b-4306-97b5-330d62f78238 None None] MFA Rules not processed for user `d4f1e68b74e34352ac22213f841133fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:25.394549 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-dc5f06c9-456b-4306-97b5-330d62f78238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:25.412899 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68974f-b1e9-4678-af50-10691339fe97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:25.414714 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68974f-b1e9-4678-af50-10691339fe97 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:25.415329 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68974f-b1e9-4678-af50-10691339fe97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:25.416273 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68974f-b1e9-4678-af50-10691339fe97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:25.419902 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5d68974f-b1e9-4678-af50-10691339fe97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:25.516859 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68974f-b1e9-4678-af50-10691339fe97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:25.518561 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68974f-b1e9-4678-af50-10691339fe97 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:25.526388 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 906/1806] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:55:25.531068 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f06c9-456b-4306-97b5-330d62f78238 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:25.544632 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 901/1807] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:25 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:25.638843 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f06c9-456b-4306-97b5-330d62f78238 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:25.643700 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a1dcc-f230-4d66-8057-fefbc7283110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:25.644363 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a1dcc-f230-4d66-8057-fefbc7283110 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:25.644648 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a1dcc-f230-4d66-8057-fefbc7283110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:25.644913 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a1dcc-f230-4d66-8057-fefbc7283110 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:25.645556 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a1dcc-f230-4d66-8057-fefbc7283110 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:25.647554 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a1dcc-f230-4d66-8057-fefbc7283110 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:25.659541 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:25.685707 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 907/1808] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:55:25 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:25.686928 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68974f-b1e9-4678-af50-10691339fe97 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:25.698360 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68974f-b1e9-4678-af50-10691339fe97 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:25.767062 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:25.791942 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74475a1-b0ab-402e-bfc9-84c600c01984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:25.794294 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74475a1-b0ab-402e-bfc9-84c600c01984 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:25.794608 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74475a1-b0ab-402e-bfc9-84c600c01984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:25.794889 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74475a1-b0ab-402e-bfc9-84c600c01984 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:25.795558 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74475a1-b0ab-402e-bfc9-84c600c01984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:25.797733 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74475a1-b0ab-402e-bfc9-84c600c01984 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:25.829458 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 902/1809] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:55:25 2022] POST /identity/v3/users => generated 297 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:55:25.831296 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a1dcc-f230-4d66-8057-fefbc7283110 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:25.843213 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a1dcc-f230-4d66-8057-fefbc7283110 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:25.849655 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d324301-4e13-4719-9194-6c030ec296eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:25.850746 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d324301-4e13-4719-9194-6c030ec296eb admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:25.851120 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d324301-4e13-4719-9194-6c030ec296eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:25.851537 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d324301-4e13-4719-9194-6c030ec296eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:25.852404 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d324301-4e13-4719-9194-6c030ec296eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:25.854416 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d324301-4e13-4719-9194-6c030ec296eb admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:25.870778 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 908/1810] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:25.875230 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74475a1-b0ab-402e-bfc9-84c600c01984 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:25.888303 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74475a1-b0ab-402e-bfc9-84c600c01984 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:25.894355 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d759d8-9b95-4414-9da8-c496ca6c7d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:25.895039 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d759d8-9b95-4414-9da8-c496ca6c7d43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:25.895318 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d759d8-9b95-4414-9da8-c496ca6c7d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:25.895591 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d759d8-9b95-4414-9da8-c496ca6c7d43 admin admin] PATH_INFO: `/v3/projects/acc6aa53a63748069d92244c50f9105e/users/b4309f99e5d74c8ba15395f61067c435/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:25.934240 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d759d8-9b95-4414-9da8-c496ca6c7d43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acc6aa53a63748069d92244c50f9105e, user_id=b4309f99e5d74c8ba15395f61067c435, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:25.941279 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d759d8-9b95-4414-9da8-c496ca6c7d43 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:25.971619 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 903/1811] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:25 2022] PUT /identity/v3/projects/acc6aa53a63748069d92244c50f9105e/users/b4309f99e5d74c8ba15395f61067c435/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:25.975436 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d324301-4e13-4719-9194-6c030ec296eb admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:25.990677 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d324301-4e13-4719-9194-6c030ec296eb admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:26.064923 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0891b-7042-450a-a06b-42c172d9c81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:26.065601 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0891b-7042-450a-a06b-42c172d9c81c admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:26.066312 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0891b-7042-450a-a06b-42c172d9c81c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:26.066312 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0891b-7042-450a-a06b-42c172d9c81c admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:26.066749 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0891b-7042-450a-a06b-42c172d9c81c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:26.069878 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0891b-7042-450a-a06b-42c172d9c81c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:26.088182 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 909/1812] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:26.089730 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d759d8-9b95-4414-9da8-c496ca6c7d43 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:26.098963 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0891b-7042-450a-a06b-42c172d9c81c admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:26.100940 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d759d8-9b95-4414-9da8-c496ca6c7d43 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:26.101066 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d0f0891b-7042-450a-a06b-42c172d9c81c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:26.105822 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16429efb-8b2b-41b7-9e8f-fa5829049c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:26.107031 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16429efb-8b2b-41b7-9e8f-fa5829049c2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:26.107031 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16429efb-8b2b-41b7-9e8f-fa5829049c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:26.107031 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16429efb-8b2b-41b7-9e8f-fa5829049c2a admin admin] PATH_INFO: `/v3/projects/acc6aa53a63748069d92244c50f9105e/users/b4309f99e5d74c8ba15395f61067c435/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:26.108941 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16429efb-8b2b-41b7-9e8f-fa5829049c2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=acc6aa53a63748069d92244c50f9105e, user_id=b4309f99e5d74c8ba15395f61067c435, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:26.111656 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16429efb-8b2b-41b7-9e8f-fa5829049c2a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:26.116068 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0891b-7042-450a-a06b-42c172d9c81c admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:26.126976 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 904/1813] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:26 2022] PUT /identity/v3/projects/acc6aa53a63748069d92244c50f9105e/users/b4309f99e5d74c8ba15395f61067c435/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:26.135778 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23116580-fd76-45cb-89de-32ab110e1c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:26.136445 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23116580-fd76-45cb-89de-32ab110e1c9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:26.136749 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23116580-fd76-45cb-89de-32ab110e1c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:26.137070 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23116580-fd76-45cb-89de-32ab110e1c9c admin admin] PATH_INFO: `/v3/projects/5330be95cf364ed2b49fdd93b8c70a7a` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:26.138496 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23116580-fd76-45cb-89de-32ab110e1c9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5330be95cf364ed2b49fdd93b8c70a7a)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:26.140712 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23116580-fd76-45cb-89de-32ab110e1c9c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:26.140985 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de451a-3ea2-4b8b-8a0a-ce2e909f52d5 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:26.141368 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de451a-3ea2-4b8b-8a0a-ce2e909f52d5 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:26.141739 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de451a-3ea2-4b8b-8a0a-ce2e909f52d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:26.176721 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-82de451a-3ea2-4b8b-8a0a-ce2e909f52d5 None None] MFA Rules not processed for user `b4309f99e5d74c8ba15395f61067c435`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:26.178428 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-82de451a-3ea2-4b8b-8a0a-ce2e909f52d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:26.200647 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-23116580-fd76-45cb-89de-32ab110e1c9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5330be95cf364ed2b49fdd93b8c70a7a', 'request_id': 'req-23116580-fd76-45cb-89de-32ab110e1c9c'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:26.209321 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-23116580-fd76-45cb-89de-32ab110e1c9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5330be95cf364ed2b49fdd93b8c70a7a', 'request_id': 'req-23116580-fd76-45cb-89de-32ab110e1c9c'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:26.221423 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-23116580-fd76-45cb-89de-32ab110e1c9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5330be95cf364ed2b49fdd93b8c70a7a', 'request_id': 'req-23116580-fd76-45cb-89de-32ab110e1c9c'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:26.238282 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-23116580-fd76-45cb-89de-32ab110e1c9c admin admin] The token cache is being invalidate because project 5330be95cf364ed2b49fdd93b8c70a7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:55:26.238642 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-23116580-fd76-45cb-89de-32ab110e1c9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:26.239407 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-23116580-fd76-45cb-89de-32ab110e1c9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:26.241042 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 910/1814] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:55:26 2022] DELETE /identity/v3/projects/5330be95cf364ed2b49fdd93b8c70a7a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:55:26.246853 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23116580-fd76-45cb-89de-32ab110e1c9c admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:26.248299 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-23116580-fd76-45cb-89de-32ab110e1c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:26.282862 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 905/1815] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:26 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:26.328189 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23116580-fd76-45cb-89de-32ab110e1c9c admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:26.332805 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305e7cf-2e52-4253-b56d-4c34f3ecc392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:26.333437 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305e7cf-2e52-4253-b56d-4c34f3ecc392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:26.333720 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305e7cf-2e52-4253-b56d-4c34f3ecc392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:26.334028 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305e7cf-2e52-4253-b56d-4c34f3ecc392 admin admin] PATH_INFO: `/v3/users/fabd5e4340eb4ecca2070432cfc326dd` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:26.335167 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305e7cf-2e52-4253-b56d-4c34f3ecc392 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fabd5e4340eb4ecca2070432cfc326dd)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:26.337181 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305e7cf-2e52-4253-b56d-4c34f3ecc392 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:26.338856 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:26.425013 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8305e7cf-2e52-4253-b56d-4c34f3ecc392 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fabd5e4340eb4ecca2070432cfc326dd'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:26.433420 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8305e7cf-2e52-4253-b56d-4c34f3ecc392 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fabd5e4340eb4ecca2070432cfc326dd'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:26.443339 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8305e7cf-2e52-4253-b56d-4c34f3ecc392 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fabd5e4340eb4ecca2070432cfc326dd'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:26.461542 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8305e7cf-2e52-4253-b56d-4c34f3ecc392 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fabd5e4340eb4ecca2070432cfc326dd'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:26.462328 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8305e7cf-2e52-4253-b56d-4c34f3ecc392 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fabd5e4340eb4ecca2070432cfc326dd'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:26.469296 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 911/1816] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:55:26 2022] DELETE /identity/v3/users/fabd5e4340eb4ecca2070432cfc326dd => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:26.954765 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de451a-3ea2-4b8b-8a0a-ce2e909f52d5 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:27.050512 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de451a-3ea2-4b8b-8a0a-ce2e909f52d5 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:27.113771 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:27.157224 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe291d-de5b-4c4c-9a89-48d0b55c1a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:27.160040 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe291d-de5b-4c4c-9a89-48d0b55c1a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:27.160468 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe291d-de5b-4c4c-9a89-48d0b55c1a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:27.160837 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe291d-de5b-4c4c-9a89-48d0b55c1a98 admin admin] PATH_INFO: `/v3/projects/88c3665d21e8489991f9037092fa9aca` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:27.164705 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe291d-de5b-4c4c-9a89-48d0b55c1a98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88c3665d21e8489991f9037092fa9aca)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:27.167241 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe291d-de5b-4c4c-9a89-48d0b55c1a98 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:27.236771 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9bfe291d-de5b-4c4c-9a89-48d0b55c1a98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88c3665d21e8489991f9037092fa9aca', 'request_id': 'req-9bfe291d-de5b-4c4c-9a89-48d0b55c1a98'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:27.242548 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9bfe291d-de5b-4c4c-9a89-48d0b55c1a98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88c3665d21e8489991f9037092fa9aca', 'request_id': 'req-9bfe291d-de5b-4c4c-9a89-48d0b55c1a98'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:27.250499 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9bfe291d-de5b-4c4c-9a89-48d0b55c1a98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88c3665d21e8489991f9037092fa9aca', 'request_id': 'req-9bfe291d-de5b-4c4c-9a89-48d0b55c1a98'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:27.265352 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9bfe291d-de5b-4c4c-9a89-48d0b55c1a98 admin admin] The token cache is being invalidate because project 88c3665d21e8489991f9037092fa9aca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:55:27.265711 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9bfe291d-de5b-4c4c-9a89-48d0b55c1a98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:27.266435 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9bfe291d-de5b-4c4c-9a89-48d0b55c1a98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:27.273700 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 906/1817] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:55:26 2022] DELETE /identity/v3/projects/88c3665d21e8489991f9037092fa9aca => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:27.276022 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d28105-01cc-45c2-b25c-4e862a97c917 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:27.277317 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d28105-01cc-45c2-b25c-4e862a97c917 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:27.277317 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d28105-01cc-45c2-b25c-4e862a97c917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:27.308298 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-21d28105-01cc-45c2-b25c-4e862a97c917 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:27.309733 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-21d28105-01cc-45c2-b25c-4e862a97c917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:27.396383 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 912/1818] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:27.404439 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492bedc-cb84-462c-aa17-e60a1be799a4 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:27.405009 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492bedc-cb84-462c-aa17-e60a1be799a4 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:27.406102 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492bedc-cb84-462c-aa17-e60a1be799a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:27.429315 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-2492bedc-cb84-462c-aa17-e60a1be799a4 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:27.430754 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2492bedc-cb84-462c-aa17-e60a1be799a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:27.444181 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d28105-01cc-45c2-b25c-4e862a97c917 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:27.444971 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 907/1819] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:27.470583 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d28105-01cc-45c2-b25c-4e862a97c917 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:27.488422 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ad7d4-a3c1-4343-8aab-76896d5ec7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:27.489391 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ad7d4-a3c1-4343-8aab-76896d5ec7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:27.489904 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ad7d4-a3c1-4343-8aab-76896d5ec7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:27.491447 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ad7d4-a3c1-4343-8aab-76896d5ec7d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:27.492531 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ad7d4-a3c1-4343-8aab-76896d5ec7d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:27.494802 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ad7d4-a3c1-4343-8aab-76896d5ec7d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:27.496820 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ad7d4-a3c1-4343-8aab-76896d5ec7d5 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:27.515715 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 913/1820] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:55:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:27.519863 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2492bedc-cb84-462c-aa17-e60a1be799a4 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:27.543245 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2492bedc-cb84-462c-aa17-e60a1be799a4 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:27.550017 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afbd5e-c425-4389-bb37-a26d6d4fc13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:27.551139 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afbd5e-c425-4389-bb37-a26d6d4fc13d admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:27.551703 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afbd5e-c425-4389-bb37-a26d6d4fc13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:27.553348 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afbd5e-c425-4389-bb37-a26d6d4fc13d admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:27.558623 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afbd5e-c425-4389-bb37-a26d6d4fc13d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:27.560788 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afbd5e-c425-4389-bb37-a26d6d4fc13d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:27.596140 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 908/1821] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:55:27 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:27.602138 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ad7d4-a3c1-4343-8aab-76896d5ec7d5 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:27.623414 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ad7d4-a3c1-4343-8aab-76896d5ec7d5 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:27.758006 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b524bf2-c5c5-40da-a2dc-8eb0d0c3a64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:27.758866 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b524bf2-c5c5-40da-a2dc-8eb0d0c3a64d admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:27.758866 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b524bf2-c5c5-40da-a2dc-8eb0d0c3a64d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:27.759138 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b524bf2-c5c5-40da-a2dc-8eb0d0c3a64d admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:27.760545 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b524bf2-c5c5-40da-a2dc-8eb0d0c3a64d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:27.773801 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b524bf2-c5c5-40da-a2dc-8eb0d0c3a64d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:27.793827 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:27.808041 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 914/1822] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:55:27 2022] POST /identity/v3/users => generated 287 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:27.811766 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afbd5e-c425-4389-bb37-a26d6d4fc13d admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:27.828335 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afbd5e-c425-4389-bb37-a26d6d4fc13d admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:27.838063 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e24ec-4b72-47af-85e5-b2114bd6351b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:27.839579 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e24ec-4b72-47af-85e5-b2114bd6351b admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:27.840021 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e24ec-4b72-47af-85e5-b2114bd6351b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:27.840596 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e24ec-4b72-47af-85e5-b2114bd6351b admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:27.841508 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e24ec-4b72-47af-85e5-b2114bd6351b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:27.843418 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e24ec-4b72-47af-85e5-b2114bd6351b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:27.860826 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 909/1823] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:27.865143 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b524bf2-c5c5-40da-a2dc-8eb0d0c3a64d admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:27.883534 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b524bf2-c5c5-40da-a2dc-8eb0d0c3a64d admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:27.890639 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31687b4a-d6fd-4223-9c7e-9aec9e97b0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:27.891580 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31687b4a-d6fd-4223-9c7e-9aec9e97b0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:27.892039 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31687b4a-d6fd-4223-9c7e-9aec9e97b0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:27.892826 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31687b4a-d6fd-4223-9c7e-9aec9e97b0d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:27.893885 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31687b4a-d6fd-4223-9c7e-9aec9e97b0d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:27.896536 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31687b4a-d6fd-4223-9c7e-9aec9e97b0d2 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:27.915702 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 915/1824] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:55:27.919836 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e24ec-4b72-47af-85e5-b2114bd6351b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:27.936823 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e24ec-4b72-47af-85e5-b2114bd6351b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:27.943474 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd452ca-b16b-4aea-b0aa-cc5ec0452d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:27.944515 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd452ca-b16b-4aea-b0aa-cc5ec0452d3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:27.946089 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd452ca-b16b-4aea-b0aa-cc5ec0452d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:27.946740 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd452ca-b16b-4aea-b0aa-cc5ec0452d3d admin admin] PATH_INFO: `/v3/projects/2aa3d7d748174343a3344fb9fc5db42c/users/6c92f3b8f2b34906ac4a1f0e532b6a78/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:27.971960 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd452ca-b16b-4aea-b0aa-cc5ec0452d3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aa3d7d748174343a3344fb9fc5db42c, user_id=6c92f3b8f2b34906ac4a1f0e532b6a78, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:27.977873 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd452ca-b16b-4aea-b0aa-cc5ec0452d3d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:28.005880 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 910/1825] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:27 2022] PUT /identity/v3/projects/2aa3d7d748174343a3344fb9fc5db42c/users/6c92f3b8f2b34906ac4a1f0e532b6a78/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:55:28.015802 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d282f-4a4d-43e8-8724-c0eebe434c71 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:28.015802 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d282f-4a4d-43e8-8724-c0eebe434c71 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:28.015802 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d282f-4a4d-43e8-8724-c0eebe434c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:28.047698 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-f20d282f-4a4d-43e8-8724-c0eebe434c71 None None] MFA Rules not processed for user `6c92f3b8f2b34906ac4a1f0e532b6a78`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:28.049178 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f20d282f-4a4d-43e8-8724-c0eebe434c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:28.146432 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 916/1826] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:28.148136 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd452ca-b16b-4aea-b0aa-cc5ec0452d3d admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:28.220936 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd452ca-b16b-4aea-b0aa-cc5ec0452d3d admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:28.226318 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8a919-2eff-4d34-afab-bc8bc58a796d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:28.226994 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8a919-2eff-4d34-afab-bc8bc58a796d admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:28.227371 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8a919-2eff-4d34-afab-bc8bc58a796d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:28.227743 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8a919-2eff-4d34-afab-bc8bc58a796d admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:28.228526 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8a919-2eff-4d34-afab-bc8bc58a796d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:28.231008 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8a919-2eff-4d34-afab-bc8bc58a796d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:28.253656 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:28.280156 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 911/1827] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:55:28 2022] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:28.284445 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d282f-4a4d-43e8-8724-c0eebe434c71 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:28.297460 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d282f-4a4d-43e8-8724-c0eebe434c71 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:28.389958 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafa0ed-e31a-48fe-8670-8ff0820f1df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:28.390855 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafa0ed-e31a-48fe-8670-8ff0820f1df8 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:28.391812 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafa0ed-e31a-48fe-8670-8ff0820f1df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:28.391812 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafa0ed-e31a-48fe-8670-8ff0820f1df8 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:28.392245 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dafa0ed-e31a-48fe-8670-8ff0820f1df8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:28.394242 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dafa0ed-e31a-48fe-8670-8ff0820f1df8 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:28.429940 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 917/1828] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:55:28 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:55:28.430300 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8a919-2eff-4d34-afab-bc8bc58a796d admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:28.443118 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8a919-2eff-4d34-afab-bc8bc58a796d admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:28.449935 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95deb7d3-180b-4fee-87d9-a41e3e7fc907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:28.451056 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95deb7d3-180b-4fee-87d9-a41e3e7fc907 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:28.451581 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95deb7d3-180b-4fee-87d9-a41e3e7fc907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:28.452301 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95deb7d3-180b-4fee-87d9-a41e3e7fc907 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:28.453163 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95deb7d3-180b-4fee-87d9-a41e3e7fc907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:28.455407 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95deb7d3-180b-4fee-87d9-a41e3e7fc907 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:28.471536 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 912/1829] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:28.476030 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafa0ed-e31a-48fe-8670-8ff0820f1df8 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:28.487763 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafa0ed-e31a-48fe-8670-8ff0820f1df8 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:28.493987 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce8cda-56a4-4248-b3fe-4ba4c3b9d6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:28.495360 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce8cda-56a4-4248-b3fe-4ba4c3b9d6f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:28.496107 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce8cda-56a4-4248-b3fe-4ba4c3b9d6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:28.496486 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce8cda-56a4-4248-b3fe-4ba4c3b9d6f6 admin admin] PATH_INFO: `/v3/projects/87aefdaee3704a84863cb67264bd3be3/users/b66269f5384144eb9eb4301ee1130c5b/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:28.519279 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce8cda-56a4-4248-b3fe-4ba4c3b9d6f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87aefdaee3704a84863cb67264bd3be3, user_id=b66269f5384144eb9eb4301ee1130c5b, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:28.521965 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce8cda-56a4-4248-b3fe-4ba4c3b9d6f6 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:28.565499 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 918/1830] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:28 2022] PUT /identity/v3/projects/87aefdaee3704a84863cb67264bd3be3/users/b66269f5384144eb9eb4301ee1130c5b/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:55:28.570200 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95deb7d3-180b-4fee-87d9-a41e3e7fc907 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:28.583777 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95deb7d3-180b-4fee-87d9-a41e3e7fc907 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:28.648189 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c99a9b-f5f7-479f-a669-3adda2c5da57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:28.648947 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c99a9b-f5f7-479f-a669-3adda2c5da57 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:28.649301 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c99a9b-f5f7-479f-a669-3adda2c5da57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:28.649623 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c99a9b-f5f7-479f-a669-3adda2c5da57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:28.650381 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c99a9b-f5f7-479f-a669-3adda2c5da57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:28.652810 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c99a9b-f5f7-479f-a669-3adda2c5da57 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:28.670023 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 913/1831] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:55:28.673579 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce8cda-56a4-4248-b3fe-4ba4c3b9d6f6 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:28.700111 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce8cda-56a4-4248-b3fe-4ba4c3b9d6f6 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:28.711892 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3d13b-8c1f-40f9-b736-1f03ccfb7ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:28.712577 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3d13b-8c1f-40f9-b736-1f03ccfb7ddc admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:28.712850 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3d13b-8c1f-40f9-b736-1f03ccfb7ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:28.713118 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3d13b-8c1f-40f9-b736-1f03ccfb7ddc admin admin] PATH_INFO: `/v3/projects/87aefdaee3704a84863cb67264bd3be3/users/b66269f5384144eb9eb4301ee1130c5b/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:28.715676 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3d13b-8c1f-40f9-b736-1f03ccfb7ddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=87aefdaee3704a84863cb67264bd3be3, user_id=b66269f5384144eb9eb4301ee1130c5b, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:28.719749 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3d13b-8c1f-40f9-b736-1f03ccfb7ddc admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:28.741091 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 919/1832] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:28 2022] PUT /identity/v3/projects/87aefdaee3704a84863cb67264bd3be3/users/b66269f5384144eb9eb4301ee1130c5b/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:28.752830 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc889231-03d5-47be-8779-d1b66354f298 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:28.753139 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc889231-03d5-47be-8779-d1b66354f298 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:28.753383 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc889231-03d5-47be-8779-d1b66354f298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:28.782240 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-fc889231-03d5-47be-8779-d1b66354f298 None None] MFA Rules not processed for user `b66269f5384144eb9eb4301ee1130c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:28.783451 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-fc889231-03d5-47be-8779-d1b66354f298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:28.859206 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 914/1833] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:28.872238 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3d13b-8c1f-40f9-b736-1f03ccfb7ddc admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:28.874270 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f7b3d13b-8c1f-40f9-b736-1f03ccfb7ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:28.906091 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:28.935442 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3d13b-8c1f-40f9-b736-1f03ccfb7ddc admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:28.939939 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9b19f-fd11-48ca-9a46-1e6901e00943 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:28.940563 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9b19f-fd11-48ca-9a46-1e6901e00943 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:28.940838 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9b19f-fd11-48ca-9a46-1e6901e00943 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:28.941102 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9b19f-fd11-48ca-9a46-1e6901e00943 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:28.951117 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9b19f-fd11-48ca-9a46-1e6901e00943 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:28.952696 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9b19f-fd11-48ca-9a46-1e6901e00943 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:28.963657 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 920/1834] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:29.164333 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77ef48-7f91-4dd6-809b-1a15bb5ab0ca None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:29.165277 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77ef48-7f91-4dd6-809b-1a15bb5ab0ca None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:29.165755 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77ef48-7f91-4dd6-809b-1a15bb5ab0ca None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:29.168209 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 915/1835] 10.222.0.52 () {54 vars in 921 bytes} [Sun Aug 28 00:55:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:55:29.191933 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9e5e9-0da5-45a1-9375-952643330bdc None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:29.192217 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9e5e9-0da5-45a1-9375-952643330bdc None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:29.192508 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9e5e9-0da5-45a1-9375-952643330bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:29.219893 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-3ee9e5e9-0da5-45a1-9375-952643330bdc None None] MFA Rules not processed for user `f890ff4e7807477db7f17c2f6434dce8`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:29.221390 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3ee9e5e9-0da5-45a1-9375-952643330bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:29.380450 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 921/1836] 10.222.0.52 () {58 vars in 1018 bytes} [Sun Aug 28 00:55:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:29.395570 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77ef48-7f91-4dd6-809b-1a15bb5ab0ca None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:29.397653 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7f77ef48-7f91-4dd6-809b-1a15bb5ab0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:29.421937 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77ef48-7f91-4dd6-809b-1a15bb5ab0ca None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:29.430003 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc880023-5537-4be2-95b7-7bc0e01ae6ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:29.430964 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc880023-5537-4be2-95b7-7bc0e01ae6ba service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:29.431446 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc880023-5537-4be2-95b7-7bc0e01ae6ba service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:29.431921 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc880023-5537-4be2-95b7-7bc0e01ae6ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:29.444333 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc880023-5537-4be2-95b7-7bc0e01ae6ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:29.447538 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc880023-5537-4be2-95b7-7bc0e01ae6ba service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:29.481438 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 916/1837] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:29.498519 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9e5e9-0da5-45a1-9375-952643330bdc None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:29.620034 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9e5e9-0da5-45a1-9375-952643330bdc None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:29.633007 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931845e8-8b29-4447-9218-ad85101cf82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:29.634681 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931845e8-8b29-4447-9218-ad85101cf82e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:29.634995 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931845e8-8b29-4447-9218-ad85101cf82e admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:29.635427 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931845e8-8b29-4447-9218-ad85101cf82e admin admin] PATH_INFO: `/v3/users/6c92f3b8f2b34906ac4a1f0e532b6a78` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:29.637177 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931845e8-8b29-4447-9218-ad85101cf82e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c92f3b8f2b34906ac4a1f0e532b6a78)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:29.639482 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931845e8-8b29-4447-9218-ad85101cf82e admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:29.746442 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-931845e8-8b29-4447-9218-ad85101cf82e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c92f3b8f2b34906ac4a1f0e532b6a78'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:29.765894 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-931845e8-8b29-4447-9218-ad85101cf82e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c92f3b8f2b34906ac4a1f0e532b6a78'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:29.778338 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-931845e8-8b29-4447-9218-ad85101cf82e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c92f3b8f2b34906ac4a1f0e532b6a78'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:29.780109 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:29.801935 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-931845e8-8b29-4447-9218-ad85101cf82e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c92f3b8f2b34906ac4a1f0e532b6a78'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:29.803353 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-931845e8-8b29-4447-9218-ad85101cf82e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c92f3b8f2b34906ac4a1f0e532b6a78'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:29.812816 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 922/1838] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:55:29 2022] DELETE /identity/v3/users/6c92f3b8f2b34906ac4a1f0e532b6a78 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:29.819102 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1e46c-555f-4d39-86a1-007458cce277 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:29.819466 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1e46c-555f-4d39-86a1-007458cce277 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:29.820112 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1e46c-555f-4d39-86a1-007458cce277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:29.846645 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c3c1e46c-555f-4d39-86a1-007458cce277 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:29.848039 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c3c1e46c-555f-4d39-86a1-007458cce277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:29.923305 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:29.967731 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 917/1839] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:30.045683 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931845e8-8b29-4447-9218-ad85101cf82e admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:30.047224 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-931845e8-8b29-4447-9218-ad85101cf82e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:30.115470 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1e46c-555f-4d39-86a1-007458cce277 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:30.118014 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c3c1e46c-555f-4d39-86a1-007458cce277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:30.224315 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931845e8-8b29-4447-9218-ad85101cf82e admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:30.241319 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73985a-716b-4c2f-985a-1075d19557fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:30.242027 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73985a-716b-4c2f-985a-1075d19557fa service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:30.244039 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73985a-716b-4c2f-985a-1075d19557fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:30.244329 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73985a-716b-4c2f-985a-1075d19557fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:30.277509 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73985a-716b-4c2f-985a-1075d19557fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:30.280140 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73985a-716b-4c2f-985a-1075d19557fa service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:30.303092 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 923/1840] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:30.304596 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1e46c-555f-4d39-86a1-007458cce277 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:30.324718 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d56df7-39da-4cd8-bcef-4ea1352953d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:30.324718 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d56df7-39da-4cd8-bcef-4ea1352953d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:30.324718 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d56df7-39da-4cd8-bcef-4ea1352953d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:30.324718 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d56df7-39da-4cd8-bcef-4ea1352953d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:30.326631 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d7d56df7-39da-4cd8-bcef-4ea1352953d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:30.407965 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d56df7-39da-4cd8-bcef-4ea1352953d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:30.409675 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d56df7-39da-4cd8-bcef-4ea1352953d3 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:30.420496 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 918/1841] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:55:30.682906 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73985a-716b-4c2f-985a-1075d19557fa service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:30.684388 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-0c73985a-716b-4c2f-985a-1075d19557fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:30.708569 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73985a-716b-4c2f-985a-1075d19557fa service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:30.715204 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed2807-3d76-49d1-bc36-20917a4c0e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:30.716494 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed2807-3d76-49d1-bc36-20917a4c0e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:30.717170 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed2807-3d76-49d1-bc36-20917a4c0e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:30.717537 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed2807-3d76-49d1-bc36-20917a4c0e0d admin admin] PATH_INFO: `/v3/projects/2aa3d7d748174343a3344fb9fc5db42c` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:30.719264 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed2807-3d76-49d1-bc36-20917a4c0e0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aa3d7d748174343a3344fb9fc5db42c)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:30.722068 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed2807-3d76-49d1-bc36-20917a4c0e0d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:30.787788 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-16ed2807-3d76-49d1-bc36-20917a4c0e0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aa3d7d748174343a3344fb9fc5db42c', 'request_id': 'req-16ed2807-3d76-49d1-bc36-20917a4c0e0d'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:30.799039 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-16ed2807-3d76-49d1-bc36-20917a4c0e0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aa3d7d748174343a3344fb9fc5db42c', 'request_id': 'req-16ed2807-3d76-49d1-bc36-20917a4c0e0d'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:30.808099 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-16ed2807-3d76-49d1-bc36-20917a4c0e0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aa3d7d748174343a3344fb9fc5db42c', 'request_id': 'req-16ed2807-3d76-49d1-bc36-20917a4c0e0d'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:30.823369 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-16ed2807-3d76-49d1-bc36-20917a4c0e0d admin admin] The token cache is being invalidate because project 2aa3d7d748174343a3344fb9fc5db42c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:55:30.823806 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-16ed2807-3d76-49d1-bc36-20917a4c0e0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:30.824545 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-16ed2807-3d76-49d1-bc36-20917a4c0e0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:30.830239 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 924/1842] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:55:30 2022] DELETE /identity/v3/projects/2aa3d7d748174343a3344fb9fc5db42c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:30.831381 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d56df7-39da-4cd8-bcef-4ea1352953d3 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:30.848047 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d56df7-39da-4cd8-bcef-4ea1352953d3 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:30.964737 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4033307-d3db-44f6-9fab-73b4b293dcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:30.966347 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4033307-d3db-44f6-9fab-73b4b293dcfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:30.967329 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4033307-d3db-44f6-9fab-73b4b293dcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:30.970140 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4033307-d3db-44f6-9fab-73b4b293dcfe admin admin] PATH_INFO: `/v3/users/b66269f5384144eb9eb4301ee1130c5b` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:30.991649 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4033307-d3db-44f6-9fab-73b4b293dcfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b66269f5384144eb9eb4301ee1130c5b)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:31.000757 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4033307-d3db-44f6-9fab-73b4b293dcfe admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:31.105546 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:31.108024 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f4033307-d3db-44f6-9fab-73b4b293dcfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b66269f5384144eb9eb4301ee1130c5b'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:31.148754 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f4033307-d3db-44f6-9fab-73b4b293dcfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b66269f5384144eb9eb4301ee1130c5b'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:31.170572 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f4033307-d3db-44f6-9fab-73b4b293dcfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b66269f5384144eb9eb4301ee1130c5b'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:31.187992 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f4033307-d3db-44f6-9fab-73b4b293dcfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b66269f5384144eb9eb4301ee1130c5b'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:31.188957 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f4033307-d3db-44f6-9fab-73b4b293dcfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b66269f5384144eb9eb4301ee1130c5b'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:31.196291 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 919/1843] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:55:30 2022] DELETE /identity/v3/users/b66269f5384144eb9eb4301ee1130c5b => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:32.208418 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed2807-3d76-49d1-bc36-20917a4c0e0d admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:32.209872 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-16ed2807-3d76-49d1-bc36-20917a4c0e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:32.229940 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed2807-3d76-49d1-bc36-20917a4c0e0d admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:32.302263 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1439f7a-0c10-45f5-999c-51db90013657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:32.303700 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1439f7a-0c10-45f5-999c-51db90013657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:32.303843 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1439f7a-0c10-45f5-999c-51db90013657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:32.304158 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1439f7a-0c10-45f5-999c-51db90013657 admin admin] PATH_INFO: `/v3/projects/87aefdaee3704a84863cb67264bd3be3` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:32.305660 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1439f7a-0c10-45f5-999c-51db90013657 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87aefdaee3704a84863cb67264bd3be3)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:32.308011 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1439f7a-0c10-45f5-999c-51db90013657 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:32.316861 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:32.364392 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c1439f7a-0c10-45f5-999c-51db90013657 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87aefdaee3704a84863cb67264bd3be3', 'request_id': 'req-c1439f7a-0c10-45f5-999c-51db90013657'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:32.374793 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c1439f7a-0c10-45f5-999c-51db90013657 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87aefdaee3704a84863cb67264bd3be3', 'request_id': 'req-c1439f7a-0c10-45f5-999c-51db90013657'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:32.384373 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c1439f7a-0c10-45f5-999c-51db90013657 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87aefdaee3704a84863cb67264bd3be3', 'request_id': 'req-c1439f7a-0c10-45f5-999c-51db90013657'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:32.397277 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c1439f7a-0c10-45f5-999c-51db90013657 admin admin] The token cache is being invalidate because project 87aefdaee3704a84863cb67264bd3be3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:55:32.397639 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c1439f7a-0c10-45f5-999c-51db90013657 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:32.398478 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c1439f7a-0c10-45f5-999c-51db90013657 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:32.400727 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 925/1844] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:55:32 2022] DELETE /identity/v3/projects/87aefdaee3704a84863cb67264bd3be3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:32.405633 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4027936-a286-4165-bec3-0ebf45834a24 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:32.406134 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4027936-a286-4165-bec3-0ebf45834a24 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:32.406223 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4027936-a286-4165-bec3-0ebf45834a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:32.427849 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a4027936-a286-4165-bec3-0ebf45834a24 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:32.429215 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a4027936-a286-4165-bec3-0ebf45834a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:32.512580 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917ad85-6ccc-477f-89df-fb26393fdca2 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:32.512864 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917ad85-6ccc-477f-89df-fb26393fdca2 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:32.513162 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917ad85-6ccc-477f-89df-fb26393fdca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:32.513926 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 920/1845] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:32.565907 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-7917ad85-6ccc-477f-89df-fb26393fdca2 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:32.567330 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-7917ad85-6ccc-477f-89df-fb26393fdca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:32.579653 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 926/1846] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:32.580919 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4027936-a286-4165-bec3-0ebf45834a24 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:32.594526 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4027936-a286-4165-bec3-0ebf45834a24 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:32.604497 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab14e5-c1b1-4b9f-ba1f-9516ae41ddaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:32.605583 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab14e5-c1b1-4b9f-ba1f-9516ae41ddaa admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:32.606284 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab14e5-c1b1-4b9f-ba1f-9516ae41ddaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:32.606768 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab14e5-c1b1-4b9f-ba1f-9516ae41ddaa admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:32.607677 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab14e5-c1b1-4b9f-ba1f-9516ae41ddaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:32.608191 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab14e5-c1b1-4b9f-ba1f-9516ae41ddaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:32.610467 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab14e5-c1b1-4b9f-ba1f-9516ae41ddaa admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:32.625798 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 921/1847] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:55:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:32.630120 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917ad85-6ccc-477f-89df-fb26393fdca2 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:32.642400 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917ad85-6ccc-477f-89df-fb26393fdca2 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:32.647981 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743b649-4e85-45d6-b9ce-76f8ebdbdde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:32.648671 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743b649-4e85-45d6-b9ce-76f8ebdbdde2 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:32.649095 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743b649-4e85-45d6-b9ce-76f8ebdbdde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:32.650070 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743b649-4e85-45d6-b9ce-76f8ebdbdde2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:32.650179 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743b649-4e85-45d6-b9ce-76f8ebdbdde2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:32.652756 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743b649-4e85-45d6-b9ce-76f8ebdbdde2 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:32.691727 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 927/1848] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:55:32 2022] POST /identity/v3/projects => generated 369 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:55:32.696037 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab14e5-c1b1-4b9f-ba1f-9516ae41ddaa admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:32.713471 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab14e5-c1b1-4b9f-ba1f-9516ae41ddaa admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:32.847122 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f30ab-f3be-43c9-a265-980e4485923f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:32.847837 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f30ab-f3be-43c9-a265-980e4485923f admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:32.848118 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f30ab-f3be-43c9-a265-980e4485923f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:32.848391 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f30ab-f3be-43c9-a265-980e4485923f admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:32.849035 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f30ab-f3be-43c9-a265-980e4485923f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:32.859239 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f30ab-f3be-43c9-a265-980e4485923f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:32.902766 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 922/1849] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:55:32 2022] POST /identity/v3/users => generated 285 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:32.907530 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743b649-4e85-45d6-b9ce-76f8ebdbdde2 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:32.926810 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743b649-4e85-45d6-b9ce-76f8ebdbdde2 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:32.941101 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fddb65e-1cf3-40cd-8b03-ae2090026fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:32.942220 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddb65e-1cf3-40cd-8b03-ae2090026fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:32.942554 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddb65e-1cf3-40cd-8b03-ae2090026fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:32.942879 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddb65e-1cf3-40cd-8b03-ae2090026fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:32.943729 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fddb65e-1cf3-40cd-8b03-ae2090026fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:32.945414 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fddb65e-1cf3-40cd-8b03-ae2090026fd3 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:32.976447 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 928/1850] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:32.980843 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f30ab-f3be-43c9-a265-980e4485923f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:33.004674 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f30ab-f3be-43c9-a265-980e4485923f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:33.011871 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132309d8-0eb2-4ba4-b36d-aea98067c571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:33.012846 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132309d8-0eb2-4ba4-b36d-aea98067c571 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:33.013312 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132309d8-0eb2-4ba4-b36d-aea98067c571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:33.013724 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132309d8-0eb2-4ba4-b36d-aea98067c571 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:33.014634 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132309d8-0eb2-4ba4-b36d-aea98067c571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:33.016841 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132309d8-0eb2-4ba4-b36d-aea98067c571 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:33.029327 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 923/1851] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:33.033335 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fddb65e-1cf3-40cd-8b03-ae2090026fd3 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:33.047244 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fddb65e-1cf3-40cd-8b03-ae2090026fd3 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:33.062239 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738af65a-cc79-45e5-a6e7-e7c70f7d5a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:33.063594 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738af65a-cc79-45e5-a6e7-e7c70f7d5a94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:33.064363 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738af65a-cc79-45e5-a6e7-e7c70f7d5a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:33.066757 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738af65a-cc79-45e5-a6e7-e7c70f7d5a94 admin admin] PATH_INFO: `/v3/projects/6c25a08e78ff493f9a79ad8d5454602f/users/021af6e23f27421e8b71cac0579b6e59/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:33.102495 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738af65a-cc79-45e5-a6e7-e7c70f7d5a94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c25a08e78ff493f9a79ad8d5454602f, user_id=021af6e23f27421e8b71cac0579b6e59, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:33.105609 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738af65a-cc79-45e5-a6e7-e7c70f7d5a94 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:33.127617 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 929/1852] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:33 2022] PUT /identity/v3/projects/6c25a08e78ff493f9a79ad8d5454602f/users/021af6e23f27421e8b71cac0579b6e59/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:33.139829 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32a643-4ad5-4388-946c-2fbe9c4a1ded None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:33.140213 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32a643-4ad5-4388-946c-2fbe9c4a1ded None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:33.140696 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32a643-4ad5-4388-946c-2fbe9c4a1ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:33.187964 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-6c32a643-4ad5-4388-946c-2fbe9c4a1ded None None] MFA Rules not processed for user `021af6e23f27421e8b71cac0579b6e59`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:33.189158 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6c32a643-4ad5-4388-946c-2fbe9c4a1ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:33.209138 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:33.313177 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 924/1853] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:33.317974 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738af65a-cc79-45e5-a6e7-e7c70f7d5a94 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:33.387428 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32a643-4ad5-4388-946c-2fbe9c4a1ded None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:33.388863 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6c32a643-4ad5-4388-946c-2fbe9c4a1ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:33.465550 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738af65a-cc79-45e5-a6e7-e7c70f7d5a94 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:33.470526 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d80ce-8518-4f29-88d2-fec857305f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:33.471505 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d80ce-8518-4f29-88d2-fec857305f45 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:33.471842 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d80ce-8518-4f29-88d2-fec857305f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:33.472231 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d80ce-8518-4f29-88d2-fec857305f45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:33.472983 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d80ce-8518-4f29-88d2-fec857305f45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:33.475460 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d80ce-8518-4f29-88d2-fec857305f45 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:33.506718 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32a643-4ad5-4388-946c-2fbe9c4a1ded None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:33.513156 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 930/1854] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:55:33 2022] POST /identity/v3/projects => generated 365 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:33.514240 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d80ce-8518-4f29-88d2-fec857305f45 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:33.515958 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b12d80ce-8518-4f29-88d2-fec857305f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:33.517142 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c455b49-3e45-4c8b-9506-24e5849b9c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:33.517984 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c455b49-3e45-4c8b-9506-24e5849b9c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:33.518402 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c455b49-3e45-4c8b-9506-24e5849b9c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:33.518812 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c455b49-3e45-4c8b-9506-24e5849b9c76 admin admin] PATH_INFO: `/v3/users/fa4734de2c5241c798497732a13e4e64` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:33.520558 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c455b49-3e45-4c8b-9506-24e5849b9c76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4734de2c5241c798497732a13e4e64)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:33.523231 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c455b49-3e45-4c8b-9506-24e5849b9c76 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:33.566092 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:33.595928 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7c455b49-3e45-4c8b-9506-24e5849b9c76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4734de2c5241c798497732a13e4e64'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:33.610886 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7c455b49-3e45-4c8b-9506-24e5849b9c76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4734de2c5241c798497732a13e4e64'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:33.612615 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d80ce-8518-4f29-88d2-fec857305f45 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:33.616704 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c289cd1-1be3-4556-b75f-f512a0bbc21f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:33.617411 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c289cd1-1be3-4556-b75f-f512a0bbc21f service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:33.617738 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c289cd1-1be3-4556-b75f-f512a0bbc21f service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:33.618050 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c289cd1-1be3-4556-b75f-f512a0bbc21f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:33.618307 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7c455b49-3e45-4c8b-9506-24e5849b9c76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4734de2c5241c798497732a13e4e64'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:33.619838 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3c289cd1-1be3-4556-b75f-f512a0bbc21f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:33.626676 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7c455b49-3e45-4c8b-9506-24e5849b9c76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4734de2c5241c798497732a13e4e64'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:33.627324 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7c455b49-3e45-4c8b-9506-24e5849b9c76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4734de2c5241c798497732a13e4e64'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:33.633392 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 925/1855] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:55:33 2022] DELETE /identity/v3/users/fa4734de2c5241c798497732a13e4e64 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:55:33.634333 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c455b49-3e45-4c8b-9506-24e5849b9c76 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:33.635888 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7c455b49-3e45-4c8b-9506-24e5849b9c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:33.679639 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:33.692932 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c289cd1-1be3-4556-b75f-f512a0bbc21f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:33.694427 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c289cd1-1be3-4556-b75f-f512a0bbc21f service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:33.703362 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c455b49-3e45-4c8b-9506-24e5849b9c76 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:33.704633 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 931/1856] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:33 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:33.705703 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e8b0a-861c-416f-810b-f5510fac00f7 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:33.706022 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e8b0a-861c-416f-810b-f5510fac00f7 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:33.706297 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e8b0a-861c-416f-810b-f5510fac00f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:33.709265 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8b22c-66b1-4245-ba88-5781ad6455a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:33.709703 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8b22c-66b1-4245-ba88-5781ad6455a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:33.709999 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8b22c-66b1-4245-ba88-5781ad6455a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:33.710273 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8b22c-66b1-4245-ba88-5781ad6455a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:33.710894 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8b22c-66b1-4245-ba88-5781ad6455a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:33.712815 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8b22c-66b1-4245-ba88-5781ad6455a4 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:33.727823 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-463e8b0a-861c-416f-810b-f5510fac00f7 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:33.730011 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-463e8b0a-861c-416f-810b-f5510fac00f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:33.737460 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 926/1857] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:55:33 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:33.742279 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8b22c-66b1-4245-ba88-5781ad6455a4 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:33.765224 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 932/1858] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:33.773599 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8b22c-66b1-4245-ba88-5781ad6455a4 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:33.775240 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e8b0a-861c-416f-810b-f5510fac00f7 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:33.777622 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-463e8b0a-861c-416f-810b-f5510fac00f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:33.782435 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a15b1-8ece-4154-9af0-48d6b5302ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:33.783432 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a15b1-8ece-4154-9af0-48d6b5302ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:33.784241 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a15b1-8ece-4154-9af0-48d6b5302ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:33.784810 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a15b1-8ece-4154-9af0-48d6b5302ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:33.787695 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a15b1-8ece-4154-9af0-48d6b5302ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:33.790196 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a15b1-8ece-4154-9af0-48d6b5302ec4 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:33.803603 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 927/1859] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:55:33.811218 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a15b1-8ece-4154-9af0-48d6b5302ec4 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:33.829256 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a15b1-8ece-4154-9af0-48d6b5302ec4 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:33.834882 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56cfcb-aee0-40c5-a6fa-22771f853cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:33.835555 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56cfcb-aee0-40c5-a6fa-22771f853cad admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:33.835839 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56cfcb-aee0-40c5-a6fa-22771f853cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:33.836198 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56cfcb-aee0-40c5-a6fa-22771f853cad admin admin] PATH_INFO: `/v3/projects/5c245ecc6caf48c5b07a87137cd5cd93/users/f5b56532c01048148d7c43882fa9a1bd/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:33.854798 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56cfcb-aee0-40c5-a6fa-22771f853cad admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c245ecc6caf48c5b07a87137cd5cd93, user_id=f5b56532c01048148d7c43882fa9a1bd, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:33.857773 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56cfcb-aee0-40c5-a6fa-22771f853cad admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:33.860033 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e8b0a-861c-416f-810b-f5510fac00f7 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:33.868269 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a412ed-b1e7-4c2c-8675-6764e87aac7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:33.869585 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a412ed-b1e7-4c2c-8675-6764e87aac7e service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:33.870354 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a412ed-b1e7-4c2c-8675-6764e87aac7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:33.870763 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a412ed-b1e7-4c2c-8675-6764e87aac7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:33.884170 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a412ed-b1e7-4c2c-8675-6764e87aac7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:33.886815 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a412ed-b1e7-4c2c-8675-6764e87aac7e service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:33.894846 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 928/1860] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:33 2022] PUT /identity/v3/projects/5c245ecc6caf48c5b07a87137cd5cd93/users/f5b56532c01048148d7c43882fa9a1bd/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:33.898743 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56cfcb-aee0-40c5-a6fa-22771f853cad admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:33.901055 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 933/1861] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:55:33.981427 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56cfcb-aee0-40c5-a6fa-22771f853cad admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:33.987080 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a63a5-04cf-4220-a4f2-4585d1fd390e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:33.987773 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a63a5-04cf-4220-a4f2-4585d1fd390e admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:33.988180 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a63a5-04cf-4220-a4f2-4585d1fd390e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:33.988537 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a63a5-04cf-4220-a4f2-4585d1fd390e admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:33.989256 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a63a5-04cf-4220-a4f2-4585d1fd390e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:33.991034 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a63a5-04cf-4220-a4f2-4585d1fd390e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:34.002736 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 929/1862] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:55:34.007066 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a412ed-b1e7-4c2c-8675-6764e87aac7e service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:34.018498 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a412ed-b1e7-4c2c-8675-6764e87aac7e service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:34.025031 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf732018-33bd-487f-8b4d-fd36ddf8edec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:34.025716 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf732018-33bd-487f-8b4d-fd36ddf8edec admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:34.026454 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf732018-33bd-487f-8b4d-fd36ddf8edec admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:34.026814 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf732018-33bd-487f-8b4d-fd36ddf8edec admin admin] PATH_INFO: `/v3/projects/5c245ecc6caf48c5b07a87137cd5cd93/users/f5b56532c01048148d7c43882fa9a1bd/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:34.028913 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf732018-33bd-487f-8b4d-fd36ddf8edec admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c245ecc6caf48c5b07a87137cd5cd93, user_id=f5b56532c01048148d7c43882fa9a1bd, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:34.032644 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf732018-33bd-487f-8b4d-fd36ddf8edec admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:34.046486 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 934/1863] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:34 2022] PUT /identity/v3/projects/5c245ecc6caf48c5b07a87137cd5cd93/users/f5b56532c01048148d7c43882fa9a1bd/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:34.057214 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290ba4f-ba67-4d3c-bc29-21ac7b92aca8 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:34.058032 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290ba4f-ba67-4d3c-bc29-21ac7b92aca8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:34.058387 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290ba4f-ba67-4d3c-bc29-21ac7b92aca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:34.122645 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-0290ba4f-ba67-4d3c-bc29-21ac7b92aca8 None None] MFA Rules not processed for user `f5b56532c01048148d7c43882fa9a1bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:34.123837 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0290ba4f-ba67-4d3c-bc29-21ac7b92aca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:34.143458 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf732018-33bd-487f-8b4d-fd36ddf8edec admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:34.145235 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-cf732018-33bd-487f-8b4d-fd36ddf8edec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:34.232273 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:34.272383 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 930/1864] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:34.283813 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf732018-33bd-487f-8b4d-fd36ddf8edec admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:34.290038 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290ba4f-ba67-4d3c-bc29-21ac7b92aca8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:34.293421 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0290ba4f-ba67-4d3c-bc29-21ac7b92aca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:34.295107 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb544fc-8a25-4b70-82b7-4583cfbe33fd tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4309f99e5d74c8ba15395f61067c435', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc6aa53a63748069d92244c50f9105e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:34.296488 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb544fc-8a25-4b70-82b7-4583cfbe33fd tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:34.297066 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb544fc-8a25-4b70-82b7-4583cfbe33fd tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:34.297731 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb544fc-8a25-4b70-82b7-4583cfbe33fd tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:34.299109 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb544fc-8a25-4b70-82b7-4583cfbe33fd tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:34.299985 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb544fc-8a25-4b70-82b7-4583cfbe33fd tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:34.302182 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb544fc-8a25-4b70-82b7-4583cfbe33fd tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:34.309710 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:34.321090 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 935/1865] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:55:34.322140 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb544fc-8a25-4b70-82b7-4583cfbe33fd tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:34.325130 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-0bb544fc-8a25-4b70-82b7-4583cfbe33fd tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:34.401481 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290ba4f-ba67-4d3c-bc29-21ac7b92aca8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:34.405620 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8bedd-869a-4f8c-8b10-18599da27a37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:34.406302 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8bedd-869a-4f8c-8b10-18599da27a37 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:34.406577 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8bedd-869a-4f8c-8b10-18599da27a37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:34.406847 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8bedd-869a-4f8c-8b10-18599da27a37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:34.416872 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8bedd-869a-4f8c-8b10-18599da27a37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:34.419238 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8bedd-869a-4f8c-8b10-18599da27a37 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:34.423451 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb544fc-8a25-4b70-82b7-4583cfbe33fd tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:34.434525 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 931/1866] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:34 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:34.434903 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd7b18-f1eb-4b3e-83fa-6029c413ea8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:34.436498 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8bedd-869a-4f8c-8b10-18599da27a37 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:34.437294 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd7b18-f1eb-4b3e-83fa-6029c413ea8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:34.437776 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd7b18-f1eb-4b3e-83fa-6029c413ea8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:34.438151 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd7b18-f1eb-4b3e-83fa-6029c413ea8f admin admin] PATH_INFO: `/v3/projects/8b69de39362e4942b6e2285f0f32dd44` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:34.440969 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd7b18-f1eb-4b3e-83fa-6029c413ea8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b69de39362e4942b6e2285f0f32dd44)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:34.443186 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd7b18-f1eb-4b3e-83fa-6029c413ea8f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:34.450940 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8bedd-869a-4f8c-8b10-18599da27a37 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:34.464238 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf3255-ca21-43df-8dae-574658d3c149 tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4309f99e5d74c8ba15395f61067c435', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc6aa53a63748069d92244c50f9105e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:34.465624 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf3255-ca21-43df-8dae-574658d3c149 tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:34.465956 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf3255-ca21-43df-8dae-574658d3c149 tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:34.466297 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf3255-ca21-43df-8dae-574658d3c149 tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:34.468922 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf3255-ca21-43df-8dae-574658d3c149 tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:34.471176 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf3255-ca21-43df-8dae-574658d3c149 tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:34.526116 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3ebd7b18-f1eb-4b3e-83fa-6029c413ea8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b69de39362e4942b6e2285f0f32dd44', 'request_id': 'req-3ebd7b18-f1eb-4b3e-83fa-6029c413ea8f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:34.535648 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 932/1867] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:55:34 2022] POST /identity/v3/projects => generated 353 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:34.535648 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf3255-ca21-43df-8dae-574658d3c149 tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:34.537511 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f2bf3255-ca21-43df-8dae-574658d3c149 tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:34.541197 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3ebd7b18-f1eb-4b3e-83fa-6029c413ea8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b69de39362e4942b6e2285f0f32dd44', 'request_id': 'req-3ebd7b18-f1eb-4b3e-83fa-6029c413ea8f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:34.551608 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3ebd7b18-f1eb-4b3e-83fa-6029c413ea8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b69de39362e4942b6e2285f0f32dd44', 'request_id': 'req-3ebd7b18-f1eb-4b3e-83fa-6029c413ea8f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:34.566739 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3ebd7b18-f1eb-4b3e-83fa-6029c413ea8f admin admin] The token cache is being invalidate because project 8b69de39362e4942b6e2285f0f32dd44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:55:34.567315 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3ebd7b18-f1eb-4b3e-83fa-6029c413ea8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:34.568166 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3ebd7b18-f1eb-4b3e-83fa-6029c413ea8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:34.570058 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 936/1868] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:55:34 2022] DELETE /identity/v3/projects/8b69de39362e4942b6e2285f0f32dd44 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:34.571057 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd7b18-f1eb-4b3e-83fa-6029c413ea8f admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:34.586004 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3ebd7b18-f1eb-4b3e-83fa-6029c413ea8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:34.687126 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf3255-ca21-43df-8dae-574658d3c149 tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:34.692880 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbc625-4fa0-4a65-af82-ee7a0633b3b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:34.693856 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbc625-4fa0-4a65-af82-ee7a0633b3b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:34.694537 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbc625-4fa0-4a65-af82-ee7a0633b3b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:34.694963 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbc625-4fa0-4a65-af82-ee7a0633b3b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:34.699611 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-13dbc625-4fa0-4a65-af82-ee7a0633b3b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:34.709227 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd7b18-f1eb-4b3e-83fa-6029c413ea8f admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:34.764699 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:34.786935 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbc625-4fa0-4a65-af82-ee7a0633b3b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:34.788617 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbc625-4fa0-4a65-af82-ee7a0633b3b0 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:34.798627 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 933/1869] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:34.799446 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbc625-4fa0-4a65-af82-ee7a0633b3b0 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:34.800925 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-13dbc625-4fa0-4a65-af82-ee7a0633b3b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:34.816281 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276bd44-978a-41b1-9d2b-f095e26cc558 tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4309f99e5d74c8ba15395f61067c435', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc6aa53a63748069d92244c50f9105e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:34.818213 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276bd44-978a-41b1-9d2b-f095e26cc558 tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:34.818560 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276bd44-978a-41b1-9d2b-f095e26cc558 tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:34.818873 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276bd44-978a-41b1-9d2b-f095e26cc558 tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:34.819544 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276bd44-978a-41b1-9d2b-f095e26cc558 tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:34.819853 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276bd44-978a-41b1-9d2b-f095e26cc558 tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:34.821723 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276bd44-978a-41b1-9d2b-f095e26cc558 tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:34.837750 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 937/1870] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:34.860720 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:34.881076 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbc625-4fa0-4a65-af82-ee7a0633b3b0 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:34.890405 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cb353-a082-461b-b5e6-70b5bddda7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:34.890983 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cb353-a082-461b-b5e6-70b5bddda7c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:34.891255 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cb353-a082-461b-b5e6-70b5bddda7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:34.891524 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cb353-a082-461b-b5e6-70b5bddda7c1 admin admin] PATH_INFO: `/v3/users/fe3789fbc33949a69da53740ec93c9ff` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:34.894581 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362cb353-a082-461b-b5e6-70b5bddda7c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe3789fbc33949a69da53740ec93c9ff)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:34.896532 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362cb353-a082-461b-b5e6-70b5bddda7c1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:34.926716 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276bd44-978a-41b1-9d2b-f095e26cc558 tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:34.938079 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276bd44-978a-41b1-9d2b-f095e26cc558 tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:34.943437 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197cf61-d2d3-4ba6-8da5-7347f0a9d853 tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4309f99e5d74c8ba15395f61067c435', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc6aa53a63748069d92244c50f9105e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:34.944287 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197cf61-d2d3-4ba6-8da5-7347f0a9d853 tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:34.944715 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197cf61-d2d3-4ba6-8da5-7347f0a9d853 tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:34.945039 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197cf61-d2d3-4ba6-8da5-7347f0a9d853 tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] PATH_INFO: `/v3/projects/f1ab8164728e46b787777c8122bfab93` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:34.946375 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197cf61-d2d3-4ba6-8da5-7347f0a9d853 tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f1ab8164728e46b787777c8122bfab93)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:34.948742 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197cf61-d2d3-4ba6-8da5-7347f0a9d853 tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:34.969153 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-362cb353-a082-461b-b5e6-70b5bddda7c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe3789fbc33949a69da53740ec93c9ff'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:34.985555 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-362cb353-a082-461b-b5e6-70b5bddda7c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe3789fbc33949a69da53740ec93c9ff'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:34.996690 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-362cb353-a082-461b-b5e6-70b5bddda7c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe3789fbc33949a69da53740ec93c9ff'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:35.007265 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-362cb353-a082-461b-b5e6-70b5bddda7c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe3789fbc33949a69da53740ec93c9ff'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:35.008015 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-362cb353-a082-461b-b5e6-70b5bddda7c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe3789fbc33949a69da53740ec93c9ff'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:35.013357 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6197cf61-d2d3-4ba6-8da5-7347f0a9d853 tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1ab8164728e46b787777c8122bfab93', 'request_id': 'req-6197cf61-d2d3-4ba6-8da5-7347f0a9d853'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:35.018237 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 934/1871] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:55:34 2022] DELETE /identity/v3/users/fe3789fbc33949a69da53740ec93c9ff => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:35.030979 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6197cf61-d2d3-4ba6-8da5-7347f0a9d853 tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1ab8164728e46b787777c8122bfab93', 'request_id': 'req-6197cf61-d2d3-4ba6-8da5-7347f0a9d853'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:35.040682 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6197cf61-d2d3-4ba6-8da5-7347f0a9d853 tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1ab8164728e46b787777c8122bfab93', 'request_id': 'req-6197cf61-d2d3-4ba6-8da5-7347f0a9d853'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:35.056736 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6197cf61-d2d3-4ba6-8da5-7347f0a9d853 tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] The token cache is being invalidate because project f1ab8164728e46b787777c8122bfab93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:55:35.057639 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6197cf61-d2d3-4ba6-8da5-7347f0a9d853 tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:35.058311 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6197cf61-d2d3-4ba6-8da5-7347f0a9d853 tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:35.060558 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 938/1872] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:55:34 2022] DELETE /identity/v3/projects/f1ab8164728e46b787777c8122bfab93 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:55:35.312233 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cb353-a082-461b-b5e6-70b5bddda7c1 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:35.314124 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-362cb353-a082-461b-b5e6-70b5bddda7c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:35.326716 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197cf61-d2d3-4ba6-8da5-7347f0a9d853 tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:35.328623 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6197cf61-d2d3-4ba6-8da5-7347f0a9d853 tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:35.396225 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cb353-a082-461b-b5e6-70b5bddda7c1 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:35.401563 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621b16a-1a2e-4a31-8962-88bc1870fecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:35.402238 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621b16a-1a2e-4a31-8962-88bc1870fecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:35.402785 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621b16a-1a2e-4a31-8962-88bc1870fecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:35.402785 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621b16a-1a2e-4a31-8962-88bc1870fecb admin admin] PATH_INFO: `/v3/users/d4f1e68b74e34352ac22213f841133fb` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:35.403169 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197cf61-d2d3-4ba6-8da5-7347f0a9d853 tempest-VolumeQuotaClassesTest-1965916683 tempest-VolumeQuotaClassesTest-1965916683-project-admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:35.403966 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621b16a-1a2e-4a31-8962-88bc1870fecb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4f1e68b74e34352ac22213f841133fb)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:35.406011 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621b16a-1a2e-4a31-8962-88bc1870fecb admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:35.409060 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd5030-7d6b-45bc-9be6-8a4485abcdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:35.410119 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd5030-7d6b-45bc-9be6-8a4485abcdd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:35.410805 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd5030-7d6b-45bc-9be6-8a4485abcdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:35.411156 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd5030-7d6b-45bc-9be6-8a4485abcdd6 admin admin] PATH_INFO: `/v3/projects/aa486a31f8474a979afb23034842496e` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:35.413165 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd5030-7d6b-45bc-9be6-8a4485abcdd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa486a31f8474a979afb23034842496e)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:35.415202 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd5030-7d6b-45bc-9be6-8a4485abcdd6 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:35.459998 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7621b16a-1a2e-4a31-8962-88bc1870fecb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4f1e68b74e34352ac22213f841133fb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:35.462455 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:35.476358 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7621b16a-1a2e-4a31-8962-88bc1870fecb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4f1e68b74e34352ac22213f841133fb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:35.476552 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9efd5030-7d6b-45bc-9be6-8a4485abcdd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa486a31f8474a979afb23034842496e', 'request_id': 'req-9efd5030-7d6b-45bc-9be6-8a4485abcdd6'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:35.482210 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:35.486941 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9efd5030-7d6b-45bc-9be6-8a4485abcdd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa486a31f8474a979afb23034842496e', 'request_id': 'req-9efd5030-7d6b-45bc-9be6-8a4485abcdd6'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:35.496373 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9efd5030-7d6b-45bc-9be6-8a4485abcdd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa486a31f8474a979afb23034842496e', 'request_id': 'req-9efd5030-7d6b-45bc-9be6-8a4485abcdd6'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:35.499148 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7621b16a-1a2e-4a31-8962-88bc1870fecb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4f1e68b74e34352ac22213f841133fb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:35.511283 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9efd5030-7d6b-45bc-9be6-8a4485abcdd6 admin admin] The token cache is being invalidate because project aa486a31f8474a979afb23034842496e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:55:35.511578 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9efd5030-7d6b-45bc-9be6-8a4485abcdd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:35.512252 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9efd5030-7d6b-45bc-9be6-8a4485abcdd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:35.512682 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7621b16a-1a2e-4a31-8962-88bc1870fecb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4f1e68b74e34352ac22213f841133fb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:35.513357 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7621b16a-1a2e-4a31-8962-88bc1870fecb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4f1e68b74e34352ac22213f841133fb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:35.513768 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 939/1873] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:55:35 2022] DELETE /identity/v3/projects/aa486a31f8474a979afb23034842496e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:35.517562 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd5030-7d6b-45bc-9be6-8a4485abcdd6 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:35.518992 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9efd5030-7d6b-45bc-9be6-8a4485abcdd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:35.521492 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 935/1874] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:55:35 2022] DELETE /identity/v3/users/d4f1e68b74e34352ac22213f841133fb => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:35.525987 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c611b6e-ca45-425b-a7ce-ecdbdfb592cc None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:35.526279 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c611b6e-ca45-425b-a7ce-ecdbdfb592cc None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:35.526551 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c611b6e-ca45-425b-a7ce-ecdbdfb592cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:35.550648 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-8c611b6e-ca45-425b-a7ce-ecdbdfb592cc None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:35.553003 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8c611b6e-ca45-425b-a7ce-ecdbdfb592cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:35.617405 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd5030-7d6b-45bc-9be6-8a4485abcdd6 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:35.632557 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 936/1875] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:35.645054 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c611b6e-ca45-425b-a7ce-ecdbdfb592cc None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:35.647170 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8c611b6e-ca45-425b-a7ce-ecdbdfb592cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:35.693465 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0842db9-7872-49bb-92fe-8bd962f923cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:35.694702 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0842db9-7872-49bb-92fe-8bd962f923cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:35.694814 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0842db9-7872-49bb-92fe-8bd962f923cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:35.695084 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0842db9-7872-49bb-92fe-8bd962f923cc admin admin] PATH_INFO: `/v3/users/07b9f59bef454fb19a5ceb5703613cc5` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:35.696571 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0842db9-7872-49bb-92fe-8bd962f923cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=07b9f59bef454fb19a5ceb5703613cc5)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:35.700077 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0842db9-7872-49bb-92fe-8bd962f923cc admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:35.752276 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c611b6e-ca45-425b-a7ce-ecdbdfb592cc None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:35.758488 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050b2ea-5d3f-413f-b2e0-5d6a0883fb42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:35.759461 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050b2ea-5d3f-413f-b2e0-5d6a0883fb42 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:35.760105 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050b2ea-5d3f-413f-b2e0-5d6a0883fb42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:35.760312 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050b2ea-5d3f-413f-b2e0-5d6a0883fb42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:35.771183 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050b2ea-5d3f-413f-b2e0-5d6a0883fb42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:35.773387 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050b2ea-5d3f-413f-b2e0-5d6a0883fb42 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:35.779773 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-b0842db9-7872-49bb-92fe-8bd962f923cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07b9f59bef454fb19a5ceb5703613cc5'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:35.788069 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-b0842db9-7872-49bb-92fe-8bd962f923cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07b9f59bef454fb19a5ceb5703613cc5'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:35.795939 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 937/1876] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:35.797166 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-b0842db9-7872-49bb-92fe-8bd962f923cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07b9f59bef454fb19a5ceb5703613cc5'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:35.809011 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:35.810412 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-b0842db9-7872-49bb-92fe-8bd962f923cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07b9f59bef454fb19a5ceb5703613cc5'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:35.811199 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-b0842db9-7872-49bb-92fe-8bd962f923cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07b9f59bef454fb19a5ceb5703613cc5'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:35.818551 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 940/1877] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:55:35 2022] DELETE /identity/v3/users/07b9f59bef454fb19a5ceb5703613cc5 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:36.131742 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050b2ea-5d3f-413f-b2e0-5d6a0883fb42 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:36.133428 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c050b2ea-5d3f-413f-b2e0-5d6a0883fb42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:36.149089 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050b2ea-5d3f-413f-b2e0-5d6a0883fb42 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:36.220106 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748e507-de1b-4826-90e9-645ce572681d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:36.221716 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748e507-de1b-4826-90e9-645ce572681d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:36.222089 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748e507-de1b-4826-90e9-645ce572681d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:36.222368 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748e507-de1b-4826-90e9-645ce572681d admin admin] PATH_INFO: `/v3/projects/4da777624e2f4f5e9432b7ff0842cad2` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:36.223687 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d748e507-de1b-4826-90e9-645ce572681d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4da777624e2f4f5e9432b7ff0842cad2)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:36.226056 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d748e507-de1b-4826-90e9-645ce572681d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:36.342665 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:36.363172 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d748e507-de1b-4826-90e9-645ce572681d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4da777624e2f4f5e9432b7ff0842cad2', 'request_id': 'req-d748e507-de1b-4826-90e9-645ce572681d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:36.372213 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d748e507-de1b-4826-90e9-645ce572681d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4da777624e2f4f5e9432b7ff0842cad2', 'request_id': 'req-d748e507-de1b-4826-90e9-645ce572681d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:36.392674 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d748e507-de1b-4826-90e9-645ce572681d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4da777624e2f4f5e9432b7ff0842cad2', 'request_id': 'req-d748e507-de1b-4826-90e9-645ce572681d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:36.422680 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d748e507-de1b-4826-90e9-645ce572681d admin admin] The token cache is being invalidate because project 4da777624e2f4f5e9432b7ff0842cad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:55:36.423115 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d748e507-de1b-4826-90e9-645ce572681d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:36.424453 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d748e507-de1b-4826-90e9-645ce572681d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:36.425885 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 938/1878] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:55:36 2022] DELETE /identity/v3/projects/4da777624e2f4f5e9432b7ff0842cad2 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:36.433667 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd755fb1-ec57-4313-b709-bd8d7ac6bcb6 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:36.434172 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd755fb1-ec57-4313-b709-bd8d7ac6bcb6 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:36.434259 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd755fb1-ec57-4313-b709-bd8d7ac6bcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:36.467083 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-bd755fb1-ec57-4313-b709-bd8d7ac6bcb6 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:36.468565 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-bd755fb1-ec57-4313-b709-bd8d7ac6bcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:36.473209 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748e507-de1b-4826-90e9-645ce572681d admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:36.475558 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d748e507-de1b-4826-90e9-645ce572681d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:36.585763 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 941/1879] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:36.587247 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d8f3d-3afa-4206-af06-93e3706eb188 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:36.587536 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d8f3d-3afa-4206-af06-93e3706eb188 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:36.587814 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d8f3d-3afa-4206-af06-93e3706eb188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:36.612438 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-297d8f3d-3afa-4206-af06-93e3706eb188 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:36.614904 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-297d8f3d-3afa-4206-af06-93e3706eb188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:36.634341 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748e507-de1b-4826-90e9-645ce572681d admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:36.643467 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004861d-b8b5-4afa-8205-8c516a6bbdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:36.644930 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004861d-b8b5-4afa-8205-8c516a6bbdf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:36.645499 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004861d-b8b5-4afa-8205-8c516a6bbdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:36.645980 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004861d-b8b5-4afa-8205-8c516a6bbdf0 admin admin] PATH_INFO: `/v3/projects/210b7b58d4ec4231a3fe788185ffc1f5` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:36.647655 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004861d-b8b5-4afa-8205-8c516a6bbdf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=210b7b58d4ec4231a3fe788185ffc1f5)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:36.649167 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 942/1880] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:36.649696 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004861d-b8b5-4afa-8205-8c516a6bbdf0 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:36.654859 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d8f3d-3afa-4206-af06-93e3706eb188 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:36.679168 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d8f3d-3afa-4206-af06-93e3706eb188 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:36.701138 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f09ac9-c80b-4a4e-bc82-b0d6cf90e091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:36.703502 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f09ac9-c80b-4a4e-bc82-b0d6cf90e091 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:36.704545 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f09ac9-c80b-4a4e-bc82-b0d6cf90e091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:36.705271 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f09ac9-c80b-4a4e-bc82-b0d6cf90e091 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:36.708451 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f09ac9-c80b-4a4e-bc82-b0d6cf90e091 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:36.708769 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f09ac9-c80b-4a4e-bc82-b0d6cf90e091 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:36.716046 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f09ac9-c80b-4a4e-bc82-b0d6cf90e091 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:36.741676 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 943/1881] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:55:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:36.744061 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f004861d-b8b5-4afa-8205-8c516a6bbdf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '210b7b58d4ec4231a3fe788185ffc1f5', 'request_id': 'req-f004861d-b8b5-4afa-8205-8c516a6bbdf0'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:36.746919 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f09ac9-c80b-4a4e-bc82-b0d6cf90e091 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:36.762490 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f004861d-b8b5-4afa-8205-8c516a6bbdf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '210b7b58d4ec4231a3fe788185ffc1f5', 'request_id': 'req-f004861d-b8b5-4afa-8205-8c516a6bbdf0'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:36.764328 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f09ac9-c80b-4a4e-bc82-b0d6cf90e091 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:36.773343 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f004861d-b8b5-4afa-8205-8c516a6bbdf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '210b7b58d4ec4231a3fe788185ffc1f5', 'request_id': 'req-f004861d-b8b5-4afa-8205-8c516a6bbdf0'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:36.801553 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f004861d-b8b5-4afa-8205-8c516a6bbdf0 admin admin] The token cache is being invalidate because project 210b7b58d4ec4231a3fe788185ffc1f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:55:36.801943 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f004861d-b8b5-4afa-8205-8c516a6bbdf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:36.802615 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f004861d-b8b5-4afa-8205-8c516a6bbdf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:36.804188 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 939/1882] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:55:36 2022] DELETE /identity/v3/projects/210b7b58d4ec4231a3fe788185ffc1f5 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:55:36.809326 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004861d-b8b5-4afa-8205-8c516a6bbdf0 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:36.811151 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f004861d-b8b5-4afa-8205-8c516a6bbdf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:36.864398 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cd981-b360-4816-882d-1a8fa64c9f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:36.865503 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cd981-b360-4816-882d-1a8fa64c9f8d admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:36.866040 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cd981-b360-4816-882d-1a8fa64c9f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:36.866532 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cd981-b360-4816-882d-1a8fa64c9f8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:36.868491 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606cd981-b360-4816-882d-1a8fa64c9f8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:36.875036 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606cd981-b360-4816-882d-1a8fa64c9f8d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:36.924256 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:36.953409 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004861d-b8b5-4afa-8205-8c516a6bbdf0 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:36.962437 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 944/1883] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:55:36 2022] POST /identity/v3/projects => generated 407 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:36.963491 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cd981-b360-4816-882d-1a8fa64c9f8d admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:36.967491 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45842b11-d855-48c1-9f11-1a9807da31de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:36.967671 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-606cd981-b360-4816-882d-1a8fa64c9f8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:36.969454 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45842b11-d855-48c1-9f11-1a9807da31de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:36.969454 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45842b11-d855-48c1-9f11-1a9807da31de admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:36.969454 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45842b11-d855-48c1-9f11-1a9807da31de admin admin] PATH_INFO: `/v3/users/b4309f99e5d74c8ba15395f61067c435` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:36.970817 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45842b11-d855-48c1-9f11-1a9807da31de admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4309f99e5d74c8ba15395f61067c435)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:36.974000 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45842b11-d855-48c1-9f11-1a9807da31de admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:37.099009 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-45842b11-d855-48c1-9f11-1a9807da31de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4309f99e5d74c8ba15395f61067c435'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:37.114572 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cd981-b360-4816-882d-1a8fa64c9f8d admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:37.129592 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f20475-0d2b-4df6-860c-0d066cec5501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:37.130744 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-45842b11-d855-48c1-9f11-1a9807da31de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4309f99e5d74c8ba15395f61067c435'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:37.132220 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f20475-0d2b-4df6-860c-0d066cec5501 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:37.132900 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f20475-0d2b-4df6-860c-0d066cec5501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:37.134179 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f20475-0d2b-4df6-860c-0d066cec5501 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:37.135356 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f20475-0d2b-4df6-860c-0d066cec5501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:37.143403 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-45842b11-d855-48c1-9f11-1a9807da31de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4309f99e5d74c8ba15395f61067c435'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:37.152731 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f20475-0d2b-4df6-860c-0d066cec5501 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:37.153685 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-45842b11-d855-48c1-9f11-1a9807da31de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4309f99e5d74c8ba15395f61067c435'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:37.154801 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-45842b11-d855-48c1-9f11-1a9807da31de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4309f99e5d74c8ba15395f61067c435'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:37.166530 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 940/1884] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:55:36 2022] DELETE /identity/v3/users/b4309f99e5d74c8ba15395f61067c435 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:55:37.186960 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:37.211612 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 945/1885] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:55:36 2022] POST /identity/v3/users => generated 304 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:37.212748 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45842b11-d855-48c1-9f11-1a9807da31de admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:37.214614 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-45842b11-d855-48c1-9f11-1a9807da31de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:37.321910 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45842b11-d855-48c1-9f11-1a9807da31de admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:37.328531 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46bd329-00b9-4af7-8f22-7e93029f8d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:37.330289 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bd329-00b9-4af7-8f22-7e93029f8d21 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:37.331030 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bd329-00b9-4af7-8f22-7e93029f8d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:37.331344 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bd329-00b9-4af7-8f22-7e93029f8d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:37.332187 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46bd329-00b9-4af7-8f22-7e93029f8d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:37.334076 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46bd329-00b9-4af7-8f22-7e93029f8d21 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:37.349371 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 941/1886] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:37.351033 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f20475-0d2b-4df6-860c-0d066cec5501 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:37.363805 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f20475-0d2b-4df6-860c-0d066cec5501 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:37.369601 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e0f0d-5795-4d4b-a0ae-db0878ebe119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:37.370445 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e0f0d-5795-4d4b-a0ae-db0878ebe119 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:37.370824 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e0f0d-5795-4d4b-a0ae-db0878ebe119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:37.371276 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e0f0d-5795-4d4b-a0ae-db0878ebe119 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:37.372214 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e0f0d-5795-4d4b-a0ae-db0878ebe119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:37.374425 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e0f0d-5795-4d4b-a0ae-db0878ebe119 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:37.389878 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 946/1887] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:55:37.391567 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46bd329-00b9-4af7-8f22-7e93029f8d21 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:37.407114 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46bd329-00b9-4af7-8f22-7e93029f8d21 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:37.422586 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496c1fa-27ae-47e3-a975-f11c10ac09e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:37.423679 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496c1fa-27ae-47e3-a975-f11c10ac09e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:37.423679 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496c1fa-27ae-47e3-a975-f11c10ac09e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:37.424129 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496c1fa-27ae-47e3-a975-f11c10ac09e1 admin admin] PATH_INFO: `/v3/projects/03547711939241a5b12c7172c7f82913/users/9835a0ae533446309efe4057805014ae/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:37.441039 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496c1fa-27ae-47e3-a975-f11c10ac09e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03547711939241a5b12c7172c7f82913, user_id=9835a0ae533446309efe4057805014ae, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:37.443771 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496c1fa-27ae-47e3-a975-f11c10ac09e1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:37.477611 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 942/1888] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:37 2022] PUT /identity/v3/projects/03547711939241a5b12c7172c7f82913/users/9835a0ae533446309efe4057805014ae/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:37.479373 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3209e-a960-4189-9cd6-00f0ef2e4a2f None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:37.479866 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3209e-a960-4189-9cd6-00f0ef2e4a2f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:37.479960 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3209e-a960-4189-9cd6-00f0ef2e4a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:37.508891 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-caf3209e-a960-4189-9cd6-00f0ef2e4a2f None None] MFA Rules not processed for user `9835a0ae533446309efe4057805014ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:37.510662 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-caf3209e-a960-4189-9cd6-00f0ef2e4a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:37.590243 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 947/1889] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:37 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:37.594646 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496c1fa-27ae-47e3-a975-f11c10ac09e1 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:37.603501 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3209e-a960-4189-9cd6-00f0ef2e4a2f None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:37.606012 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-caf3209e-a960-4189-9cd6-00f0ef2e4a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:37.671381 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:37.706143 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3209e-a960-4189-9cd6-00f0ef2e4a2f None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:37.711240 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ea627-bce3-4387-804b-8d812406aa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:37.711902 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ea627-bce3-4387-804b-8d812406aa73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:37.712072 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496c1fa-27ae-47e3-a975-f11c10ac09e1 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:37.712239 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ea627-bce3-4387-804b-8d812406aa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:37.712494 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ea627-bce3-4387-804b-8d812406aa73 admin admin] PATH_INFO: `/v3/projects/acc6aa53a63748069d92244c50f9105e` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:37.713881 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ea627-bce3-4387-804b-8d812406aa73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acc6aa53a63748069d92244c50f9105e)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:37.716337 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ea627-bce3-4387-804b-8d812406aa73 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:37.719459 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242f8c2-d09c-4133-b740-3afdad910012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:37.720214 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242f8c2-d09c-4133-b740-3afdad910012 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:37.720555 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242f8c2-d09c-4133-b740-3afdad910012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:37.720987 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242f8c2-d09c-4133-b740-3afdad910012 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:37.721702 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242f8c2-d09c-4133-b740-3afdad910012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:37.723938 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242f8c2-d09c-4133-b740-3afdad910012 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:37.759295 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 943/1890] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:55:37 2022] POST /identity/v3/projects => generated 407 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:37.764136 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242f8c2-d09c-4133-b740-3afdad910012 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:37.780526 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-633ea627-bce3-4387-804b-8d812406aa73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acc6aa53a63748069d92244c50f9105e', 'request_id': 'req-633ea627-bce3-4387-804b-8d812406aa73'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:37.790671 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-633ea627-bce3-4387-804b-8d812406aa73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acc6aa53a63748069d92244c50f9105e', 'request_id': 'req-633ea627-bce3-4387-804b-8d812406aa73'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:37.798795 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-633ea627-bce3-4387-804b-8d812406aa73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acc6aa53a63748069d92244c50f9105e', 'request_id': 'req-633ea627-bce3-4387-804b-8d812406aa73'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:37.807230 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:37.812354 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-633ea627-bce3-4387-804b-8d812406aa73 admin admin] The token cache is being invalidate because project acc6aa53a63748069d92244c50f9105e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:55:37.812897 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-633ea627-bce3-4387-804b-8d812406aa73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:37.813714 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-633ea627-bce3-4387-804b-8d812406aa73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:37.817933 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 948/1891] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:55:37 2022] DELETE /identity/v3/projects/acc6aa53a63748069d92244c50f9105e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:37.821348 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b223534-4067-44cc-abd9-e5fc8b8f7814 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:37.821800 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b223534-4067-44cc-abd9-e5fc8b8f7814 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:37.822124 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b223534-4067-44cc-abd9-e5fc8b8f7814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:37.841256 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242f8c2-d09c-4133-b740-3afdad910012 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:37.843388 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-8b223534-4067-44cc-abd9-e5fc8b8f7814 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:37.844599 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8b223534-4067-44cc-abd9-e5fc8b8f7814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:37.897794 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49349a36-c03e-466a-bcfb-9ea969456287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:37.898468 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49349a36-c03e-466a-bcfb-9ea969456287 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:37.898744 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49349a36-c03e-466a-bcfb-9ea969456287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:37.899009 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49349a36-c03e-466a-bcfb-9ea969456287 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:37.899633 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49349a36-c03e-466a-bcfb-9ea969456287 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:37.902147 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49349a36-c03e-466a-bcfb-9ea969456287 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:37.903923 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 949/1892] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:37.911637 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e67cd-f822-40ab-8c09-edb67b310bdd None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:37.911927 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e67cd-f822-40ab-8c09-edb67b310bdd None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:37.912169 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e67cd-f822-40ab-8c09-edb67b310bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:37.925375 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 944/1893] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:55:37 2022] POST /identity/v3/users => generated 310 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:55:37.929296 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49349a36-c03e-466a-bcfb-9ea969456287 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:37.931198 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-49349a36-c03e-466a-bcfb-9ea969456287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:37.933318 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-450e67cd-f822-40ab-8c09-edb67b310bdd None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:37.934555 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-450e67cd-f822-40ab-8c09-edb67b310bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:37.942230 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 950/1894] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:55:37.943596 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49349a36-c03e-466a-bcfb-9ea969456287 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:37.946246 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e67cd-f822-40ab-8c09-edb67b310bdd None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:37.949277 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e88372-4e94-4eb9-8c47-7ba578dd20fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:37.949940 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e88372-4e94-4eb9-8c47-7ba578dd20fb admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:37.950204 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e88372-4e94-4eb9-8c47-7ba578dd20fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:37.950479 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e88372-4e94-4eb9-8c47-7ba578dd20fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:37.951130 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e88372-4e94-4eb9-8c47-7ba578dd20fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:37.952791 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e88372-4e94-4eb9-8c47-7ba578dd20fb admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:37.956389 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e67cd-f822-40ab-8c09-edb67b310bdd None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:37.961681 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153b2b0-a9ad-4e2d-964a-a5ab282e8813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:37.962424 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153b2b0-a9ad-4e2d-964a-a5ab282e8813 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:37.962699 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153b2b0-a9ad-4e2d-964a-a5ab282e8813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:37.962966 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153b2b0-a9ad-4e2d-964a-a5ab282e8813 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:37.963407 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 945/1895] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:37.963683 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153b2b0-a9ad-4e2d-964a-a5ab282e8813 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:37.964343 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153b2b0-a9ad-4e2d-964a-a5ab282e8813 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:37.965597 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153b2b0-a9ad-4e2d-964a-a5ab282e8813 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:37.967766 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e88372-4e94-4eb9-8c47-7ba578dd20fb admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:37.978304 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 951/1896] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:55:37.978737 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e88372-4e94-4eb9-8c47-7ba578dd20fb admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:37.983158 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153b2b0-a9ad-4e2d-964a-a5ab282e8813 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:37.984007 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbcbd8-6925-4fe9-a8f1-40958e610cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:37.984662 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbcbd8-6925-4fe9-a8f1-40958e610cd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:37.984941 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbcbd8-6925-4fe9-a8f1-40958e610cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:37.985205 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbcbd8-6925-4fe9-a8f1-40958e610cd9 admin admin] PATH_INFO: `/v3/projects/b7d6fc5df1764f1a93bc0f5aaae0c376/users/e3b10e0878b9449b8ddde611311197ec/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:37.992854 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153b2b0-a9ad-4e2d-964a-a5ab282e8813 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:37.997544 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc24b5-b633-4856-99fa-f5a3d79f5963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:37.998243 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc24b5-b633-4856-99fa-f5a3d79f5963 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:37.998951 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc24b5-b633-4856-99fa-f5a3d79f5963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:37.998951 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc24b5-b633-4856-99fa-f5a3d79f5963 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:37.999406 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc24b5-b633-4856-99fa-f5a3d79f5963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:38.001365 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbcbd8-6925-4fe9-a8f1-40958e610cd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7d6fc5df1764f1a93bc0f5aaae0c376, user_id=e3b10e0878b9449b8ddde611311197ec, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:38.001545 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc24b5-b633-4856-99fa-f5a3d79f5963 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:38.004401 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbcbd8-6925-4fe9-a8f1-40958e610cd9 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:38.019784 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 946/1897] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:37 2022] PUT /identity/v3/projects/b7d6fc5df1764f1a93bc0f5aaae0c376/users/e3b10e0878b9449b8ddde611311197ec/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:55:38.024279 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbcbd8-6925-4fe9-a8f1-40958e610cd9 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:38.037768 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 952/1898] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:55:37 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:55:38.041565 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc24b5-b633-4856-99fa-f5a3d79f5963 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:38.067045 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:38.109419 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc24b5-b633-4856-99fa-f5a3d79f5963 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:38.112498 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbcbd8-6925-4fe9-a8f1-40958e610cd9 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:38.117116 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf7f15-ce60-43c2-9671-0b46b7670fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:38.117818 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62e2e6-a670-4cf1-a33a-6fa0dec9ebe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:38.118008 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf7f15-ce60-43c2-9671-0b46b7670fcc admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:38.118190 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf7f15-ce60-43c2-9671-0b46b7670fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:38.118402 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf7f15-ce60-43c2-9671-0b46b7670fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:38.118503 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62e2e6-a670-4cf1-a33a-6fa0dec9ebe9 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:38.118800 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62e2e6-a670-4cf1-a33a-6fa0dec9ebe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:38.118992 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62e2e6-a670-4cf1-a33a-6fa0dec9ebe9 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:38.119090 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf7f15-ce60-43c2-9671-0b46b7670fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:38.119669 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62e2e6-a670-4cf1-a33a-6fa0dec9ebe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:38.120828 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf7f15-ce60-43c2-9671-0b46b7670fcc admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:38.121572 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62e2e6-a670-4cf1-a33a-6fa0dec9ebe9 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:38.132005 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 947/1899] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:38.137044 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf7f15-ce60-43c2-9671-0b46b7670fcc admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:38.150737 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 953/1900] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:55:38 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:55:38.150921 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf7f15-ce60-43c2-9671-0b46b7670fcc admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:38.151841 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62e2e6-a670-4cf1-a33a-6fa0dec9ebe9 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:38.154491 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fd87c-bd6b-4a8d-a676-c71d0549f521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:38.155148 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fd87c-bd6b-4a8d-a676-c71d0549f521 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:38.155423 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fd87c-bd6b-4a8d-a676-c71d0549f521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:38.155722 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fd87c-bd6b-4a8d-a676-c71d0549f521 admin admin] PATH_INFO: `/v3/projects/b7d6fc5df1764f1a93bc0f5aaae0c376/users/e3b10e0878b9449b8ddde611311197ec/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:38.157688 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fd87c-bd6b-4a8d-a676-c71d0549f521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7d6fc5df1764f1a93bc0f5aaae0c376, user_id=e3b10e0878b9449b8ddde611311197ec, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:38.160802 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fd87c-bd6b-4a8d-a676-c71d0549f521 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:38.163930 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62e2e6-a670-4cf1-a33a-6fa0dec9ebe9 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:38.170936 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b552d-ba25-4554-b8bf-4074662a3bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:38.170936 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b552d-ba25-4554-b8bf-4074662a3bee admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:38.170936 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b552d-ba25-4554-b8bf-4074662a3bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:38.173342 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b552d-ba25-4554-b8bf-4074662a3bee admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:38.174645 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b552d-ba25-4554-b8bf-4074662a3bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:38.177459 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 948/1901] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:38 2022] PUT /identity/v3/projects/b7d6fc5df1764f1a93bc0f5aaae0c376/users/e3b10e0878b9449b8ddde611311197ec/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:38.187914 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2935195-6e89-4360-a42b-d834bee666bd None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:38.188202 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2935195-6e89-4360-a42b-d834bee666bd None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:38.188474 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b552d-ba25-4554-b8bf-4074662a3bee admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:38.188578 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2935195-6e89-4360-a42b-d834bee666bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:38.221216 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a2935195-6e89-4360-a42b-d834bee666bd None None] MFA Rules not processed for user `e3b10e0878b9449b8ddde611311197ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:38.222467 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a2935195-6e89-4360-a42b-d834bee666bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:38.244700 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 954/1902] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:55:38.246313 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b552d-ba25-4554-b8bf-4074662a3bee admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:38.268479 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b552d-ba25-4554-b8bf-4074662a3bee admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:38.319915 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 949/1903] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:38 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:38.326950 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:38.328015 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2935195-6e89-4360-a42b-d834bee666bd None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:38.329791 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a2935195-6e89-4360-a42b-d834bee666bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:38.364498 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df9fe5-ecde-4597-aa3e-0a11c2191c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:38.365147 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df9fe5-ecde-4597-aa3e-0a11c2191c07 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:38.365428 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df9fe5-ecde-4597-aa3e-0a11c2191c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:38.365699 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df9fe5-ecde-4597-aa3e-0a11c2191c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:38.366386 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df9fe5-ecde-4597-aa3e-0a11c2191c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:38.372312 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df9fe5-ecde-4597-aa3e-0a11c2191c07 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:38.397796 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 955/1904] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:38.399433 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df9fe5-ecde-4597-aa3e-0a11c2191c07 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:38.414836 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df9fe5-ecde-4597-aa3e-0a11c2191c07 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:38.417662 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2935195-6e89-4360-a42b-d834bee666bd None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:38.420486 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057caad-e882-4041-b7f9-04eb91b3832a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:38.421174 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057caad-e882-4041-b7f9-04eb91b3832a admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:38.421464 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057caad-e882-4041-b7f9-04eb91b3832a admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:38.421805 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057caad-e882-4041-b7f9-04eb91b3832a admin admin] PATH_INFO: `/v3/projects/cd12e696095a4f419598c246fb301406/users/69b8ff3b6cff499a96ed291323b48bdb/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:38.422324 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f0c85-2fa6-495a-b050-9eb2b84e37ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:38.423206 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f0c85-2fa6-495a-b050-9eb2b84e37ad service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:38.423571 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f0c85-2fa6-495a-b050-9eb2b84e37ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:38.424001 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f0c85-2fa6-495a-b050-9eb2b84e37ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:38.434039 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f0c85-2fa6-495a-b050-9eb2b84e37ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:38.435905 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f0c85-2fa6-495a-b050-9eb2b84e37ad service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:38.443510 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057caad-e882-4041-b7f9-04eb91b3832a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd12e696095a4f419598c246fb301406, user_id=69b8ff3b6cff499a96ed291323b48bdb, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:38.449935 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057caad-e882-4041-b7f9-04eb91b3832a admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:38.450129 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 950/1905] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:38 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:38.479519 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 956/1906] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:38 2022] PUT /identity/v3/projects/cd12e696095a4f419598c246fb301406/users/69b8ff3b6cff499a96ed291323b48bdb/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:38.484890 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f60fc4-64fb-4f28-989b-6b0cabda1501 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:38.485354 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f60fc4-64fb-4f28-989b-6b0cabda1501 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:38.485629 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f60fc4-64fb-4f28-989b-6b0cabda1501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:38.508837 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e8f60fc4-64fb-4f28-989b-6b0cabda1501 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:38.510534 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e8f60fc4-64fb-4f28-989b-6b0cabda1501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:38.607002 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:38.640362 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 951/1907] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:38.649907 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057caad-e882-4041-b7f9-04eb91b3832a admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:38.652192 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f057caad-e882-4041-b7f9-04eb91b3832a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:38.761446 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057caad-e882-4041-b7f9-04eb91b3832a admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:38.772757 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66126156-e286-4a1a-b379-e1a6edc8258d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:38.775058 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f60fc4-64fb-4f28-989b-6b0cabda1501 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:38.777788 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e8f60fc4-64fb-4f28-989b-6b0cabda1501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:38.779216 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66126156-e286-4a1a-b379-e1a6edc8258d service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:38.779585 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66126156-e286-4a1a-b379-e1a6edc8258d service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:38.780000 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66126156-e286-4a1a-b379-e1a6edc8258d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:38.797141 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66126156-e286-4a1a-b379-e1a6edc8258d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:38.797884 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66126156-e286-4a1a-b379-e1a6edc8258d service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:38.808956 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 957/1908] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:38.842351 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66126156-e286-4a1a-b379-e1a6edc8258d service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:38.844240 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-66126156-e286-4a1a-b379-e1a6edc8258d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:38.859220 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66126156-e286-4a1a-b379-e1a6edc8258d service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:38.878006 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82183e-b7ad-4a6e-ab77-55f5c682375c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:38.879283 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82183e-b7ad-4a6e-ab77-55f5c682375c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:38.879581 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82183e-b7ad-4a6e-ab77-55f5c682375c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:38.880347 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82183e-b7ad-4a6e-ab77-55f5c682375c admin admin] PATH_INFO: `/v3/users/021af6e23f27421e8b71cac0579b6e59` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:38.881243 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82183e-b7ad-4a6e-ab77-55f5c682375c admin admin] RBAC: Authorizing `identity:delete_user(user_id=021af6e23f27421e8b71cac0579b6e59)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:38.886068 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f60fc4-64fb-4f28-989b-6b0cabda1501 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:38.886381 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82183e-b7ad-4a6e-ab77-55f5c682375c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:38.893301 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94091b87-8e22-4939-91ba-b625568683ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:38.893974 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94091b87-8e22-4939-91ba-b625568683ea service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:38.894259 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94091b87-8e22-4939-91ba-b625568683ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:38.894549 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94091b87-8e22-4939-91ba-b625568683ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:38.906393 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-94091b87-8e22-4939-91ba-b625568683ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:38.977309 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-2b82183e-b7ad-4a6e-ab77-55f5c682375c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '021af6e23f27421e8b71cac0579b6e59'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:38.985131 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-2b82183e-b7ad-4a6e-ab77-55f5c682375c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '021af6e23f27421e8b71cac0579b6e59'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:38.994994 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-2b82183e-b7ad-4a6e-ab77-55f5c682375c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '021af6e23f27421e8b71cac0579b6e59'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:39.010351 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-2b82183e-b7ad-4a6e-ab77-55f5c682375c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '021af6e23f27421e8b71cac0579b6e59'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:39.011354 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-2b82183e-b7ad-4a6e-ab77-55f5c682375c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '021af6e23f27421e8b71cac0579b6e59'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:39.023859 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 958/1909] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:55:38 2022] DELETE /identity/v3/users/021af6e23f27421e8b71cac0579b6e59 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:55:39.025799 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a35c1-a46e-4d3d-a2c1-117d6b8b6633 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:39.026586 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a35c1-a46e-4d3d-a2c1-117d6b8b6633 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:39.026586 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a35c1-a46e-4d3d-a2c1-117d6b8b6633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:39.058167 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-608a35c1-a46e-4d3d-a2c1-117d6b8b6633 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:39.059713 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-608a35c1-a46e-4d3d-a2c1-117d6b8b6633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:39.079291 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94091b87-8e22-4939-91ba-b625568683ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:39.083341 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94091b87-8e22-4939-91ba-b625568683ea service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:39.106492 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:39.115437 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 952/1910] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:38 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:39.228659 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 959/1911] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:39.262587 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94091b87-8e22-4939-91ba-b625568683ea service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:39.265398 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-94091b87-8e22-4939-91ba-b625568683ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:39.288179 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94091b87-8e22-4939-91ba-b625568683ea service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:39.374663 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24b177-5476-4898-9ccb-12e45f4db2e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:39.375584 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24b177-5476-4898-9ccb-12e45f4db2e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:39.376022 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24b177-5476-4898-9ccb-12e45f4db2e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:39.376294 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24b177-5476-4898-9ccb-12e45f4db2e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:39.386219 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24b177-5476-4898-9ccb-12e45f4db2e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:39.387675 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24b177-5476-4898-9ccb-12e45f4db2e4 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:39.398247 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 953/1912] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:39.894107 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a35c1-a46e-4d3d-a2c1-117d6b8b6633 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:39.898440 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-608a35c1-a46e-4d3d-a2c1-117d6b8b6633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:39.915371 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a35c1-a46e-4d3d-a2c1-117d6b8b6633 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:39.933409 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ad85a-3d21-46cc-87bc-cfda552fe2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:39.933409 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ad85a-3d21-46cc-87bc-cfda552fe2cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:39.933409 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ad85a-3d21-46cc-87bc-cfda552fe2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:39.933409 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ad85a-3d21-46cc-87bc-cfda552fe2cc admin admin] PATH_INFO: `/v3/projects/6c25a08e78ff493f9a79ad8d5454602f` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:39.934335 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ad85a-3d21-46cc-87bc-cfda552fe2cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c25a08e78ff493f9a79ad8d5454602f)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:39.934335 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ad85a-3d21-46cc-87bc-cfda552fe2cc admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:40.008932 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-298ad85a-3d21-46cc-87bc-cfda552fe2cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c25a08e78ff493f9a79ad8d5454602f', 'request_id': 'req-298ad85a-3d21-46cc-87bc-cfda552fe2cc'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:40.019985 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-298ad85a-3d21-46cc-87bc-cfda552fe2cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c25a08e78ff493f9a79ad8d5454602f', 'request_id': 'req-298ad85a-3d21-46cc-87bc-cfda552fe2cc'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:40.029423 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-298ad85a-3d21-46cc-87bc-cfda552fe2cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c25a08e78ff493f9a79ad8d5454602f', 'request_id': 'req-298ad85a-3d21-46cc-87bc-cfda552fe2cc'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:40.042590 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-298ad85a-3d21-46cc-87bc-cfda552fe2cc admin admin] The token cache is being invalidate because project 6c25a08e78ff493f9a79ad8d5454602f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:55:40.042974 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-298ad85a-3d21-46cc-87bc-cfda552fe2cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:40.043714 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-298ad85a-3d21-46cc-87bc-cfda552fe2cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:40.045691 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 960/1913] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:55:39 2022] DELETE /identity/v3/projects/6c25a08e78ff493f9a79ad8d5454602f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:40.049526 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24b177-5476-4898-9ccb-12e45f4db2e4 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:40.059870 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24b177-5476-4898-9ccb-12e45f4db2e4 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:40.102687 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:40.140940 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fd15c-506c-4c08-a074-938a66817bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:40.142229 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fd15c-506c-4c08-a074-938a66817bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:40.143019 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fd15c-506c-4c08-a074-938a66817bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:40.143510 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fd15c-506c-4c08-a074-938a66817bb6 admin admin] PATH_INFO: `/v3/users/f5b56532c01048148d7c43882fa9a1bd` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:40.145044 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fd15c-506c-4c08-a074-938a66817bb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5b56532c01048148d7c43882fa9a1bd)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:40.147743 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fd15c-506c-4c08-a074-938a66817bb6 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:40.230639 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02277ba-3e1d-4ef0-b706-c8ab33d40966 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:40.230905 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02277ba-3e1d-4ef0-b706-c8ab33d40966 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:40.231183 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02277ba-3e1d-4ef0-b706-c8ab33d40966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:40.251514 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3b8fd15c-506c-4c08-a074-938a66817bb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5b56532c01048148d7c43882fa9a1bd'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:40.272050 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-d02277ba-3e1d-4ef0-b706-c8ab33d40966 None None] MFA Rules not processed for user `69b8ff3b6cff499a96ed291323b48bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:40.273205 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d02277ba-3e1d-4ef0-b706-c8ab33d40966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:40.283104 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3b8fd15c-506c-4c08-a074-938a66817bb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5b56532c01048148d7c43882fa9a1bd'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:40.294962 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3b8fd15c-506c-4c08-a074-938a66817bb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5b56532c01048148d7c43882fa9a1bd'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:40.305528 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3b8fd15c-506c-4c08-a074-938a66817bb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5b56532c01048148d7c43882fa9a1bd'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:40.306228 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3b8fd15c-506c-4c08-a074-938a66817bb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5b56532c01048148d7c43882fa9a1bd'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:40.319300 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 954/1914] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:55:40 2022] DELETE /identity/v3/users/f5b56532c01048148d7c43882fa9a1bd => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:40.410885 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fd15c-506c-4c08-a074-938a66817bb6 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:40.412809 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3b8fd15c-506c-4c08-a074-938a66817bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:40.413345 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 961/1915] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:40.501116 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fd15c-506c-4c08-a074-938a66817bb6 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:40.506653 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69c99a-1128-4774-affd-890773f7da60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:40.507446 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69c99a-1128-4774-affd-890773f7da60 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:40.508022 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69c99a-1128-4774-affd-890773f7da60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:40.508439 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69c99a-1128-4774-affd-890773f7da60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:40.509231 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69c99a-1128-4774-affd-890773f7da60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:40.511860 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69c99a-1128-4774-affd-890773f7da60 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:40.556293 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 955/1916] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:55:40 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:55:40.560841 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02277ba-3e1d-4ef0-b706-c8ab33d40966 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:40.580979 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02277ba-3e1d-4ef0-b706-c8ab33d40966 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:40.632912 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:40.674011 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58754e-9f4e-4848-b856-a331d505550a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:40.674647 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58754e-9f4e-4848-b856-a331d505550a admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:40.674929 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58754e-9f4e-4848-b856-a331d505550a admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:40.675260 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58754e-9f4e-4848-b856-a331d505550a admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:40.676430 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58754e-9f4e-4848-b856-a331d505550a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:40.677867 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58754e-9f4e-4848-b856-a331d505550a admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:40.726567 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 962/1917] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:55:40 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:40.730983 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69c99a-1128-4774-affd-890773f7da60 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:40.738084 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58754e-9f4e-4848-b856-a331d505550a admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:40.744035 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8b58754e-9f4e-4848-b856-a331d505550a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:40.750751 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69c99a-1128-4774-affd-890773f7da60 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:40.760352 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32adb7e-bddf-4162-9d1f-b4537e484201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:40.763593 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32adb7e-bddf-4162-9d1f-b4537e484201 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:40.764139 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32adb7e-bddf-4162-9d1f-b4537e484201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:40.764622 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32adb7e-bddf-4162-9d1f-b4537e484201 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:40.765632 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32adb7e-bddf-4162-9d1f-b4537e484201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:40.767944 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32adb7e-bddf-4162-9d1f-b4537e484201 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:40.769863 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58754e-9f4e-4848-b856-a331d505550a admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:40.778277 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600e0d1-2a18-41c4-9ce3-8c0fdcccbf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:40.779479 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600e0d1-2a18-41c4-9ce3-8c0fdcccbf2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:40.779763 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600e0d1-2a18-41c4-9ce3-8c0fdcccbf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:40.783545 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600e0d1-2a18-41c4-9ce3-8c0fdcccbf2b admin admin] PATH_INFO: `/v3/projects/5c245ecc6caf48c5b07a87137cd5cd93` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:40.783704 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 956/1918] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:40.783802 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600e0d1-2a18-41c4-9ce3-8c0fdcccbf2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c245ecc6caf48c5b07a87137cd5cd93)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:40.783802 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600e0d1-2a18-41c4-9ce3-8c0fdcccbf2b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:40.792801 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32adb7e-bddf-4162-9d1f-b4537e484201 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:40.824787 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32adb7e-bddf-4162-9d1f-b4537e484201 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:40.837969 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0e66e-d22c-4a74-9932-14150bf30fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:40.839100 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0e66e-d22c-4a74-9932-14150bf30fe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:40.839702 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0e66e-d22c-4a74-9932-14150bf30fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:40.840179 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0e66e-d22c-4a74-9932-14150bf30fe9 admin admin] PATH_INFO: `/v3/projects/9f7e899db2ce4a86b1afd0f0677c1aca/users/c4f4b7a3657042a184dd205fcc32eee4/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:40.856764 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-a600e0d1-2a18-41c4-9ce3-8c0fdcccbf2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c245ecc6caf48c5b07a87137cd5cd93', 'request_id': 'req-a600e0d1-2a18-41c4-9ce3-8c0fdcccbf2b'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:40.868291 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-a600e0d1-2a18-41c4-9ce3-8c0fdcccbf2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c245ecc6caf48c5b07a87137cd5cd93', 'request_id': 'req-a600e0d1-2a18-41c4-9ce3-8c0fdcccbf2b'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:40.869684 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0e66e-d22c-4a74-9932-14150bf30fe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f7e899db2ce4a86b1afd0f0677c1aca, user_id=c4f4b7a3657042a184dd205fcc32eee4, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:40.872892 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0e66e-d22c-4a74-9932-14150bf30fe9 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:40.878543 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-a600e0d1-2a18-41c4-9ce3-8c0fdcccbf2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c245ecc6caf48c5b07a87137cd5cd93', 'request_id': 'req-a600e0d1-2a18-41c4-9ce3-8c0fdcccbf2b'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:40.899385 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 957/1919] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:40 2022] PUT /identity/v3/projects/9f7e899db2ce4a86b1afd0f0677c1aca/users/c4f4b7a3657042a184dd205fcc32eee4/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:40.899504 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-a600e0d1-2a18-41c4-9ce3-8c0fdcccbf2b admin admin] The token cache is being invalidate because project 5c245ecc6caf48c5b07a87137cd5cd93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:55:40.899504 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-a600e0d1-2a18-41c4-9ce3-8c0fdcccbf2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:40.900338 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-a600e0d1-2a18-41c4-9ce3-8c0fdcccbf2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:40.901986 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0e66e-d22c-4a74-9932-14150bf30fe9 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:40.906952 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a9c0e66e-d22c-4a74-9932-14150bf30fe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:40.907383 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 963/1920] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:55:40 2022] DELETE /identity/v3/projects/5c245ecc6caf48c5b07a87137cd5cd93 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:55:40.909095 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f8974-d93f-44c7-90c6-73ddfa512618 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:40.909610 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f8974-d93f-44c7-90c6-73ddfa512618 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:40.917383 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f8974-d93f-44c7-90c6-73ddfa512618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:40.926838 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:41.000227 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-258f8974-d93f-44c7-90c6-73ddfa512618 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:41.001621 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-258f8974-d93f-44c7-90c6-73ddfa512618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:41.089835 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0e66e-d22c-4a74-9932-14150bf30fe9 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:41.098945 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 964/1921] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:41.108414 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f91ecd-fecb-4ea0-94d3-ebd7cd781a5b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:41.108866 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f91ecd-fecb-4ea0-94d3-ebd7cd781a5b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:41.108995 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f91ecd-fecb-4ea0-94d3-ebd7cd781a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:41.120523 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690f33a-026f-4668-af19-25b9bfefb50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:41.121348 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690f33a-026f-4668-af19-25b9bfefb50c admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:41.122110 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690f33a-026f-4668-af19-25b9bfefb50c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:41.122925 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690f33a-026f-4668-af19-25b9bfefb50c admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:41.125323 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690f33a-026f-4668-af19-25b9bfefb50c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:41.129810 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690f33a-026f-4668-af19-25b9bfefb50c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:41.165561 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 958/1922] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:41.171053 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690f33a-026f-4668-af19-25b9bfefb50c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:41.192922 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-73f91ecd-fecb-4ea0-94d3-ebd7cd781a5b None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:41.194218 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-73f91ecd-fecb-4ea0-94d3-ebd7cd781a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:41.197339 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690f33a-026f-4668-af19-25b9bfefb50c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:41.212082 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578a910-4fb8-447f-b824-90a2a6f1331f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:41.212966 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578a910-4fb8-447f-b824-90a2a6f1331f admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:41.213420 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578a910-4fb8-447f-b824-90a2a6f1331f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:41.215740 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578a910-4fb8-447f-b824-90a2a6f1331f admin admin] PATH_INFO: `/v3/projects/9f7e899db2ce4a86b1afd0f0677c1aca/users/c4f4b7a3657042a184dd205fcc32eee4/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:41.220793 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6578a910-4fb8-447f-b824-90a2a6f1331f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f7e899db2ce4a86b1afd0f0677c1aca, user_id=c4f4b7a3657042a184dd205fcc32eee4, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:41.225981 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6578a910-4fb8-447f-b824-90a2a6f1331f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:41.236869 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 965/1923] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:41.238761 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f91ecd-fecb-4ea0-94d3-ebd7cd781a5b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:41.243637 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 959/1924] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:41 2022] PUT /identity/v3/projects/9f7e899db2ce4a86b1afd0f0677c1aca/users/c4f4b7a3657042a184dd205fcc32eee4/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:41.261067 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f91ecd-fecb-4ea0-94d3-ebd7cd781a5b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:41.317271 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:41.339729 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf35ab-ddb5-4f6a-97af-b308e9e84425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:41.341362 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf35ab-ddb5-4f6a-97af-b308e9e84425 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:41.341968 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf35ab-ddb5-4f6a-97af-b308e9e84425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:41.342352 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf35ab-ddb5-4f6a-97af-b308e9e84425 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:41.343178 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf35ab-ddb5-4f6a-97af-b308e9e84425 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:41.343583 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf35ab-ddb5-4f6a-97af-b308e9e84425 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:41.345939 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf35ab-ddb5-4f6a-97af-b308e9e84425 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:41.366351 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 966/1925] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:41.370978 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578a910-4fb8-447f-b824-90a2a6f1331f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:41.386438 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578a910-4fb8-447f-b824-90a2a6f1331f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:41.396778 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04057c34-16b2-490e-9d7b-c2827a935b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:41.397673 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04057c34-16b2-490e-9d7b-c2827a935b5f admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:41.398070 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04057c34-16b2-490e-9d7b-c2827a935b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:41.398350 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04057c34-16b2-490e-9d7b-c2827a935b5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:41.399068 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04057c34-16b2-490e-9d7b-c2827a935b5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:41.401673 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04057c34-16b2-490e-9d7b-c2827a935b5f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:41.436201 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 960/1926] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:55:41 2022] POST /identity/v3/projects => generated 393 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:41.440523 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf35ab-ddb5-4f6a-97af-b308e9e84425 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:41.453761 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf35ab-ddb5-4f6a-97af-b308e9e84425 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:41.530458 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d706d-e672-4227-8943-bcb451521b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:41.531435 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d706d-e672-4227-8943-bcb451521b5e admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:41.531905 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d706d-e672-4227-8943-bcb451521b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:41.532246 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d706d-e672-4227-8943-bcb451521b5e admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:41.533217 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d706d-e672-4227-8943-bcb451521b5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:41.536199 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d706d-e672-4227-8943-bcb451521b5e admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:41.568072 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 967/1927] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:55:41 2022] POST /identity/v3/users => generated 297 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:41.571204 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04057c34-16b2-490e-9d7b-c2827a935b5f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:41.586460 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04057c34-16b2-490e-9d7b-c2827a935b5f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:41.613050 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618fbd0-9d3f-4243-bc74-85ecdf1df6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:41.614834 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618fbd0-9d3f-4243-bc74-85ecdf1df6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:41.615124 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618fbd0-9d3f-4243-bc74-85ecdf1df6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:41.615540 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618fbd0-9d3f-4243-bc74-85ecdf1df6a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:41.616729 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618fbd0-9d3f-4243-bc74-85ecdf1df6a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:41.620090 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618fbd0-9d3f-4243-bc74-85ecdf1df6a1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:41.646450 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 961/1928] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:41.647896 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d706d-e672-4227-8943-bcb451521b5e admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:41.662476 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d706d-e672-4227-8943-bcb451521b5e admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:41.670997 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24b087-1c8d-411a-99f3-cf0403eeb3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:41.672552 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24b087-1c8d-411a-99f3-cf0403eeb3cf admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:41.672552 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24b087-1c8d-411a-99f3-cf0403eeb3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:41.672552 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24b087-1c8d-411a-99f3-cf0403eeb3cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:41.673148 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24b087-1c8d-411a-99f3-cf0403eeb3cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:41.675978 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24b087-1c8d-411a-99f3-cf0403eeb3cf admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:41.694315 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 968/1929] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:41.695843 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618fbd0-9d3f-4243-bc74-85ecdf1df6a1 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:41.708576 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618fbd0-9d3f-4243-bc74-85ecdf1df6a1 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:41.713186 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c1e01-972d-4739-8246-6ab8397f0192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:41.714494 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c1e01-972d-4739-8246-6ab8397f0192 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:41.714494 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c1e01-972d-4739-8246-6ab8397f0192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:41.714679 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c1e01-972d-4739-8246-6ab8397f0192 admin admin] PATH_INFO: `/v3/projects/794e0b2df8de4e8e802035d491ffa5df/users/8035706c83e94dcea214d92ad078989b/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:41.732029 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c1e01-972d-4739-8246-6ab8397f0192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=794e0b2df8de4e8e802035d491ffa5df, user_id=8035706c83e94dcea214d92ad078989b, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:41.734519 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c1e01-972d-4739-8246-6ab8397f0192 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:41.758849 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 962/1930] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:41 2022] PUT /identity/v3/projects/794e0b2df8de4e8e802035d491ffa5df/users/8035706c83e94dcea214d92ad078989b/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:41.764590 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750a31b-b8c6-4b14-be19-d4febb94328e None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:41.765184 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750a31b-b8c6-4b14-be19-d4febb94328e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:41.765582 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750a31b-b8c6-4b14-be19-d4febb94328e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:41.806865 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-b750a31b-b8c6-4b14-be19-d4febb94328e None None] MFA Rules not processed for user `8035706c83e94dcea214d92ad078989b`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:41.808215 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b750a31b-b8c6-4b14-be19-d4febb94328e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:41.897598 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 969/1931] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:55:41.902441 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c1e01-972d-4739-8246-6ab8397f0192 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:41.980778 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c1e01-972d-4739-8246-6ab8397f0192 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:41.986046 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e61f91-5d4a-4e6f-ad62-803ebe51315f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:41.986745 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e61f91-5d4a-4e6f-ad62-803ebe51315f admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:41.987116 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e61f91-5d4a-4e6f-ad62-803ebe51315f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:41.987464 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e61f91-5d4a-4e6f-ad62-803ebe51315f admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:41.988176 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e61f91-5d4a-4e6f-ad62-803ebe51315f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:41.990230 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e61f91-5d4a-4e6f-ad62-803ebe51315f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:42.030043 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 963/1932] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:55:41 2022] POST /identity/v3/projects => generated 393 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:42.033028 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750a31b-b8c6-4b14-be19-d4febb94328e None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:42.045203 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750a31b-b8c6-4b14-be19-d4febb94328e None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:42.118153 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:42.181994 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d24f4-1208-471b-8187-3db853d49092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:42.184450 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d24f4-1208-471b-8187-3db853d49092 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:42.184840 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d24f4-1208-471b-8187-3db853d49092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:42.186716 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d24f4-1208-471b-8187-3db853d49092 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:42.188574 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d24f4-1208-471b-8187-3db853d49092 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:42.193233 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d24f4-1208-471b-8187-3db853d49092 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:42.236888 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 970/1933] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:55:42 2022] POST /identity/v3/users => generated 303 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:42.237199 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e61f91-5d4a-4e6f-ad62-803ebe51315f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:42.265219 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e61f91-5d4a-4e6f-ad62-803ebe51315f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:42.270427 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da366b1f-34f3-47d9-b7eb-bb3f202b6b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:42.271129 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da366b1f-34f3-47d9-b7eb-bb3f202b6b82 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:42.271475 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da366b1f-34f3-47d9-b7eb-bb3f202b6b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:42.271835 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da366b1f-34f3-47d9-b7eb-bb3f202b6b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:42.272566 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da366b1f-34f3-47d9-b7eb-bb3f202b6b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:42.274666 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da366b1f-34f3-47d9-b7eb-bb3f202b6b82 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:42.315957 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 964/1934] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:55:42.320378 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d24f4-1208-471b-8187-3db853d49092 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:42.338842 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d24f4-1208-471b-8187-3db853d49092 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:42.358223 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1cdb3-5417-4cda-bd29-5dbf95ec4f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:42.359528 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1cdb3-5417-4cda-bd29-5dbf95ec4f49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:42.361383 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1cdb3-5417-4cda-bd29-5dbf95ec4f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:42.362730 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1cdb3-5417-4cda-bd29-5dbf95ec4f49 admin admin] PATH_INFO: `/v3/projects/67a85be427774cbba551e5db3ff0a7e8/users/ab0a67fccce5473ea139b2fd8282980e/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:42.371949 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce789d-9a35-4b3e-99b7-2c3f92b1a1d3 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:42.372244 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce789d-9a35-4b3e-99b7-2c3f92b1a1d3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:42.372508 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce789d-9a35-4b3e-99b7-2c3f92b1a1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:42.387599 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:42.409075 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f8ce789d-9a35-4b3e-99b7-2c3f92b1a1d3 None None] MFA Rules not processed for user `c4f4b7a3657042a184dd205fcc32eee4`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:42.410610 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f8ce789d-9a35-4b3e-99b7-2c3f92b1a1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:42.410879 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1cdb3-5417-4cda-bd29-5dbf95ec4f49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67a85be427774cbba551e5db3ff0a7e8, user_id=ab0a67fccce5473ea139b2fd8282980e, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:42.422444 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1cdb3-5417-4cda-bd29-5dbf95ec4f49 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:42.460887 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 971/1935] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:42 2022] PUT /identity/v3/projects/67a85be427774cbba551e5db3ff0a7e8/users/ab0a67fccce5473ea139b2fd8282980e/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:42.465419 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1cdb3-5417-4cda-bd29-5dbf95ec4f49 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:42.571039 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 965/1936] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:55:42.582891 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ea8a9-56be-4ffc-9e51-8db34593eb53 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:42.583279 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ea8a9-56be-4ffc-9e51-8db34593eb53 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:42.583658 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ea8a9-56be-4ffc-9e51-8db34593eb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:42.602953 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1cdb3-5417-4cda-bd29-5dbf95ec4f49 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:42.623832 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19314ba-970b-498d-8baa-153c9a2a77fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:42.625239 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19314ba-970b-498d-8baa-153c9a2a77fc admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:42.625751 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19314ba-970b-498d-8baa-153c9a2a77fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:42.626256 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19314ba-970b-498d-8baa-153c9a2a77fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:42.627210 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b25ea8a9-56be-4ffc-9e51-8db34593eb53 None None] MFA Rules not processed for user `69b8ff3b6cff499a96ed291323b48bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:42.627738 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19314ba-970b-498d-8baa-153c9a2a77fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:42.628460 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b25ea8a9-56be-4ffc-9e51-8db34593eb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:42.631241 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19314ba-970b-498d-8baa-153c9a2a77fc admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:42.653653 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 972/1937] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:42.656227 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19314ba-970b-498d-8baa-153c9a2a77fc admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:42.677318 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19314ba-970b-498d-8baa-153c9a2a77fc admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:42.692484 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ad981-42f2-49ac-b81a-d5f0aed2f88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:42.693173 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ad981-42f2-49ac-b81a-d5f0aed2f88b admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:42.693916 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ad981-42f2-49ac-b81a-d5f0aed2f88b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:42.693916 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ad981-42f2-49ac-b81a-d5f0aed2f88b admin admin] PATH_INFO: `/v3/projects/67a85be427774cbba551e5db3ff0a7e8/users/ab0a67fccce5473ea139b2fd8282980e/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:42.697483 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ad981-42f2-49ac-b81a-d5f0aed2f88b admin admin] RBAC: Authorizing `identity:create_grant(project_id=67a85be427774cbba551e5db3ff0a7e8, user_id=ab0a67fccce5473ea139b2fd8282980e, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:42.700263 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ad981-42f2-49ac-b81a-d5f0aed2f88b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:42.740294 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 973/1938] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:42 2022] PUT /identity/v3/projects/67a85be427774cbba551e5db3ff0a7e8/users/ab0a67fccce5473ea139b2fd8282980e/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:42.751804 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109dc40-352a-4867-832d-8a9d236eccf3 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:42.752160 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109dc40-352a-4867-832d-8a9d236eccf3 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:42.752510 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109dc40-352a-4867-832d-8a9d236eccf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:42.774009 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 966/1939] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:42.822171 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ea8a9-56be-4ffc-9e51-8db34593eb53 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:42.822171 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b25ea8a9-56be-4ffc-9e51-8db34593eb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:42.826066 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-f109dc40-352a-4867-832d-8a9d236eccf3 None None] MFA Rules not processed for user `ab0a67fccce5473ea139b2fd8282980e`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:42.827518 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f109dc40-352a-4867-832d-8a9d236eccf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:42.905146 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ea8a9-56be-4ffc-9e51-8db34593eb53 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:42.938521 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 974/1940] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:42 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:55:42.946665 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:42.957308 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109dc40-352a-4867-832d-8a9d236eccf3 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:42.959087 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f109dc40-352a-4867-832d-8a9d236eccf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:42.980767 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d786d-936a-490d-ba2c-9a0c01a370ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:42.981176 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d786d-936a-490d-ba2c-9a0c01a370ba service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:42.981464 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d786d-936a-490d-ba2c-9a0c01a370ba service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:42.981722 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d786d-936a-490d-ba2c-9a0c01a370ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:42.983228 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:42.984462 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-617d786d-936a-490d-ba2c-9a0c01a370ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:43.045300 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109dc40-352a-4867-832d-8a9d236eccf3 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:43.049903 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665aa24-613f-405c-a43f-279c365b34d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:43.051339 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665aa24-613f-405c-a43f-279c365b34d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:43.051642 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665aa24-613f-405c-a43f-279c365b34d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:43.051917 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665aa24-613f-405c-a43f-279c365b34d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:43.082352 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665aa24-613f-405c-a43f-279c365b34d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:43.084931 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665aa24-613f-405c-a43f-279c365b34d2 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:43.090929 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d786d-936a-490d-ba2c-9a0c01a370ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:43.093614 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d786d-936a-490d-ba2c-9a0c01a370ba service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:43.094348 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 975/1941] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:42 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:43.109178 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 967/1942] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:43.159708 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665aa24-613f-405c-a43f-279c365b34d2 service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:43.162177 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-0665aa24-613f-405c-a43f-279c365b34d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:43.186183 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665aa24-613f-405c-a43f-279c365b34d2 service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:43.195100 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1114c7-0b70-40e6-9087-1401de87b274 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:43.195383 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1114c7-0b70-40e6-9087-1401de87b274 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:43.195662 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1114c7-0b70-40e6-9087-1401de87b274 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:43.195939 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1114c7-0b70-40e6-9087-1401de87b274 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:43.293493 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1114c7-0b70-40e6-9087-1401de87b274 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:43.295215 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1114c7-0b70-40e6-9087-1401de87b274 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:43.306106 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 976/1943] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:43 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:45.294429 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d786d-936a-490d-ba2c-9a0c01a370ba service nova] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:45.295844 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-617d786d-936a-490d-ba2c-9a0c01a370ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:45.374180 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d786d-936a-490d-ba2c-9a0c01a370ba service nova] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:45.378668 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42509f5-d221-4468-aee7-d65318139a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:45.379299 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42509f5-d221-4468-aee7-d65318139a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:45.379571 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42509f5-d221-4468-aee7-d65318139a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:45.379838 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42509f5-d221-4468-aee7-d65318139a6c admin admin] PATH_INFO: `/v3/users/9835a0ae533446309efe4057805014ae` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:45.380961 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42509f5-d221-4468-aee7-d65318139a6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9835a0ae533446309efe4057805014ae)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:45.382922 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42509f5-d221-4468-aee7-d65318139a6c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:45.457600 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e42509f5-d221-4468-aee7-d65318139a6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9835a0ae533446309efe4057805014ae'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:45.471185 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e42509f5-d221-4468-aee7-d65318139a6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9835a0ae533446309efe4057805014ae'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:45.480993 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e42509f5-d221-4468-aee7-d65318139a6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9835a0ae533446309efe4057805014ae'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:45.483202 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:45.492248 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e42509f5-d221-4468-aee7-d65318139a6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9835a0ae533446309efe4057805014ae'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:45.493213 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e42509f5-d221-4468-aee7-d65318139a6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9835a0ae533446309efe4057805014ae'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:45.503261 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 968/1944] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:55:45 2022] DELETE /identity/v3/users/9835a0ae533446309efe4057805014ae => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:45.508265 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0f917-2cc4-4a59-8b88-ab1304b56015 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:45.508808 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0f917-2cc4-4a59-8b88-ab1304b56015 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:45.508808 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0f917-2cc4-4a59-8b88-ab1304b56015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:45.532316 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-22b0f917-2cc4-4a59-8b88-ab1304b56015 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:45.533565 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-22b0f917-2cc4-4a59-8b88-ab1304b56015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:45.608622 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 977/1945] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:45.620860 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42509f5-d221-4468-aee7-d65318139a6c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:45.622478 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e42509f5-d221-4468-aee7-d65318139a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:45.711503 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42509f5-d221-4468-aee7-d65318139a6c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:45.715459 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76768e37-e253-43d6-8121-e42a84677ad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:45.716072 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76768e37-e253-43d6-8121-e42a84677ad1 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:45.716352 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76768e37-e253-43d6-8121-e42a84677ad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:45.716623 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76768e37-e253-43d6-8121-e42a84677ad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:45.728085 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76768e37-e253-43d6-8121-e42a84677ad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:45.729601 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76768e37-e253-43d6-8121-e42a84677ad1 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:45.743517 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 969/1946] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:46.148834 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0f917-2cc4-4a59-8b88-ab1304b56015 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:46.150598 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-22b0f917-2cc4-4a59-8b88-ab1304b56015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:46.169007 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0f917-2cc4-4a59-8b88-ab1304b56015 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:46.175471 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbbf6ec-e560-49ba-af8b-9569b4b9a5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:46.176138 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbf6ec-e560-49ba-af8b-9569b4b9a5da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:46.187623 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbf6ec-e560-49ba-af8b-9569b4b9a5da admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:46.188001 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbf6ec-e560-49ba-af8b-9569b4b9a5da admin admin] PATH_INFO: `/v3/projects/03547711939241a5b12c7172c7f82913` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:46.189354 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbbf6ec-e560-49ba-af8b-9569b4b9a5da admin admin] RBAC: Authorizing `identity:delete_project(project_id=03547711939241a5b12c7172c7f82913)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:46.192739 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbbf6ec-e560-49ba-af8b-9569b4b9a5da admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:46.250829 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8fbbf6ec-e560-49ba-af8b-9569b4b9a5da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03547711939241a5b12c7172c7f82913', 'request_id': 'req-8fbbf6ec-e560-49ba-af8b-9569b4b9a5da'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:46.260829 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8fbbf6ec-e560-49ba-af8b-9569b4b9a5da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03547711939241a5b12c7172c7f82913', 'request_id': 'req-8fbbf6ec-e560-49ba-af8b-9569b4b9a5da'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:46.262485 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:46.270338 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8fbbf6ec-e560-49ba-af8b-9569b4b9a5da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03547711939241a5b12c7172c7f82913', 'request_id': 'req-8fbbf6ec-e560-49ba-af8b-9569b4b9a5da'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:46.283988 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8fbbf6ec-e560-49ba-af8b-9569b4b9a5da admin admin] The token cache is being invalidate because project 03547711939241a5b12c7172c7f82913 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:55:46.284543 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8fbbf6ec-e560-49ba-af8b-9569b4b9a5da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:46.285365 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8fbbf6ec-e560-49ba-af8b-9569b4b9a5da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:46.290658 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 978/1947] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:55:46 2022] DELETE /identity/v3/projects/03547711939241a5b12c7172c7f82913 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:46.291718 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76768e37-e253-43d6-8121-e42a84677ad1 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:46.302384 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76768e37-e253-43d6-8121-e42a84677ad1 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:46.390285 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81a51a-7998-4593-a8ce-9c4eb3977368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:46.390815 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81a51a-7998-4593-a8ce-9c4eb3977368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:46.391151 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81a51a-7998-4593-a8ce-9c4eb3977368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:46.391641 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81a51a-7998-4593-a8ce-9c4eb3977368 admin admin] PATH_INFO: `/v3/users/e3b10e0878b9449b8ddde611311197ec` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:46.392855 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81a51a-7998-4593-a8ce-9c4eb3977368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3b10e0878b9449b8ddde611311197ec)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:46.394928 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81a51a-7998-4593-a8ce-9c4eb3977368 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:46.448290 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-df81a51a-7998-4593-a8ce-9c4eb3977368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3b10e0878b9449b8ddde611311197ec'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:46.468033 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-df81a51a-7998-4593-a8ce-9c4eb3977368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3b10e0878b9449b8ddde611311197ec'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:46.476016 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-df81a51a-7998-4593-a8ce-9c4eb3977368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3b10e0878b9449b8ddde611311197ec'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:46.496931 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-df81a51a-7998-4593-a8ce-9c4eb3977368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3b10e0878b9449b8ddde611311197ec'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:46.498175 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-df81a51a-7998-4593-a8ce-9c4eb3977368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3b10e0878b9449b8ddde611311197ec'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:46.507902 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 970/1948] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:55:46 2022] DELETE /identity/v3/users/e3b10e0878b9449b8ddde611311197ec => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:55:46.881969 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbbf6ec-e560-49ba-af8b-9569b4b9a5da admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:46.883679 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8fbbf6ec-e560-49ba-af8b-9569b4b9a5da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:46.894268 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81a51a-7998-4593-a8ce-9c4eb3977368 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:46.895462 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-df81a51a-7998-4593-a8ce-9c4eb3977368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:46.903614 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbbf6ec-e560-49ba-af8b-9569b4b9a5da admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:46.921708 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:46.981753 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0eb29-222c-4310-85e9-8d6026c6cdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:46.982440 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0eb29-222c-4310-85e9-8d6026c6cdfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:46.982722 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0eb29-222c-4310-85e9-8d6026c6cdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:46.982994 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0eb29-222c-4310-85e9-8d6026c6cdfe admin admin] PATH_INFO: `/v3/users/8035706c83e94dcea214d92ad078989b` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:46.984139 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0eb29-222c-4310-85e9-8d6026c6cdfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=8035706c83e94dcea214d92ad078989b)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:46.986432 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0eb29-222c-4310-85e9-8d6026c6cdfe admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:46.996852 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81a51a-7998-4593-a8ce-9c4eb3977368 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:47.001773 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab90999-ff51-4bca-8da7-710b3b4f71d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:47.002449 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab90999-ff51-4bca-8da7-710b3b4f71d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:47.002726 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab90999-ff51-4bca-8da7-710b3b4f71d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:47.002992 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab90999-ff51-4bca-8da7-710b3b4f71d6 admin admin] PATH_INFO: `/v3/projects/b7d6fc5df1764f1a93bc0f5aaae0c376` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:47.004263 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab90999-ff51-4bca-8da7-710b3b4f71d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7d6fc5df1764f1a93bc0f5aaae0c376)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:47.006230 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab90999-ff51-4bca-8da7-710b3b4f71d6 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:47.058114 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3bc0eb29-222c-4310-85e9-8d6026c6cdfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8035706c83e94dcea214d92ad078989b'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:47.066069 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3bc0eb29-222c-4310-85e9-8d6026c6cdfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8035706c83e94dcea214d92ad078989b'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:47.071855 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6ab90999-ff51-4bca-8da7-710b3b4f71d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7d6fc5df1764f1a93bc0f5aaae0c376', 'request_id': 'req-6ab90999-ff51-4bca-8da7-710b3b4f71d6'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:47.077809 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3bc0eb29-222c-4310-85e9-8d6026c6cdfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8035706c83e94dcea214d92ad078989b'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:47.080413 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6ab90999-ff51-4bca-8da7-710b3b4f71d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7d6fc5df1764f1a93bc0f5aaae0c376', 'request_id': 'req-6ab90999-ff51-4bca-8da7-710b3b4f71d6'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:47.092468 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6ab90999-ff51-4bca-8da7-710b3b4f71d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7d6fc5df1764f1a93bc0f5aaae0c376', 'request_id': 'req-6ab90999-ff51-4bca-8da7-710b3b4f71d6'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:47.102245 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3bc0eb29-222c-4310-85e9-8d6026c6cdfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8035706c83e94dcea214d92ad078989b'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:47.103521 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3bc0eb29-222c-4310-85e9-8d6026c6cdfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8035706c83e94dcea214d92ad078989b'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:47.113701 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 979/1949] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:55:46 2022] DELETE /identity/v3/users/8035706c83e94dcea214d92ad078989b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:47.120262 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6d04b-9857-4694-8ae3-79d843567d20 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:47.120392 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6d04b-9857-4694-8ae3-79d843567d20 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:47.120721 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6d04b-9857-4694-8ae3-79d843567d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:47.121993 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6ab90999-ff51-4bca-8da7-710b3b4f71d6 admin admin] The token cache is being invalidate because project b7d6fc5df1764f1a93bc0f5aaae0c376 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:55:47.122411 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6ab90999-ff51-4bca-8da7-710b3b4f71d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:47.123402 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6ab90999-ff51-4bca-8da7-710b3b4f71d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:47.125386 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 971/1950] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:55:46 2022] DELETE /identity/v3/projects/b7d6fc5df1764f1a93bc0f5aaae0c376 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:47.130787 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6ba7a-040f-4225-9ac0-88cf81aa7150 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:47.131512 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6ba7a-040f-4225-9ac0-88cf81aa7150 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:47.131947 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6ba7a-040f-4225-9ac0-88cf81aa7150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:47.143567 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-69d6d04b-9857-4694-8ae3-79d843567d20 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:47.144693 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-69d6d04b-9857-4694-8ae3-79d843567d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:47.173640 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-7fa6ba7a-040f-4225-9ac0-88cf81aa7150 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:47.175663 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7fa6ba7a-040f-4225-9ac0-88cf81aa7150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:47.246356 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 980/1951] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:55:47.249891 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 972/1952] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:55:47.254926 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6d04b-9857-4694-8ae3-79d843567d20 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:47.256398 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-69d6d04b-9857-4694-8ae3-79d843567d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:47.256818 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169ac4b-d82d-4015-a947-610f0f3b4bf5 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:47.257108 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169ac4b-d82d-4015-a947-610f0f3b4bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:47.257379 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169ac4b-d82d-4015-a947-610f0f3b4bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:47.263474 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:47.278255 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-1169ac4b-d82d-4015-a947-610f0f3b4bf5 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:47.279436 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1169ac4b-d82d-4015-a947-610f0f3b4bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:47.288833 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 973/1953] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:55:47.293266 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169ac4b-d82d-4015-a947-610f0f3b4bf5 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:47.302288 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169ac4b-d82d-4015-a947-610f0f3b4bf5 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:47.307170 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb9de9-c8a9-4b26-9fdd-053223ddddc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:47.307778 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb9de9-c8a9-4b26-9fdd-053223ddddc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:47.308030 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb9de9-c8a9-4b26-9fdd-053223ddddc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:47.308300 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb9de9-c8a9-4b26-9fdd-053223ddddc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:47.308944 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb9de9-c8a9-4b26-9fdd-053223ddddc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:47.309254 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb9de9-c8a9-4b26-9fdd-053223ddddc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:47.310898 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb9de9-c8a9-4b26-9fdd-053223ddddc6 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:47.317668 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6d04b-9857-4694-8ae3-79d843567d20 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:47.321325 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42ec1c-e81c-48d4-bd15-22d53e0ad551 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:47.321956 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42ec1c-e81c-48d4-bd15-22d53e0ad551 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:47.322235 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42ec1c-e81c-48d4-bd15-22d53e0ad551 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:47.325988 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42ec1c-e81c-48d4-bd15-22d53e0ad551 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:47.326125 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 974/1954] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:55:47.327238 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb9de9-c8a9-4b26-9fdd-053223ddddc6 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:47.332432 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42ec1c-e81c-48d4-bd15-22d53e0ad551 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:47.334054 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42ec1c-e81c-48d4-bd15-22d53e0ad551 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:47.337905 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb9de9-c8a9-4b26-9fdd-053223ddddc6 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:47.342651 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430daa85-66b3-4589-b6d2-f6e5a0c01a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:47.343240 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430daa85-66b3-4589-b6d2-f6e5a0c01a5b admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:47.343520 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430daa85-66b3-4589-b6d2-f6e5a0c01a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:47.343795 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430daa85-66b3-4589-b6d2-f6e5a0c01a5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:47.344037 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 981/1955] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:47.344419 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430daa85-66b3-4589-b6d2-f6e5a0c01a5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:47.346351 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430daa85-66b3-4589-b6d2-f6e5a0c01a5b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:47.374925 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 975/1956] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:55:47 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:47.379583 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42ec1c-e81c-48d4-bd15-22d53e0ad551 service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:47.390444 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42ec1c-e81c-48d4-bd15-22d53e0ad551 service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:47.460515 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313a38a-1369-4e23-b9ee-ce691c8a754c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:47.461147 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313a38a-1369-4e23-b9ee-ce691c8a754c admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:47.461417 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313a38a-1369-4e23-b9ee-ce691c8a754c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:47.461697 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313a38a-1369-4e23-b9ee-ce691c8a754c admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:47.462382 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1313a38a-1369-4e23-b9ee-ce691c8a754c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:47.464389 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1313a38a-1369-4e23-b9ee-ce691c8a754c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:47.486432 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 982/1957] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:55:47 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:47.490615 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430daa85-66b3-4589-b6d2-f6e5a0c01a5b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:47.496433 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:47.503420 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430daa85-66b3-4589-b6d2-f6e5a0c01a5b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:47.509526 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093f6eb-bb65-4680-ba9b-0a35cd6b774f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:47.510778 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093f6eb-bb65-4680-ba9b-0a35cd6b774f admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:47.511240 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093f6eb-bb65-4680-ba9b-0a35cd6b774f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:47.512342 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093f6eb-bb65-4680-ba9b-0a35cd6b774f admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:47.513005 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093f6eb-bb65-4680-ba9b-0a35cd6b774f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:47.514815 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093f6eb-bb65-4680-ba9b-0a35cd6b774f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:47.526555 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 976/1958] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:47.529862 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313a38a-1369-4e23-b9ee-ce691c8a754c admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:47.541616 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313a38a-1369-4e23-b9ee-ce691c8a754c admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:47.546930 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a15b306-50de-40b6-8830-8e389bd949d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:47.547669 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15b306-50de-40b6-8830-8e389bd949d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:47.548047 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15b306-50de-40b6-8830-8e389bd949d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:47.548418 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15b306-50de-40b6-8830-8e389bd949d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:47.549430 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a15b306-50de-40b6-8830-8e389bd949d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:47.551465 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a15b306-50de-40b6-8830-8e389bd949d2 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:47.565878 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 983/1959] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:47.568227 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093f6eb-bb65-4680-ba9b-0a35cd6b774f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:47.579800 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093f6eb-bb65-4680-ba9b-0a35cd6b774f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:47.584482 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93bdeb-a58b-452f-bad6-7746d1a1089b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:47.585138 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93bdeb-a58b-452f-bad6-7746d1a1089b admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:47.585418 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93bdeb-a58b-452f-bad6-7746d1a1089b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:47.585693 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93bdeb-a58b-452f-bad6-7746d1a1089b admin admin] PATH_INFO: `/v3/projects/e00ebfa8d83f462b94700395a3ab4db6/users/47e9d5fcac9047118330a3cfbc6437e1/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:47.602668 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c93bdeb-a58b-452f-bad6-7746d1a1089b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e00ebfa8d83f462b94700395a3ab4db6, user_id=47e9d5fcac9047118330a3cfbc6437e1, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:47.605643 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c93bdeb-a58b-452f-bad6-7746d1a1089b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:47.620726 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 977/1960] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:47 2022] PUT /identity/v3/projects/e00ebfa8d83f462b94700395a3ab4db6/users/47e9d5fcac9047118330a3cfbc6437e1/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:47.632381 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c7cbd-1caf-4848-af0f-b2f8eb6dd31c None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:47.632780 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c7cbd-1caf-4848-af0f-b2f8eb6dd31c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:47.633223 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c7cbd-1caf-4848-af0f-b2f8eb6dd31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:47.679726 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-a56c7cbd-1caf-4848-af0f-b2f8eb6dd31c None None] MFA Rules not processed for user `47e9d5fcac9047118330a3cfbc6437e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:47.681160 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a56c7cbd-1caf-4848-af0f-b2f8eb6dd31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:47.730452 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93bdeb-a58b-452f-bad6-7746d1a1089b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:47.732936 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3c93bdeb-a58b-452f-bad6-7746d1a1089b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:47.801352 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 984/1961] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:47.807137 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c7cbd-1caf-4848-af0f-b2f8eb6dd31c None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:47.832472 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:47.917451 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93bdeb-a58b-452f-bad6-7746d1a1089b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:47.926605 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c7cbd-1caf-4848-af0f-b2f8eb6dd31c None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:47.930697 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17236338-0bc8-4966-b1c8-b7ecc9787797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:47.933438 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17236338-0bc8-4966-b1c8-b7ecc9787797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:47.933740 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17236338-0bc8-4966-b1c8-b7ecc9787797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:47.934047 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17236338-0bc8-4966-b1c8-b7ecc9787797 admin admin] PATH_INFO: `/v3/projects/794e0b2df8de4e8e802035d491ffa5df` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:47.937111 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17236338-0bc8-4966-b1c8-b7ecc9787797 admin admin] RBAC: Authorizing `identity:delete_project(project_id=794e0b2df8de4e8e802035d491ffa5df)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:47.940070 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec000f0f-893f-473f-bf7c-b94f0cfbc380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:47.940702 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec000f0f-893f-473f-bf7c-b94f0cfbc380 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:47.940982 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec000f0f-893f-473f-bf7c-b94f0cfbc380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:47.942710 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17236338-0bc8-4966-b1c8-b7ecc9787797 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:47.943747 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec000f0f-893f-473f-bf7c-b94f0cfbc380 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:47.944426 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec000f0f-893f-473f-bf7c-b94f0cfbc380 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:47.950752 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec000f0f-893f-473f-bf7c-b94f0cfbc380 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:48.044958 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 985/1962] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:55:47 2022] POST /identity/v3/projects => generated 379 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:48.047659 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec000f0f-893f-473f-bf7c-b94f0cfbc380 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:48.086466 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-17236338-0bc8-4966-b1c8-b7ecc9787797 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '794e0b2df8de4e8e802035d491ffa5df', 'request_id': 'req-17236338-0bc8-4966-b1c8-b7ecc9787797'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:48.102232 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-17236338-0bc8-4966-b1c8-b7ecc9787797 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '794e0b2df8de4e8e802035d491ffa5df', 'request_id': 'req-17236338-0bc8-4966-b1c8-b7ecc9787797'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:48.120782 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-17236338-0bc8-4966-b1c8-b7ecc9787797 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '794e0b2df8de4e8e802035d491ffa5df', 'request_id': 'req-17236338-0bc8-4966-b1c8-b7ecc9787797'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:48.141394 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-17236338-0bc8-4966-b1c8-b7ecc9787797 admin admin] The token cache is being invalidate because project 794e0b2df8de4e8e802035d491ffa5df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:55:48.141738 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-17236338-0bc8-4966-b1c8-b7ecc9787797 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:48.142754 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-17236338-0bc8-4966-b1c8-b7ecc9787797 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:48.149905 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 978/1963] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:55:47 2022] DELETE /identity/v3/projects/794e0b2df8de4e8e802035d491ffa5df => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:55:48.152901 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17236338-0bc8-4966-b1c8-b7ecc9787797 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:48.156177 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-17236338-0bc8-4966-b1c8-b7ecc9787797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:48.271153 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:48.279859 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17236338-0bc8-4966-b1c8-b7ecc9787797 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:48.282481 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec000f0f-893f-473f-bf7c-b94f0cfbc380 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:48.287622 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7023e-3e20-4a6d-b0b9-a1c1fdf3ffe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:48.288259 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7023e-3e20-4a6d-b0b9-a1c1fdf3ffe7 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:48.288530 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7023e-3e20-4a6d-b0b9-a1c1fdf3ffe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:48.288807 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7023e-3e20-4a6d-b0b9-a1c1fdf3ffe7 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:48.289471 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7023e-3e20-4a6d-b0b9-a1c1fdf3ffe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:48.291585 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7023e-3e20-4a6d-b0b9-a1c1fdf3ffe7 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:48.293927 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2ef7c-2f2a-4e3f-9d7a-22cb88890f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:48.294933 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2ef7c-2f2a-4e3f-9d7a-22cb88890f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:48.295384 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2ef7c-2f2a-4e3f-9d7a-22cb88890f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:48.295811 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2ef7c-2f2a-4e3f-9d7a-22cb88890f91 admin admin] PATH_INFO: `/v3/users/ab0a67fccce5473ea139b2fd8282980e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:48.298615 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2ef7c-2f2a-4e3f-9d7a-22cb88890f91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab0a67fccce5473ea139b2fd8282980e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:48.303684 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2ef7c-2f2a-4e3f-9d7a-22cb88890f91 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:48.323397 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 986/1964] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:55:48 2022] POST /identity/v3/users => generated 290 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:48.327311 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7023e-3e20-4a6d-b0b9-a1c1fdf3ffe7 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:48.333529 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6dd7023e-3e20-4a6d-b0b9-a1c1fdf3ffe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:48.356431 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7023e-3e20-4a6d-b0b9-a1c1fdf3ffe7 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:48.361690 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56ef1c-1d41-42c7-a9a4-2d65403999b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:48.362537 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56ef1c-1d41-42c7-a9a4-2d65403999b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:48.362784 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56ef1c-1d41-42c7-a9a4-2d65403999b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:48.363058 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56ef1c-1d41-42c7-a9a4-2d65403999b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:48.363762 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56ef1c-1d41-42c7-a9a4-2d65403999b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:48.365588 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56ef1c-1d41-42c7-a9a4-2d65403999b2 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:48.378405 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 987/1965] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:48.382007 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56ef1c-1d41-42c7-a9a4-2d65403999b2 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:48.386904 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ffa2ef7c-2f2a-4e3f-9d7a-22cb88890f91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab0a67fccce5473ea139b2fd8282980e'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:48.392776 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56ef1c-1d41-42c7-a9a4-2d65403999b2 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:48.398026 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a91389-7063-45ba-ba09-e21a9eae3fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:48.398641 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a91389-7063-45ba-ba09-e21a9eae3fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:48.398916 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a91389-7063-45ba-ba09-e21a9eae3fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:48.399187 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a91389-7063-45ba-ba09-e21a9eae3fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:48.399833 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a91389-7063-45ba-ba09-e21a9eae3fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:48.402049 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a91389-7063-45ba-ba09-e21a9eae3fa0 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:48.403633 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ffa2ef7c-2f2a-4e3f-9d7a-22cb88890f91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab0a67fccce5473ea139b2fd8282980e'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:48.411483 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ffa2ef7c-2f2a-4e3f-9d7a-22cb88890f91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab0a67fccce5473ea139b2fd8282980e'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:48.415389 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 988/1966] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:55:48.420221 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a91389-7063-45ba-ba09-e21a9eae3fa0 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:48.428336 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ffa2ef7c-2f2a-4e3f-9d7a-22cb88890f91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab0a67fccce5473ea139b2fd8282980e'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:48.428975 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ffa2ef7c-2f2a-4e3f-9d7a-22cb88890f91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab0a67fccce5473ea139b2fd8282980e'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:48.438178 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a91389-7063-45ba-ba09-e21a9eae3fa0 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:48.441180 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 979/1967] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:55:48 2022] DELETE /identity/v3/users/ab0a67fccce5473ea139b2fd8282980e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:48.450916 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2731be-5922-4621-8ebc-f86dcb7f266b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:48.453487 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2731be-5922-4621-8ebc-f86dcb7f266b admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:48.454118 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2731be-5922-4621-8ebc-f86dcb7f266b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:48.454491 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2731be-5922-4621-8ebc-f86dcb7f266b admin admin] PATH_INFO: `/v3/projects/6fea467d7d63436099e8f2d7536e57d5/users/4c48f128a93644f19e8f4ca6b5eb8e1e/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:48.475010 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2731be-5922-4621-8ebc-f86dcb7f266b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fea467d7d63436099e8f2d7536e57d5, user_id=4c48f128a93644f19e8f4ca6b5eb8e1e, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:48.478017 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2731be-5922-4621-8ebc-f86dcb7f266b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:48.497897 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 989/1968] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:48 2022] PUT /identity/v3/projects/6fea467d7d63436099e8f2d7536e57d5/users/4c48f128a93644f19e8f4ca6b5eb8e1e/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:55:48.506830 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c490f-3543-4555-a108-6b078fa08f7f None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:48.507273 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c490f-3543-4555-a108-6b078fa08f7f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:48.507551 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c490f-3543-4555-a108-6b078fa08f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:48.565084 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-526c490f-3543-4555-a108-6b078fa08f7f None None] MFA Rules not processed for user `4c48f128a93644f19e8f4ca6b5eb8e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:48.566714 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-526c490f-3543-4555-a108-6b078fa08f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:48.652790 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 980/1969] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:48.654345 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2731be-5922-4621-8ebc-f86dcb7f266b admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:48.656949 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-dc2731be-5922-4621-8ebc-f86dcb7f266b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:48.726056 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:48.754449 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2731be-5922-4621-8ebc-f86dcb7f266b admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:48.760907 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97bccb2-ce12-410b-9fe7-4ac89123cee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:48.761640 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bccb2-ce12-410b-9fe7-4ac89123cee0 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:48.761957 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bccb2-ce12-410b-9fe7-4ac89123cee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:48.762455 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bccb2-ce12-410b-9fe7-4ac89123cee0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:48.763164 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97bccb2-ce12-410b-9fe7-4ac89123cee0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:48.765768 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97bccb2-ce12-410b-9fe7-4ac89123cee0 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:48.809052 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 990/1970] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:55:48 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:48.810307 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c490f-3543-4555-a108-6b078fa08f7f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:48.825884 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c490f-3543-4555-a108-6b078fa08f7f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:48.910917 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b588056-feaa-4d85-b378-7f43d08fd547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:48.912148 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b588056-feaa-4d85-b378-7f43d08fd547 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:48.912440 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b588056-feaa-4d85-b378-7f43d08fd547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:48.913552 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b588056-feaa-4d85-b378-7f43d08fd547 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:48.914403 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b588056-feaa-4d85-b378-7f43d08fd547 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:48.916727 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b588056-feaa-4d85-b378-7f43d08fd547 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:48.930073 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:48.950676 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97bccb2-ce12-410b-9fe7-4ac89123cee0 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:48.957308 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 981/1971] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:55:48 2022] POST /identity/v3/users => generated 295 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:48.963991 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97bccb2-ce12-410b-9fe7-4ac89123cee0 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:48.970945 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb9ff8-cbab-409c-aec5-e394b16f60bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:48.971577 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb9ff8-cbab-409c-aec5-e394b16f60bc admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:48.971967 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb9ff8-cbab-409c-aec5-e394b16f60bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:48.972754 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb9ff8-cbab-409c-aec5-e394b16f60bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:48.973013 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb9ff8-cbab-409c-aec5-e394b16f60bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:48.975616 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb9ff8-cbab-409c-aec5-e394b16f60bc admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:48.998478 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 991/1972] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:55:48.999809 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b588056-feaa-4d85-b378-7f43d08fd547 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:49.011992 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b588056-feaa-4d85-b378-7f43d08fd547 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:49.018787 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f128cf5-64d2-432c-bcc6-70d1dfbe3984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:49.019703 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f128cf5-64d2-432c-bcc6-70d1dfbe3984 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:49.020059 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f128cf5-64d2-432c-bcc6-70d1dfbe3984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:49.020395 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f128cf5-64d2-432c-bcc6-70d1dfbe3984 admin admin] PATH_INFO: `/v3/projects/59811f535d6a444db4c2b990fbcdc637/users/afc6e3b4ceb84050a89b1a5ccba78047/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:49.038766 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f128cf5-64d2-432c-bcc6-70d1dfbe3984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59811f535d6a444db4c2b990fbcdc637, user_id=afc6e3b4ceb84050a89b1a5ccba78047, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:49.043022 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f128cf5-64d2-432c-bcc6-70d1dfbe3984 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:49.063631 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 982/1973] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:48 2022] PUT /identity/v3/projects/59811f535d6a444db4c2b990fbcdc637/users/afc6e3b4ceb84050a89b1a5ccba78047/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:49.064785 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb9ff8-cbab-409c-aec5-e394b16f60bc admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:49.076115 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb9ff8-cbab-409c-aec5-e394b16f60bc admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:49.151510 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f09250-f066-46eb-aca1-dad54ebd56b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:49.152410 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f09250-f066-46eb-aca1-dad54ebd56b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:49.153210 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f09250-f066-46eb-aca1-dad54ebd56b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:49.153521 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f09250-f066-46eb-aca1-dad54ebd56b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:49.154318 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f09250-f066-46eb-aca1-dad54ebd56b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:49.156723 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f09250-f066-46eb-aca1-dad54ebd56b7 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:49.172210 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 992/1974] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:49.176412 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f128cf5-64d2-432c-bcc6-70d1dfbe3984 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:49.189081 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f128cf5-64d2-432c-bcc6-70d1dfbe3984 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:49.194850 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750e0d4-a5b1-44ad-a370-6d5fd4f331b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:49.196087 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750e0d4-a5b1-44ad-a370-6d5fd4f331b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:49.196087 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750e0d4-a5b1-44ad-a370-6d5fd4f331b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:49.196345 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750e0d4-a5b1-44ad-a370-6d5fd4f331b0 admin admin] PATH_INFO: `/v3/projects/59811f535d6a444db4c2b990fbcdc637/users/afc6e3b4ceb84050a89b1a5ccba78047/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:49.199010 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8750e0d4-a5b1-44ad-a370-6d5fd4f331b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59811f535d6a444db4c2b990fbcdc637, user_id=afc6e3b4ceb84050a89b1a5ccba78047, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:49.202348 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8750e0d4-a5b1-44ad-a370-6d5fd4f331b0 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:49.216649 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 983/1975] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:49 2022] PUT /identity/v3/projects/59811f535d6a444db4c2b990fbcdc637/users/afc6e3b4ceb84050a89b1a5ccba78047/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:49.240229 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f093ef1-1e03-46e9-aa75-204700d05316 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:49.242185 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f093ef1-1e03-46e9-aa75-204700d05316 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:49.242696 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f093ef1-1e03-46e9-aa75-204700d05316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:49.284663 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-1f093ef1-1e03-46e9-aa75-204700d05316 None None] MFA Rules not processed for user `afc6e3b4ceb84050a89b1a5ccba78047`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:49.287037 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1f093ef1-1e03-46e9-aa75-204700d05316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:49.373635 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 993/1976] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:49.386976 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750e0d4-a5b1-44ad-a370-6d5fd4f331b0 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:49.389133 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8750e0d4-a5b1-44ad-a370-6d5fd4f331b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:49.457562 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750e0d4-a5b1-44ad-a370-6d5fd4f331b0 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:49.462069 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71ce22-c2e3-49ba-bdc3-1fba67fcee8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:49.462674 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71ce22-c2e3-49ba-bdc3-1fba67fcee8e service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:49.463048 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71ce22-c2e3-49ba-bdc3-1fba67fcee8e service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:49.463438 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71ce22-c2e3-49ba-bdc3-1fba67fcee8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:49.474370 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71ce22-c2e3-49ba-bdc3-1fba67fcee8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:49.476329 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71ce22-c2e3-49ba-bdc3-1fba67fcee8e service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:49.492295 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 984/1977] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:49.544969 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f093ef1-1e03-46e9-aa75-204700d05316 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:49.546973 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1f093ef1-1e03-46e9-aa75-204700d05316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:49.566697 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f093ef1-1e03-46e9-aa75-204700d05316 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:49.571767 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4cbe26-eaf1-47bf-ab91-089f72e5a4f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:49.572783 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4cbe26-eaf1-47bf-ab91-089f72e5a4f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:49.573182 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4cbe26-eaf1-47bf-ab91-089f72e5a4f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:49.573514 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4cbe26-eaf1-47bf-ab91-089f72e5a4f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:49.576795 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-fb4cbe26-eaf1-47bf-ab91-089f72e5a4f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:49.643043 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:49.670083 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4cbe26-eaf1-47bf-ab91-089f72e5a4f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:49.671550 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4cbe26-eaf1-47bf-ab91-089f72e5a4f7 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:49.693869 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 994/1978] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:50.206496 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71ce22-c2e3-49ba-bdc3-1fba67fcee8e service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:50.209347 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0a71ce22-c2e3-49ba-bdc3-1fba67fcee8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:50.375037 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71ce22-c2e3-49ba-bdc3-1fba67fcee8e service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:50.382200 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a8aea-afbc-4ea2-a1eb-9a8f73410dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:50.382849 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a8aea-afbc-4ea2-a1eb-9a8f73410dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:50.383132 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a8aea-afbc-4ea2-a1eb-9a8f73410dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:50.383387 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a8aea-afbc-4ea2-a1eb-9a8f73410dca admin admin] PATH_INFO: `/v3/projects/67a85be427774cbba551e5db3ff0a7e8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:50.384540 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a8aea-afbc-4ea2-a1eb-9a8f73410dca admin admin] RBAC: Authorizing `identity:delete_project(project_id=67a85be427774cbba551e5db3ff0a7e8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:50.386773 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a8aea-afbc-4ea2-a1eb-9a8f73410dca admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:50.456538 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ab4a8aea-afbc-4ea2-a1eb-9a8f73410dca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67a85be427774cbba551e5db3ff0a7e8', 'request_id': 'req-ab4a8aea-afbc-4ea2-a1eb-9a8f73410dca'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:50.462758 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ab4a8aea-afbc-4ea2-a1eb-9a8f73410dca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67a85be427774cbba551e5db3ff0a7e8', 'request_id': 'req-ab4a8aea-afbc-4ea2-a1eb-9a8f73410dca'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:50.469615 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ab4a8aea-afbc-4ea2-a1eb-9a8f73410dca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67a85be427774cbba551e5db3ff0a7e8', 'request_id': 'req-ab4a8aea-afbc-4ea2-a1eb-9a8f73410dca'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:50.471776 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:50.489809 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ab4a8aea-afbc-4ea2-a1eb-9a8f73410dca admin admin] The token cache is being invalidate because project 67a85be427774cbba551e5db3ff0a7e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:55:50.490221 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ab4a8aea-afbc-4ea2-a1eb-9a8f73410dca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:50.490977 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ab4a8aea-afbc-4ea2-a1eb-9a8f73410dca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:50.492797 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 985/1979] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:55:50 2022] DELETE /identity/v3/projects/67a85be427774cbba551e5db3ff0a7e8 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:50.498013 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb96d7e-91c5-44d3-855a-596dd8874a5b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:50.498926 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb96d7e-91c5-44d3-855a-596dd8874a5b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:50.499266 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb96d7e-91c5-44d3-855a-596dd8874a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:50.521896 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-ffb96d7e-91c5-44d3-855a-596dd8874a5b None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:50.523343 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ffb96d7e-91c5-44d3-855a-596dd8874a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:50.587632 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 995/1980] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:50.596879 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138a65d-9154-4584-8e9a-8135ca5a4ff2 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:50.597302 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138a65d-9154-4584-8e9a-8135ca5a4ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:50.597661 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138a65d-9154-4584-8e9a-8135ca5a4ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:50.625540 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-4138a65d-9154-4584-8e9a-8135ca5a4ff2 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:50.626970 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4138a65d-9154-4584-8e9a-8135ca5a4ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:50.635851 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 986/1981] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:50.640330 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb96d7e-91c5-44d3-855a-596dd8874a5b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:50.652326 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb96d7e-91c5-44d3-855a-596dd8874a5b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:50.658147 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f13da1-cb38-4437-a0b9-4a5ee50cb4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:50.658982 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f13da1-cb38-4437-a0b9-4a5ee50cb4af admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:50.659325 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f13da1-cb38-4437-a0b9-4a5ee50cb4af admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:50.659592 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f13da1-cb38-4437-a0b9-4a5ee50cb4af admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:50.660355 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f13da1-cb38-4437-a0b9-4a5ee50cb4af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:50.661043 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f13da1-cb38-4437-a0b9-4a5ee50cb4af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:50.662798 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f13da1-cb38-4437-a0b9-4a5ee50cb4af admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:50.681299 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 996/1982] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:50.682773 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138a65d-9154-4584-8e9a-8135ca5a4ff2 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:50.693188 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138a65d-9154-4584-8e9a-8135ca5a4ff2 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:50.698906 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82292f9c-5d32-4faf-865d-ee04781c5235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:50.699702 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82292f9c-5d32-4faf-865d-ee04781c5235 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:50.700090 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82292f9c-5d32-4faf-865d-ee04781c5235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:50.700454 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82292f9c-5d32-4faf-865d-ee04781c5235 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:50.701422 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82292f9c-5d32-4faf-865d-ee04781c5235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:50.703336 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82292f9c-5d32-4faf-865d-ee04781c5235 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:50.749173 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 987/1983] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:55:50 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:50.750389 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f13da1-cb38-4437-a0b9-4a5ee50cb4af admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:50.763221 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f13da1-cb38-4437-a0b9-4a5ee50cb4af admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:50.847716 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef57fb9-9249-46a4-9a66-7d4f6c272a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:50.848630 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef57fb9-9249-46a4-9a66-7d4f6c272a73 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:50.849085 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef57fb9-9249-46a4-9a66-7d4f6c272a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:50.849429 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef57fb9-9249-46a4-9a66-7d4f6c272a73 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:50.850799 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef57fb9-9249-46a4-9a66-7d4f6c272a73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:50.853008 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef57fb9-9249-46a4-9a66-7d4f6c272a73 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:50.881895 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 997/1984] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:55:50 2022] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:55:50.886317 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82292f9c-5d32-4faf-865d-ee04781c5235 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:50.896948 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82292f9c-5d32-4faf-865d-ee04781c5235 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:50.902165 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796b36b-e68c-4bdf-9624-19ae0ae5167c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:50.902912 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796b36b-e68c-4bdf-9624-19ae0ae5167c admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:50.903307 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796b36b-e68c-4bdf-9624-19ae0ae5167c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:50.903590 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796b36b-e68c-4bdf-9624-19ae0ae5167c admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:50.904278 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8796b36b-e68c-4bdf-9624-19ae0ae5167c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:50.906195 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8796b36b-e68c-4bdf-9624-19ae0ae5167c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:50.917486 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 988/1985] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:50.921787 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef57fb9-9249-46a4-9a66-7d4f6c272a73 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:50.935718 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef57fb9-9249-46a4-9a66-7d4f6c272a73 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:50.942335 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4b144-13f3-42fc-9471-3d16137d5c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:50.943200 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4b144-13f3-42fc-9471-3d16137d5c08 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:50.943639 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4b144-13f3-42fc-9471-3d16137d5c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:50.944057 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4b144-13f3-42fc-9471-3d16137d5c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:50.944855 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4b144-13f3-42fc-9471-3d16137d5c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:50.948079 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4b144-13f3-42fc-9471-3d16137d5c08 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:50.961221 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 998/1986] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:55:50.965586 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796b36b-e68c-4bdf-9624-19ae0ae5167c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:50.977424 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796b36b-e68c-4bdf-9624-19ae0ae5167c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:50.983906 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f37daa-b705-4938-bf4a-aea71463eedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:50.984707 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f37daa-b705-4938-bf4a-aea71463eedb admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:50.985561 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f37daa-b705-4938-bf4a-aea71463eedb admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:50.985866 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f37daa-b705-4938-bf4a-aea71463eedb admin admin] PATH_INFO: `/v3/projects/beca4fa5162b49d59f9d6d1d9767a883/users/7ee6f934fd6544cb8d6f55558f8c52dd/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:51.017193 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f37daa-b705-4938-bf4a-aea71463eedb admin admin] RBAC: Authorizing `identity:create_grant(project_id=beca4fa5162b49d59f9d6d1d9767a883, user_id=7ee6f934fd6544cb8d6f55558f8c52dd, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:51.024104 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f37daa-b705-4938-bf4a-aea71463eedb admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:51.057260 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 989/1987] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:50 2022] PUT /identity/v3/projects/beca4fa5162b49d59f9d6d1d9767a883/users/7ee6f934fd6544cb8d6f55558f8c52dd/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:55:51.068502 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8666dc-878b-4876-b658-cb252761a80f None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:51.068822 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8666dc-878b-4876-b658-cb252761a80f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:51.069099 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8666dc-878b-4876-b658-cb252761a80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:51.108408 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-0e8666dc-878b-4876-b658-cb252761a80f None None] MFA Rules not processed for user `7ee6f934fd6544cb8d6f55558f8c52dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:51.109637 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-0e8666dc-878b-4876-b658-cb252761a80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:51.171893 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:51.233957 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 999/1988] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:51.252857 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f37daa-b705-4938-bf4a-aea71463eedb admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:51.257499 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-56f37daa-b705-4938-bf4a-aea71463eedb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:51.396586 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f37daa-b705-4938-bf4a-aea71463eedb admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:51.404140 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e85af4-cc28-45fc-b49b-d3ecc9f81ff7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:51.405233 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e85af4-cc28-45fc-b49b-d3ecc9f81ff7 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:51.406405 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e85af4-cc28-45fc-b49b-d3ecc9f81ff7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:51.406977 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e85af4-cc28-45fc-b49b-d3ecc9f81ff7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:51.420195 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e85af4-cc28-45fc-b49b-d3ecc9f81ff7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:51.422653 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e85af4-cc28-45fc-b49b-d3ecc9f81ff7 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:51.435998 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 990/1989] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:53.098312 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8666dc-878b-4876-b658-cb252761a80f None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:53.099868 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-0e8666dc-878b-4876-b658-cb252761a80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:53.189272 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8666dc-878b-4876-b658-cb252761a80f None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:53.194682 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9ff83-6bb7-45aa-9b42-b20a53571090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:53.195470 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9ff83-6bb7-45aa-9b42-b20a53571090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:53.195819 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9ff83-6bb7-45aa-9b42-b20a53571090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:53.196212 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9ff83-6bb7-45aa-9b42-b20a53571090 admin admin] PATH_INFO: `/v3/users/47e9d5fcac9047118330a3cfbc6437e1` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:53.197669 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9ff83-6bb7-45aa-9b42-b20a53571090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47e9d5fcac9047118330a3cfbc6437e1)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:53.199691 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9ff83-6bb7-45aa-9b42-b20a53571090 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:53.252769 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-61a9ff83-6bb7-45aa-9b42-b20a53571090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47e9d5fcac9047118330a3cfbc6437e1'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:53.260265 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-61a9ff83-6bb7-45aa-9b42-b20a53571090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47e9d5fcac9047118330a3cfbc6437e1'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:53.270265 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-61a9ff83-6bb7-45aa-9b42-b20a53571090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47e9d5fcac9047118330a3cfbc6437e1'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:53.291329 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-61a9ff83-6bb7-45aa-9b42-b20a53571090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47e9d5fcac9047118330a3cfbc6437e1'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:53.292146 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-61a9ff83-6bb7-45aa-9b42-b20a53571090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47e9d5fcac9047118330a3cfbc6437e1'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:53.298637 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1000/1990] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:55:53 2022] DELETE /identity/v3/users/47e9d5fcac9047118330a3cfbc6437e1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:53.303312 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22a39d-1751-47a9-be87-d082c9181968 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:53.303875 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22a39d-1751-47a9-be87-d082c9181968 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:53.303966 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22a39d-1751-47a9-be87-d082c9181968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:53.324152 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-1b22a39d-1751-47a9-be87-d082c9181968 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:53.325379 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1b22a39d-1751-47a9-be87-d082c9181968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:53.389407 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 991/1991] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:53.399196 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9ff83-6bb7-45aa-9b42-b20a53571090 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:53.401118 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-61a9ff83-6bb7-45aa-9b42-b20a53571090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:53.483128 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9ff83-6bb7-45aa-9b42-b20a53571090 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:53.488192 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfae7ac-f62e-48b8-895b-eb7548a575c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:53.489287 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfae7ac-f62e-48b8-895b-eb7548a575c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:53.489776 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfae7ac-f62e-48b8-895b-eb7548a575c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:53.490157 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfae7ac-f62e-48b8-895b-eb7548a575c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:53.498861 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:53.501543 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfae7ac-f62e-48b8-895b-eb7548a575c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:53.503535 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfae7ac-f62e-48b8-895b-eb7548a575c6 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:53.520021 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1001/1992] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:53.846151 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22a39d-1751-47a9-be87-d082c9181968 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:53.848879 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1b22a39d-1751-47a9-be87-d082c9181968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:53.863920 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22a39d-1751-47a9-be87-d082c9181968 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:53.869005 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1ae6e-bedb-48b8-bbd0-cc6d43423fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:53.869726 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1ae6e-bedb-48b8-bbd0-cc6d43423fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:53.870049 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1ae6e-bedb-48b8-bbd0-cc6d43423fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:53.870323 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1ae6e-bedb-48b8-bbd0-cc6d43423fc1 admin admin] PATH_INFO: `/v3/projects/e00ebfa8d83f462b94700395a3ab4db6` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:53.871823 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1ae6e-bedb-48b8-bbd0-cc6d43423fc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e00ebfa8d83f462b94700395a3ab4db6)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:53.873771 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1ae6e-bedb-48b8-bbd0-cc6d43423fc1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:53.906792 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:INSERT=3,keystone:DELETE=2,keystone:SELECT=95 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:53.925456 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-54f1ae6e-bedb-48b8-bbd0-cc6d43423fc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e00ebfa8d83f462b94700395a3ab4db6', 'request_id': 'req-54f1ae6e-bedb-48b8-bbd0-cc6d43423fc1'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:53.932888 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-54f1ae6e-bedb-48b8-bbd0-cc6d43423fc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e00ebfa8d83f462b94700395a3ab4db6', 'request_id': 'req-54f1ae6e-bedb-48b8-bbd0-cc6d43423fc1'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:53.939434 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-54f1ae6e-bedb-48b8-bbd0-cc6d43423fc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e00ebfa8d83f462b94700395a3ab4db6', 'request_id': 'req-54f1ae6e-bedb-48b8-bbd0-cc6d43423fc1'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:53.953535 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-54f1ae6e-bedb-48b8-bbd0-cc6d43423fc1 admin admin] The token cache is being invalidate because project e00ebfa8d83f462b94700395a3ab4db6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:55:53.953820 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-54f1ae6e-bedb-48b8-bbd0-cc6d43423fc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:53.954497 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-54f1ae6e-bedb-48b8-bbd0-cc6d43423fc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:53.956237 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 992/1993] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:55:53 2022] DELETE /identity/v3/projects/e00ebfa8d83f462b94700395a3ab4db6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:53.960393 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfae7ac-f62e-48b8-895b-eb7548a575c6 service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:53.970098 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfae7ac-f62e-48b8-895b-eb7548a575c6 service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:54.032024 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb18e0-6d0b-4281-b8fa-e37828948f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:54.032664 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb18e0-6d0b-4281-b8fa-e37828948f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:54.032951 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb18e0-6d0b-4281-b8fa-e37828948f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:54.033205 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb18e0-6d0b-4281-b8fa-e37828948f68 admin admin] PATH_INFO: `/v3/users/4c48f128a93644f19e8f4ca6b5eb8e1e` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:54.034361 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb18e0-6d0b-4281-b8fa-e37828948f68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c48f128a93644f19e8f4ca6b5eb8e1e)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:54.036302 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb18e0-6d0b-4281-b8fa-e37828948f68 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:54.084714 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9cdb18e0-6d0b-4281-b8fa-e37828948f68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c48f128a93644f19e8f4ca6b5eb8e1e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:54.092154 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9cdb18e0-6d0b-4281-b8fa-e37828948f68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c48f128a93644f19e8f4ca6b5eb8e1e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:54.101254 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9cdb18e0-6d0b-4281-b8fa-e37828948f68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c48f128a93644f19e8f4ca6b5eb8e1e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:54.114882 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9cdb18e0-6d0b-4281-b8fa-e37828948f68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c48f128a93644f19e8f4ca6b5eb8e1e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:54.115549 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9cdb18e0-6d0b-4281-b8fa-e37828948f68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c48f128a93644f19e8f4ca6b5eb8e1e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:54.121411 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1002/1994] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:55:53 2022] DELETE /identity/v3/users/4c48f128a93644f19e8f4ca6b5eb8e1e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:54.412559 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1ae6e-bedb-48b8-bbd0-cc6d43423fc1 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:54.414224 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-54f1ae6e-bedb-48b8-bbd0-cc6d43423fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:54.428496 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1ae6e-bedb-48b8-bbd0-cc6d43423fc1 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:54.505768 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09d3e5-e981-4a1d-8f4c-8228c8ad38f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:54.506491 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09d3e5-e981-4a1d-8f4c-8228c8ad38f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:54.506895 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09d3e5-e981-4a1d-8f4c-8228c8ad38f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:54.507241 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09d3e5-e981-4a1d-8f4c-8228c8ad38f4 admin admin] PATH_INFO: `/v3/projects/6fea467d7d63436099e8f2d7536e57d5` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:54.508444 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09d3e5-e981-4a1d-8f4c-8228c8ad38f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fea467d7d63436099e8f2d7536e57d5)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:54.510560 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09d3e5-e981-4a1d-8f4c-8228c8ad38f4 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:54.557812 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-bf09d3e5-e981-4a1d-8f4c-8228c8ad38f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fea467d7d63436099e8f2d7536e57d5', 'request_id': 'req-bf09d3e5-e981-4a1d-8f4c-8228c8ad38f4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:54.563511 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-bf09d3e5-e981-4a1d-8f4c-8228c8ad38f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fea467d7d63436099e8f2d7536e57d5', 'request_id': 'req-bf09d3e5-e981-4a1d-8f4c-8228c8ad38f4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:54.570108 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-bf09d3e5-e981-4a1d-8f4c-8228c8ad38f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fea467d7d63436099e8f2d7536e57d5', 'request_id': 'req-bf09d3e5-e981-4a1d-8f4c-8228c8ad38f4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:54.584004 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-bf09d3e5-e981-4a1d-8f4c-8228c8ad38f4 admin admin] The token cache is being invalidate because project 6fea467d7d63436099e8f2d7536e57d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:55:54.584274 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-bf09d3e5-e981-4a1d-8f4c-8228c8ad38f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:54.584885 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-bf09d3e5-e981-4a1d-8f4c-8228c8ad38f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:54.586435 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 993/1995] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:55:54 2022] DELETE /identity/v3/projects/6fea467d7d63436099e8f2d7536e57d5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:54.590727 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb18e0-6d0b-4281-b8fa-e37828948f68 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:54.592179 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9cdb18e0-6d0b-4281-b8fa-e37828948f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:54.605092 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb18e0-6d0b-4281-b8fa-e37828948f68 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:54.665909 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d62f9-0092-4ac7-9988-d8e588238ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:54.666623 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d62f9-0092-4ac7-9988-d8e588238ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:54.666889 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d62f9-0092-4ac7-9988-d8e588238ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:54.667169 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d62f9-0092-4ac7-9988-d8e588238ab6 admin admin] PATH_INFO: `/v3/users/afc6e3b4ceb84050a89b1a5ccba78047` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:54.668791 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d62f9-0092-4ac7-9988-d8e588238ab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afc6e3b4ceb84050a89b1a5ccba78047)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:54.671977 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d62f9-0092-4ac7-9988-d8e588238ab6 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:54.691815 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:54.728465 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c36d62f9-0092-4ac7-9988-d8e588238ab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afc6e3b4ceb84050a89b1a5ccba78047'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:54.735504 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c36d62f9-0092-4ac7-9988-d8e588238ab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afc6e3b4ceb84050a89b1a5ccba78047'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:54.743488 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c36d62f9-0092-4ac7-9988-d8e588238ab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afc6e3b4ceb84050a89b1a5ccba78047'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:54.757001 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c36d62f9-0092-4ac7-9988-d8e588238ab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afc6e3b4ceb84050a89b1a5ccba78047'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:54.757649 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c36d62f9-0092-4ac7-9988-d8e588238ab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afc6e3b4ceb84050a89b1a5ccba78047'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:54.763864 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1003/1996] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:55:54 2022] DELETE /identity/v3/users/afc6e3b4ceb84050a89b1a5ccba78047 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:55:55.054913 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09d3e5-e981-4a1d-8f4c-8228c8ad38f4 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:55.056423 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bf09d3e5-e981-4a1d-8f4c-8228c8ad38f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:55.079198 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09d3e5-e981-4a1d-8f4c-8228c8ad38f4 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:55.133570 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:55.158223 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecede7c6-45fa-4d65-a7ef-92684e653857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:55.158825 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecede7c6-45fa-4d65-a7ef-92684e653857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:55.159170 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecede7c6-45fa-4d65-a7ef-92684e653857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:55.159555 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecede7c6-45fa-4d65-a7ef-92684e653857 admin admin] PATH_INFO: `/v3/projects/59811f535d6a444db4c2b990fbcdc637` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:55.161112 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecede7c6-45fa-4d65-a7ef-92684e653857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59811f535d6a444db4c2b990fbcdc637)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:55.163683 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecede7c6-45fa-4d65-a7ef-92684e653857 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:55.218290 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ecede7c6-45fa-4d65-a7ef-92684e653857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59811f535d6a444db4c2b990fbcdc637', 'request_id': 'req-ecede7c6-45fa-4d65-a7ef-92684e653857'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:55.223805 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ecede7c6-45fa-4d65-a7ef-92684e653857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59811f535d6a444db4c2b990fbcdc637', 'request_id': 'req-ecede7c6-45fa-4d65-a7ef-92684e653857'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:55.230867 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ecede7c6-45fa-4d65-a7ef-92684e653857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59811f535d6a444db4c2b990fbcdc637', 'request_id': 'req-ecede7c6-45fa-4d65-a7ef-92684e653857'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:55.244711 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ecede7c6-45fa-4d65-a7ef-92684e653857 admin admin] The token cache is being invalidate because project 59811f535d6a444db4c2b990fbcdc637 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:55:55.245085 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ecede7c6-45fa-4d65-a7ef-92684e653857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:55.245771 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ecede7c6-45fa-4d65-a7ef-92684e653857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:55.247357 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 994/1997] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:55:55 2022] DELETE /identity/v3/projects/59811f535d6a444db4c2b990fbcdc637 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:55.253260 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd89e62-f2e6-4d2c-a125-60474c573484 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:55.254114 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd89e62-f2e6-4d2c-a125-60474c573484 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:55.254391 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd89e62-f2e6-4d2c-a125-60474c573484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:55.275061 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-0dd89e62-f2e6-4d2c-a125-60474c573484 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:55.276516 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-0dd89e62-f2e6-4d2c-a125-60474c573484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:55.343945 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1004/1998] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:55.352718 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d325197-5d98-47a1-839d-4be8bfabb3d0 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:55.352999 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d325197-5d98-47a1-839d-4be8bfabb3d0 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:55.353268 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d325197-5d98-47a1-839d-4be8bfabb3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:55.373341 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-0d325197-5d98-47a1-839d-4be8bfabb3d0 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:55.374565 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0d325197-5d98-47a1-839d-4be8bfabb3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:55.382673 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 995/1999] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:55.387347 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd89e62-f2e6-4d2c-a125-60474c573484 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:55.399607 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd89e62-f2e6-4d2c-a125-60474c573484 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:55.405537 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7ec5a-4e22-4894-b030-a685ca496e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:55.406193 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7ec5a-4e22-4894-b030-a685ca496e30 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:55.406452 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7ec5a-4e22-4894-b030-a685ca496e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:55.406738 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7ec5a-4e22-4894-b030-a685ca496e30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:55.407391 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b7ec5a-4e22-4894-b030-a685ca496e30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:55.407720 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b7ec5a-4e22-4894-b030-a685ca496e30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:55.409301 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b7ec5a-4e22-4894-b030-a685ca496e30 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:55.422535 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1005/2000] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:55.427232 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d325197-5d98-47a1-839d-4be8bfabb3d0 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:55.437234 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d325197-5d98-47a1-839d-4be8bfabb3d0 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:55.442201 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd2bfc-acfa-4b6a-ac21-4d0115ee2c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:55.442813 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd2bfc-acfa-4b6a-ac21-4d0115ee2c21 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:55.443092 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd2bfc-acfa-4b6a-ac21-4d0115ee2c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:55.443361 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd2bfc-acfa-4b6a-ac21-4d0115ee2c21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:55.443994 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd2bfc-acfa-4b6a-ac21-4d0115ee2c21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:55.445954 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd2bfc-acfa-4b6a-ac21-4d0115ee2c21 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:55.478023 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 996/2001] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:55:55 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:55.479478 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7ec5a-4e22-4894-b030-a685ca496e30 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:55.489767 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7ec5a-4e22-4894-b030-a685ca496e30 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:55.560634 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e39bd-45ba-419b-97b1-2c2b64145adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:55.561332 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e39bd-45ba-419b-97b1-2c2b64145adc admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:55.561680 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e39bd-45ba-419b-97b1-2c2b64145adc admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:55.562045 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e39bd-45ba-419b-97b1-2c2b64145adc admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:55.562772 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e39bd-45ba-419b-97b1-2c2b64145adc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:55.564744 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e39bd-45ba-419b-97b1-2c2b64145adc admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:55.594041 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1006/2002] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:55:55 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:55:55.595166 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd2bfc-acfa-4b6a-ac21-4d0115ee2c21 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:55.607190 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd2bfc-acfa-4b6a-ac21-4d0115ee2c21 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:55.612652 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cfe7e-52e1-4c72-a9a2-84b8f0aa6830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:55.613271 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cfe7e-52e1-4c72-a9a2-84b8f0aa6830 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:55.613551 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cfe7e-52e1-4c72-a9a2-84b8f0aa6830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:55.613828 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cfe7e-52e1-4c72-a9a2-84b8f0aa6830 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:55.614533 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cfe7e-52e1-4c72-a9a2-84b8f0aa6830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:55.616213 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cfe7e-52e1-4c72-a9a2-84b8f0aa6830 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:55.628938 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 997/2003] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:55.632925 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e39bd-45ba-419b-97b1-2c2b64145adc admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:55.642978 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e39bd-45ba-419b-97b1-2c2b64145adc admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:55.647843 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d81747-f691-430a-b99d-91899730aadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:55.648583 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d81747-f691-430a-b99d-91899730aadf admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:55.648921 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d81747-f691-430a-b99d-91899730aadf admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:55.649379 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d81747-f691-430a-b99d-91899730aadf admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:55.650014 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d81747-f691-430a-b99d-91899730aadf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:55.651810 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d81747-f691-430a-b99d-91899730aadf admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:55.657784 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:55.663928 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1007/2004] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:55.668699 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cfe7e-52e1-4c72-a9a2-84b8f0aa6830 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:55.681247 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cfe7e-52e1-4c72-a9a2-84b8f0aa6830 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:55.687456 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb4ccf-7fc7-405c-9285-5c520e670052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:55.688311 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb4ccf-7fc7-405c-9285-5c520e670052 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:55.688653 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb4ccf-7fc7-405c-9285-5c520e670052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:55.689005 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb4ccf-7fc7-405c-9285-5c520e670052 admin admin] PATH_INFO: `/v3/projects/fa1c8f8b10c04dd2ad540f5421bff42d/users/efb9172e2c74408280b2a19fe6ad9b26/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:55.704485 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb4ccf-7fc7-405c-9285-5c520e670052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa1c8f8b10c04dd2ad540f5421bff42d, user_id=efb9172e2c74408280b2a19fe6ad9b26, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:55.707203 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb4ccf-7fc7-405c-9285-5c520e670052 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:55.721615 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 998/2005] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:55:55 2022] PUT /identity/v3/projects/fa1c8f8b10c04dd2ad540f5421bff42d/users/efb9172e2c74408280b2a19fe6ad9b26/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:55.734501 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052aec7-ff08-4b94-bced-605ae0fa02dc None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:55.734767 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052aec7-ff08-4b94-bced-605ae0fa02dc None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:55.735237 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052aec7-ff08-4b94-bced-605ae0fa02dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:55.763617 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-d052aec7-ff08-4b94-bced-605ae0fa02dc None None] MFA Rules not processed for user `efb9172e2c74408280b2a19fe6ad9b26`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:55.764890 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d052aec7-ff08-4b94-bced-605ae0fa02dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:55.832001 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1008/2006] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:55.843794 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb4ccf-7fc7-405c-9285-5c520e670052 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:55.845579 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0bcb4ccf-7fc7-405c-9285-5c520e670052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:55.925936 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb4ccf-7fc7-405c-9285-5c520e670052 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:55.931377 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee08e8a-9a15-423e-aa55-1d26b162b9b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34fd9f7932e14a409d7668d40ff6680e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:55.932627 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee08e8a-9a15-423e-aa55-1d26b162b9b3 service glance] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:55.932963 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee08e8a-9a15-423e-aa55-1d26b162b9b3 service glance] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:55.933193 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee08e8a-9a15-423e-aa55-1d26b162b9b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:55.940385 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:55.944484 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee08e8a-9a15-423e-aa55-1d26b162b9b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:55.946408 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee08e8a-9a15-423e-aa55-1d26b162b9b3 service glance] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:55.960319 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 999/2007] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:59.129401 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7f1ed-cec4-44a2-b93b-f2b0ce06a31f None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:59.129983 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7f1ed-cec4-44a2-b93b-f2b0ce06a31f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:59.129983 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7f1ed-cec4-44a2-b93b-f2b0ce06a31f None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:59.131647 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1009/2008] 10.222.0.52 () {54 vars in 921 bytes} [Sun Aug 28 00:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:55:59.172994 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc9457-dd58-412c-b80a-8461de0e5c63 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:59.173599 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc9457-dd58-412c-b80a-8461de0e5c63 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:59.173599 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc9457-dd58-412c-b80a-8461de0e5c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:59.195040 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-52bc9457-dd58-412c-b80a-8461de0e5c63 None None] MFA Rules not processed for user `ae87149f6ab04a9997263598737ae27e`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:59.197161 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-52bc9457-dd58-412c-b80a-8461de0e5c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:59.279890 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7f1ed-cec4-44a2-b93b-f2b0ce06a31f None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:59.282454 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-dfe7f1ed-cec4-44a2-b93b-f2b0ce06a31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:59.321237 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1000/2009] 10.222.0.52 () {58 vars in 1018 bytes} [Sun Aug 28 00:55:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:59.344260 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e712ba-7f28-46f6-8b20-2052e319f7f8 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:59.344700 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e712ba-7f28-46f6-8b20-2052e319f7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:59.345011 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e712ba-7f28-46f6-8b20-2052e319f7f8 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:59.346644 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1001/2010] 10.222.0.52 () {54 vars in 961 bytes} [Sun Aug 28 00:55:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:55:59.352181 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6be2df-9cc5-42c3-9de9-7551c3717af3 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:59.352539 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6be2df-9cc5-42c3-9de9-7551c3717af3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:59.353826 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6be2df-9cc5-42c3-9de9-7551c3717af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:59.358686 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7f1ed-cec4-44a2-b93b-f2b0ce06a31f None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:59.369558 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba10a4a-3e96-4558-aa0f-be5ab6b4b525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:59.374412 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba10a4a-3e96-4558-aa0f-be5ab6b4b525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:59.374692 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba10a4a-3e96-4558-aa0f-be5ab6b4b525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:59.375417 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba10a4a-3e96-4558-aa0f-be5ab6b4b525 admin admin] PATH_INFO: `/v3/users/c9ef21c1f5b949df8230d1587c4a1fa6` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:59.378607 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba10a4a-3e96-4558-aa0f-be5ab6b4b525 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9ef21c1f5b949df8230d1587c4a1fa6)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:59.382627 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba10a4a-3e96-4558-aa0f-be5ab6b4b525 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:59.385428 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-ac6be2df-9cc5-42c3-9de9-7551c3717af3 None None] MFA Rules not processed for user `ae87149f6ab04a9997263598737ae27e`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:59.387135 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ac6be2df-9cc5-42c3-9de9-7551c3717af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:59.402011 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1002/2011] 10.222.0.52 () {58 vars in 1058 bytes} [Sun Aug 28 00:55:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:55:59.411942 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6be2df-9cc5-42c3-9de9-7551c3717af3 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:59.426834 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6be2df-9cc5-42c3-9de9-7551c3717af3 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:59.435060 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783127d7-7484-47c4-8876-20090ca3c6ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae87149f6ab04a9997263598737ae27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:59.435688 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783127d7-7484-47c4-8876-20090ca3c6ba service placement] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:59.435981 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783127d7-7484-47c4-8876-20090ca3c6ba service placement] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:59.436260 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783127d7-7484-47c4-8876-20090ca3c6ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:59.445570 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783127d7-7484-47c4-8876-20090ca3c6ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:59.447308 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783127d7-7484-47c4-8876-20090ca3c6ba service placement] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:59.451914 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-dba10a4a-3e96-4558-aa0f-be5ab6b4b525 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9ef21c1f5b949df8230d1587c4a1fa6'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:59.459535 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1003/2012] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:55:59.463404 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-dba10a4a-3e96-4558-aa0f-be5ab6b4b525 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9ef21c1f5b949df8230d1587c4a1fa6'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:59.473546 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-dba10a4a-3e96-4558-aa0f-be5ab6b4b525 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9ef21c1f5b949df8230d1587c4a1fa6'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:59.490956 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-dba10a4a-3e96-4558-aa0f-be5ab6b4b525 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9ef21c1f5b949df8230d1587c4a1fa6'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:59.492974 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-dba10a4a-3e96-4558-aa0f-be5ab6b4b525 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9ef21c1f5b949df8230d1587c4a1fa6'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:59.523989 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1010/2013] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:55:59 2022] DELETE /identity/v3/users/c9ef21c1f5b949df8230d1587c4a1fa6 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:59.739736 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783127d7-7484-47c4-8876-20090ca3c6ba service placement] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:59.751666 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783127d7-7484-47c4-8876-20090ca3c6ba service placement] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:59.813573 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc942b-2dec-4eeb-8b73-5e21308b3231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:59.814246 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc942b-2dec-4eeb-8b73-5e21308b3231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:59.814528 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc942b-2dec-4eeb-8b73-5e21308b3231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:59.814798 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc942b-2dec-4eeb-8b73-5e21308b3231 admin admin] PATH_INFO: `/v3/projects/3513289586f248dbbf966bfa15aefca5` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:59.815909 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc942b-2dec-4eeb-8b73-5e21308b3231 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3513289586f248dbbf966bfa15aefca5)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:59.818102 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc942b-2dec-4eeb-8b73-5e21308b3231 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:59.869362 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-aafc942b-2dec-4eeb-8b73-5e21308b3231 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3513289586f248dbbf966bfa15aefca5', 'request_id': 'req-aafc942b-2dec-4eeb-8b73-5e21308b3231'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:59.874784 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-aafc942b-2dec-4eeb-8b73-5e21308b3231 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3513289586f248dbbf966bfa15aefca5', 'request_id': 'req-aafc942b-2dec-4eeb-8b73-5e21308b3231'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:59.881434 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-aafc942b-2dec-4eeb-8b73-5e21308b3231 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3513289586f248dbbf966bfa15aefca5', 'request_id': 'req-aafc942b-2dec-4eeb-8b73-5e21308b3231'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:59.895573 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:59.900943 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-aafc942b-2dec-4eeb-8b73-5e21308b3231 admin admin] The token cache is being invalidate because project 3513289586f248dbbf966bfa15aefca5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:55:59.901460 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-aafc942b-2dec-4eeb-8b73-5e21308b3231 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:59.903160 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-aafc942b-2dec-4eeb-8b73-5e21308b3231 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:55:59.904755 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1004/2014] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:55:59 2022] DELETE /identity/v3/projects/3513289586f248dbbf966bfa15aefca5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:59.911107 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085bb62-0832-4e0e-9711-d62d1e9a7f43 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:59.912648 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085bb62-0832-4e0e-9711-d62d1e9a7f43 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:59.912648 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085bb62-0832-4e0e-9711-d62d1e9a7f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:59.947539 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-e085bb62-0832-4e0e-9711-d62d1e9a7f43 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:59.953069 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e085bb62-0832-4e0e-9711-d62d1e9a7f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:59.961807 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:00.023916 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1011/2015] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:56:00.032061 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363887f-e9e4-42a3-a4fb-0c11a9e1f0d1 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:00.032351 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363887f-e9e4-42a3-a4fb-0c11a9e1f0d1 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:00.032644 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363887f-e9e4-42a3-a4fb-0c11a9e1f0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:00.064955 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b363887f-e9e4-42a3-a4fb-0c11a9e1f0d1 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:00.066508 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b363887f-e9e4-42a3-a4fb-0c11a9e1f0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:00.080869 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1005/2016] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:00.085163 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085bb62-0832-4e0e-9711-d62d1e9a7f43 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:00.095376 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085bb62-0832-4e0e-9711-d62d1e9a7f43 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:00.101309 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5e620-ebce-421c-a1c4-0543ba818fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:00.102068 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5e620-ebce-421c-a1c4-0543ba818fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:00.102347 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5e620-ebce-421c-a1c4-0543ba818fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:00.102617 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5e620-ebce-421c-a1c4-0543ba818fa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:00.103266 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b5e620-ebce-421c-a1c4-0543ba818fa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:56:00.103564 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b5e620-ebce-421c-a1c4-0543ba818fa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:00.105320 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b5e620-ebce-421c-a1c4-0543ba818fa2 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:00.119852 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1012/2017] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:56:00.124337 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363887f-e9e4-42a3-a4fb-0c11a9e1f0d1 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:00.134364 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363887f-e9e4-42a3-a4fb-0c11a9e1f0d1 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:00.141899 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7e98e-9cad-4f26-a598-ecd1836abdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:00.142520 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7e98e-9cad-4f26-a598-ecd1836abdca admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:00.142796 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7e98e-9cad-4f26-a598-ecd1836abdca admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:00.143066 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7e98e-9cad-4f26-a598-ecd1836abdca admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:00.143860 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7e98e-9cad-4f26-a598-ecd1836abdca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:00.145864 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7e98e-9cad-4f26-a598-ecd1836abdca admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:00.187153 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1006/2018] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:56:00 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:56:00.191885 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5e620-ebce-421c-a1c4-0543ba818fa2 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:00.205756 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5e620-ebce-421c-a1c4-0543ba818fa2 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:00.265788 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553dc8a-d0e2-4acf-ab67-f4e504e8b23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:00.266430 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553dc8a-d0e2-4acf-ab67-f4e504e8b23f admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:00.266710 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553dc8a-d0e2-4acf-ab67-f4e504e8b23f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:00.266978 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553dc8a-d0e2-4acf-ab67-f4e504e8b23f admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:00.267590 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553dc8a-d0e2-4acf-ab67-f4e504e8b23f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:00.269510 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553dc8a-d0e2-4acf-ab67-f4e504e8b23f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:00.300824 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1013/2019] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:56:00 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:56:00.302082 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7e98e-9cad-4f26-a598-ecd1836abdca admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:00.319078 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7e98e-9cad-4f26-a598-ecd1836abdca admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:00.324836 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f31106-01f4-49a3-bd7f-f5993eb29ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:00.325448 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f31106-01f4-49a3-bd7f-f5993eb29ebd admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:00.325734 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f31106-01f4-49a3-bd7f-f5993eb29ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:00.326036 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f31106-01f4-49a3-bd7f-f5993eb29ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:00.326686 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f31106-01f4-49a3-bd7f-f5993eb29ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:00.328335 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f31106-01f4-49a3-bd7f-f5993eb29ebd admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:00.339607 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1007/2020] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:00.343936 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553dc8a-d0e2-4acf-ab67-f4e504e8b23f admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:00.354652 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553dc8a-d0e2-4acf-ab67-f4e504e8b23f admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:00.359392 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c72740-376b-42a4-a4b4-e0b1ae0f27a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:00.360019 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c72740-376b-42a4-a4b4-e0b1ae0f27a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:00.360299 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c72740-376b-42a4-a4b4-e0b1ae0f27a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:00.360572 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c72740-376b-42a4-a4b4-e0b1ae0f27a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:00.361212 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c72740-376b-42a4-a4b4-e0b1ae0f27a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:00.362849 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c72740-376b-42a4-a4b4-e0b1ae0f27a1 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:00.374722 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1014/2021] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:00.379160 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f31106-01f4-49a3-bd7f-f5993eb29ebd admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:00.390323 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f31106-01f4-49a3-bd7f-f5993eb29ebd admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:00.395971 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e776dc-049d-439e-af12-abd3289a0e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:00.396622 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e776dc-049d-439e-af12-abd3289a0e86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:00.396896 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e776dc-049d-439e-af12-abd3289a0e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:00.397157 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e776dc-049d-439e-af12-abd3289a0e86 admin admin] PATH_INFO: `/v3/projects/83f4f2a1a9fb438090ab536e56e4bb80/users/dc2b620887a6400eb2be5f9db2ad0127/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:00.412770 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e776dc-049d-439e-af12-abd3289a0e86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83f4f2a1a9fb438090ab536e56e4bb80, user_id=dc2b620887a6400eb2be5f9db2ad0127, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:00.415454 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e776dc-049d-439e-af12-abd3289a0e86 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:00.433262 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1008/2022] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:56:00 2022] PUT /identity/v3/projects/83f4f2a1a9fb438090ab536e56e4bb80/users/dc2b620887a6400eb2be5f9db2ad0127/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:00.443622 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4562ed-3b45-4ad9-869f-4d5689c0efb4 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:00.444035 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4562ed-3b45-4ad9-869f-4d5689c0efb4 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:00.444322 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4562ed-3b45-4ad9-869f-4d5689c0efb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:00.475177 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-6f4562ed-3b45-4ad9-869f-4d5689c0efb4 None None] MFA Rules not processed for user `dc2b620887a6400eb2be5f9db2ad0127`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:00.476650 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6f4562ed-3b45-4ad9-869f-4d5689c0efb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:00.552572 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1015/2023] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:00.558242 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e776dc-049d-439e-af12-abd3289a0e86 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:00.623393 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e776dc-049d-439e-af12-abd3289a0e86 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:00.629183 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd03b4a-bde4-480c-97f9-6f16465b32cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:00.629802 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd03b4a-bde4-480c-97f9-6f16465b32cd admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:00.630102 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd03b4a-bde4-480c-97f9-6f16465b32cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:00.630376 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd03b4a-bde4-480c-97f9-6f16465b32cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:00.631014 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd03b4a-bde4-480c-97f9-6f16465b32cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:00.632986 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd03b4a-bde4-480c-97f9-6f16465b32cd admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:00.663945 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1009/2024] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:56:00 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:56:00.668733 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4562ed-3b45-4ad9-869f-4d5689c0efb4 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:00.680655 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4562ed-3b45-4ad9-869f-4d5689c0efb4 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:00.685947 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:00.749048 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce171a0-210e-4ccd-9ab7-e2593d36db24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:00.749738 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce171a0-210e-4ccd-9ab7-e2593d36db24 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:00.750321 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce171a0-210e-4ccd-9ab7-e2593d36db24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:00.750690 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce171a0-210e-4ccd-9ab7-e2593d36db24 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:00.751441 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce171a0-210e-4ccd-9ab7-e2593d36db24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:00.753423 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce171a0-210e-4ccd-9ab7-e2593d36db24 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:00.784934 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1016/2025] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:56:00 2022] POST /identity/v3/users => generated 295 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:56:00.789015 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd03b4a-bde4-480c-97f9-6f16465b32cd admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:00.800816 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd03b4a-bde4-480c-97f9-6f16465b32cd admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:00.806214 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268621f-ce4f-4076-84b8-5ca249af3ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:00.806992 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268621f-ce4f-4076-84b8-5ca249af3ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:00.807273 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268621f-ce4f-4076-84b8-5ca249af3ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:00.807556 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268621f-ce4f-4076-84b8-5ca249af3ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:00.808224 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9268621f-ce4f-4076-84b8-5ca249af3ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:00.809930 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9268621f-ce4f-4076-84b8-5ca249af3ec8 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:00.822173 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1010/2026] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:00.827018 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce171a0-210e-4ccd-9ab7-e2593d36db24 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:00.838414 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce171a0-210e-4ccd-9ab7-e2593d36db24 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:00.843019 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112bf2f2-665a-4882-9779-d059b5e4aac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:00.843679 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bf2f2-665a-4882-9779-d059b5e4aac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:00.843957 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bf2f2-665a-4882-9779-d059b5e4aac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:00.844226 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bf2f2-665a-4882-9779-d059b5e4aac2 admin admin] PATH_INFO: `/v3/projects/5e512c0bf08242d8bdf6143eb03c7b3e/users/d029234b2e7846f78579975415b6bd52/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:00.859742 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112bf2f2-665a-4882-9779-d059b5e4aac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e512c0bf08242d8bdf6143eb03c7b3e, user_id=d029234b2e7846f78579975415b6bd52, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:00.862540 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112bf2f2-665a-4882-9779-d059b5e4aac2 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:00.878516 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1017/2027] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:56:00 2022] PUT /identity/v3/projects/5e512c0bf08242d8bdf6143eb03c7b3e/users/d029234b2e7846f78579975415b6bd52/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:00.882759 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268621f-ce4f-4076-84b8-5ca249af3ec8 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:00.893895 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268621f-ce4f-4076-84b8-5ca249af3ec8 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:00.956962 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a566dc5-bfac-4ad3-9fe8-fe8bd81d08b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:00.957586 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a566dc5-bfac-4ad3-9fe8-fe8bd81d08b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:00.957873 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a566dc5-bfac-4ad3-9fe8-fe8bd81d08b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:00.958168 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a566dc5-bfac-4ad3-9fe8-fe8bd81d08b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:00.958852 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a566dc5-bfac-4ad3-9fe8-fe8bd81d08b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:00.960482 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a566dc5-bfac-4ad3-9fe8-fe8bd81d08b3 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:00.972036 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1011/2028] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:00.976869 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112bf2f2-665a-4882-9779-d059b5e4aac2 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:00.988236 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112bf2f2-665a-4882-9779-d059b5e4aac2 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:00.993339 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c0ed8-5287-4ffb-b054-963c3f5e7e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:00.994246 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c0ed8-5287-4ffb-b054-963c3f5e7e80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:00.994581 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c0ed8-5287-4ffb-b054-963c3f5e7e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:00.994855 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c0ed8-5287-4ffb-b054-963c3f5e7e80 admin admin] PATH_INFO: `/v3/projects/5e512c0bf08242d8bdf6143eb03c7b3e/users/d029234b2e7846f78579975415b6bd52/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:00.997012 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c0ed8-5287-4ffb-b054-963c3f5e7e80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e512c0bf08242d8bdf6143eb03c7b3e, user_id=d029234b2e7846f78579975415b6bd52, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:00.999704 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c0ed8-5287-4ffb-b054-963c3f5e7e80 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:01.022707 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1018/2029] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:56:00 2022] PUT /identity/v3/projects/5e512c0bf08242d8bdf6143eb03c7b3e/users/d029234b2e7846f78579975415b6bd52/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:01.025235 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dac784-74e2-4fec-b32a-3a211b7ce534 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:01.025798 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dac784-74e2-4fec-b32a-3a211b7ce534 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:01.026168 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dac784-74e2-4fec-b32a-3a211b7ce534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:01.047755 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:01.065702 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-89dac784-74e2-4fec-b32a-3a211b7ce534 None None] MFA Rules not processed for user `d029234b2e7846f78579975415b6bd52`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:01.066952 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-89dac784-74e2-4fec-b32a-3a211b7ce534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:01.149176 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1012/2030] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:01.162169 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c0ed8-5287-4ffb-b054-963c3f5e7e80 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:01.164419 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-787c0ed8-5287-4ffb-b054-963c3f5e7e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:01.226741 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c0ed8-5287-4ffb-b054-963c3f5e7e80 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:01.231053 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cfeb8-1f37-4433-bd5f-1817f96bca90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:01.231674 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cfeb8-1f37-4433-bd5f-1817f96bca90 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:01.231955 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cfeb8-1f37-4433-bd5f-1817f96bca90 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:01.232292 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cfeb8-1f37-4433-bd5f-1817f96bca90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:01.291772 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053cfeb8-1f37-4433-bd5f-1817f96bca90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:01.293531 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053cfeb8-1f37-4433-bd5f-1817f96bca90 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:01.302468 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1019/2031] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:04.037924 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dac784-74e2-4fec-b32a-3a211b7ce534 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:04.039465 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-89dac784-74e2-4fec-b32a-3a211b7ce534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:04.052225 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dac784-74e2-4fec-b32a-3a211b7ce534 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:04.056307 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9dbcc-1e75-461c-8b97-e669407a6cb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:04.057028 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9dbcc-1e75-461c-8b97-e669407a6cb3 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:04.057406 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9dbcc-1e75-461c-8b97-e669407a6cb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:04.057714 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9dbcc-1e75-461c-8b97-e669407a6cb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:04.067619 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b9dbcc-1e75-461c-8b97-e669407a6cb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:04.069136 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b9dbcc-1e75-461c-8b97-e669407a6cb3 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:04.082553 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1013/2032] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:04 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:04.390104 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cfeb8-1f37-4433-bd5f-1817f96bca90 service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:04.398473 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cfeb8-1f37-4433-bd5f-1817f96bca90 service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:04.403186 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1906a20-13e5-49f3-819a-171e469ed334 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:04.403827 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1906a20-13e5-49f3-819a-171e469ed334 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:04.404061 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1906a20-13e5-49f3-819a-171e469ed334 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:04.404332 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1906a20-13e5-49f3-819a-171e469ed334 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:04.406180 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f1906a20-13e5-49f3-819a-171e469ed334 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:04.416545 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:04.485534 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1906a20-13e5-49f3-819a-171e469ed334 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:04.487030 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1906a20-13e5-49f3-819a-171e469ed334 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:04.497916 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1020/2033] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:56:05.898759 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9dbcc-1e75-461c-8b97-e669407a6cb3 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:05.900669 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-70b9dbcc-1e75-461c-8b97-e669407a6cb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:05.987637 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9dbcc-1e75-461c-8b97-e669407a6cb3 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:05.995847 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b9f40-cc21-4630-bb7a-18dc3c7f23c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:05.996484 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b9f40-cc21-4630-bb7a-18dc3c7f23c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:05.996755 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b9f40-cc21-4630-bb7a-18dc3c7f23c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:05.997021 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b9f40-cc21-4630-bb7a-18dc3c7f23c9 admin admin] PATH_INFO: `/v3/users/7ee6f934fd6544cb8d6f55558f8c52dd` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:05.998433 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b9f40-cc21-4630-bb7a-18dc3c7f23c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ee6f934fd6544cb8d6f55558f8c52dd)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:06.000654 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b9f40-cc21-4630-bb7a-18dc3c7f23c9 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:06.053915 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e30b9f40-cc21-4630-bb7a-18dc3c7f23c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ee6f934fd6544cb8d6f55558f8c52dd'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:06.066986 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e30b9f40-cc21-4630-bb7a-18dc3c7f23c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ee6f934fd6544cb8d6f55558f8c52dd'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:06.074521 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e30b9f40-cc21-4630-bb7a-18dc3c7f23c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ee6f934fd6544cb8d6f55558f8c52dd'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:06.084151 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e30b9f40-cc21-4630-bb7a-18dc3c7f23c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ee6f934fd6544cb8d6f55558f8c52dd'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:06.084765 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e30b9f40-cc21-4630-bb7a-18dc3c7f23c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ee6f934fd6544cb8d6f55558f8c52dd'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:06.086544 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:06.094351 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1014/2034] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:56:05 2022] DELETE /identity/v3/users/7ee6f934fd6544cb8d6f55558f8c52dd => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:06.099476 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f04139-595d-4330-b690-a833fd0171f4 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:06.100286 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f04139-595d-4330-b690-a833fd0171f4 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:06.100885 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f04139-595d-4330-b690-a833fd0171f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:06.121136 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-31f04139-595d-4330-b690-a833fd0171f4 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:06.122579 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-31f04139-595d-4330-b690-a833fd0171f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:06.183467 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1021/2035] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:06.193709 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b9f40-cc21-4630-bb7a-18dc3c7f23c9 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:06.195526 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e30b9f40-cc21-4630-bb7a-18dc3c7f23c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:06.262773 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b9f40-cc21-4630-bb7a-18dc3c7f23c9 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:06.266625 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd0188-cc07-4e84-91a8-2a5223b9631c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:06.267235 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd0188-cc07-4e84-91a8-2a5223b9631c service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:06.267514 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd0188-cc07-4e84-91a8-2a5223b9631c service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:06.267786 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd0188-cc07-4e84-91a8-2a5223b9631c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:06.277319 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd0188-cc07-4e84-91a8-2a5223b9631c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:06.278797 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd0188-cc07-4e84-91a8-2a5223b9631c service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:06.288511 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1015/2036] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:06.659222 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f04139-595d-4330-b690-a833fd0171f4 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:06.660725 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-31f04139-595d-4330-b690-a833fd0171f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:06.674543 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f04139-595d-4330-b690-a833fd0171f4 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:06.680482 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b49c48-5e29-4b78-b8e6-72113ac7d317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:06.681138 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b49c48-5e29-4b78-b8e6-72113ac7d317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:06.681445 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b49c48-5e29-4b78-b8e6-72113ac7d317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:06.681734 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b49c48-5e29-4b78-b8e6-72113ac7d317 admin admin] PATH_INFO: `/v3/projects/beca4fa5162b49d59f9d6d1d9767a883` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:06.683196 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b49c48-5e29-4b78-b8e6-72113ac7d317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=beca4fa5162b49d59f9d6d1d9767a883)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:06.685168 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b49c48-5e29-4b78-b8e6-72113ac7d317 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:06.754811 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-44b49c48-5e29-4b78-b8e6-72113ac7d317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beca4fa5162b49d59f9d6d1d9767a883', 'request_id': 'req-44b49c48-5e29-4b78-b8e6-72113ac7d317'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:06.765640 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-44b49c48-5e29-4b78-b8e6-72113ac7d317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beca4fa5162b49d59f9d6d1d9767a883', 'request_id': 'req-44b49c48-5e29-4b78-b8e6-72113ac7d317'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:06.775685 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-44b49c48-5e29-4b78-b8e6-72113ac7d317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beca4fa5162b49d59f9d6d1d9767a883', 'request_id': 'req-44b49c48-5e29-4b78-b8e6-72113ac7d317'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:06.800532 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-44b49c48-5e29-4b78-b8e6-72113ac7d317 admin admin] The token cache is being invalidate because project beca4fa5162b49d59f9d6d1d9767a883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:56:06.801167 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-44b49c48-5e29-4b78-b8e6-72113ac7d317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:06.802264 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-44b49c48-5e29-4b78-b8e6-72113ac7d317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:06.809931 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1022/2037] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:56:06 2022] DELETE /identity/v3/projects/beca4fa5162b49d59f9d6d1d9767a883 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:06.815606 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b4544-1cf1-4a23-89a0-ed32a13ee3f8 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:06.816176 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b4544-1cf1-4a23-89a0-ed32a13ee3f8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:06.816696 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b4544-1cf1-4a23-89a0-ed32a13ee3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:06.850784 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-8b4b4544-1cf1-4a23-89a0-ed32a13ee3f8 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:06.862701 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8b4b4544-1cf1-4a23-89a0-ed32a13ee3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:06.952687 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1016/2038] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:06.961058 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca8053-519a-4422-aeb2-9c0bd8861230 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:06.961448 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca8053-519a-4422-aeb2-9c0bd8861230 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:06.961626 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca8053-519a-4422-aeb2-9c0bd8861230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:06.984947 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-5aca8053-519a-4422-aeb2-9c0bd8861230 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:06.986417 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-5aca8053-519a-4422-aeb2-9c0bd8861230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:07.017087 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1023/2039] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:07.021174 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b4544-1cf1-4a23-89a0-ed32a13ee3f8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:07.032276 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b4544-1cf1-4a23-89a0-ed32a13ee3f8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:07.037763 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42401d-28d4-48d6-84d8-89bb0be78997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:07.038559 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42401d-28d4-48d6-84d8-89bb0be78997 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:07.038940 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42401d-28d4-48d6-84d8-89bb0be78997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:07.039300 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42401d-28d4-48d6-84d8-89bb0be78997 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:07.040284 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42401d-28d4-48d6-84d8-89bb0be78997 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:56:07.040696 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42401d-28d4-48d6-84d8-89bb0be78997 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:07.042884 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42401d-28d4-48d6-84d8-89bb0be78997 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:07.062816 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1017/2040] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:56:07.074040 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca8053-519a-4422-aeb2-9c0bd8861230 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:07.088395 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca8053-519a-4422-aeb2-9c0bd8861230 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:07.093453 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99899644-eb6e-4f3c-ab69-a60b5ed2f688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:07.094103 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99899644-eb6e-4f3c-ab69-a60b5ed2f688 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:07.094433 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99899644-eb6e-4f3c-ab69-a60b5ed2f688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:07.094704 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99899644-eb6e-4f3c-ab69-a60b5ed2f688 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:07.095341 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99899644-eb6e-4f3c-ab69-a60b5ed2f688 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:07.097287 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99899644-eb6e-4f3c-ab69-a60b5ed2f688 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:07.121177 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:07.138480 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1024/2041] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:56:07 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:56:07.143012 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42401d-28d4-48d6-84d8-89bb0be78997 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:07.156566 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42401d-28d4-48d6-84d8-89bb0be78997 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:07.235166 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a5562-6402-4554-a805-1a1db51badd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:07.235775 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a5562-6402-4554-a805-1a1db51badd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:07.236056 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a5562-6402-4554-a805-1a1db51badd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:07.236329 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a5562-6402-4554-a805-1a1db51badd9 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:07.236993 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a5562-6402-4554-a805-1a1db51badd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:07.238974 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a5562-6402-4554-a805-1a1db51badd9 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:07.262591 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1018/2042] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:56:07 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:56:07.266967 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99899644-eb6e-4f3c-ab69-a60b5ed2f688 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:07.277611 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99899644-eb6e-4f3c-ab69-a60b5ed2f688 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:07.282401 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f518a-a87b-435a-9e7b-9e182fe233e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:07.283003 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f518a-a87b-435a-9e7b-9e182fe233e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:07.283284 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f518a-a87b-435a-9e7b-9e182fe233e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:07.283556 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f518a-a87b-435a-9e7b-9e182fe233e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:07.284277 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f518a-a87b-435a-9e7b-9e182fe233e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:07.285981 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f518a-a87b-435a-9e7b-9e182fe233e8 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:07.296651 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1025/2043] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:07.300643 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a5562-6402-4554-a805-1a1db51badd9 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:07.311195 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a5562-6402-4554-a805-1a1db51badd9 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:07.316445 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cee441-8c27-4173-b604-4058d461c89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:07.317079 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cee441-8c27-4173-b604-4058d461c89a admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:07.317358 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cee441-8c27-4173-b604-4058d461c89a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:07.317734 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cee441-8c27-4173-b604-4058d461c89a admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:07.318411 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cee441-8c27-4173-b604-4058d461c89a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:07.320014 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cee441-8c27-4173-b604-4058d461c89a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:07.330917 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1019/2044] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:07.335278 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f518a-a87b-435a-9e7b-9e182fe233e8 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:07.345526 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f518a-a87b-435a-9e7b-9e182fe233e8 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:07.350853 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c8fff-c433-4b60-8eb8-f6e31af2279a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:07.352069 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c8fff-c433-4b60-8eb8-f6e31af2279a admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:07.352352 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c8fff-c433-4b60-8eb8-f6e31af2279a admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:07.352623 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c8fff-c433-4b60-8eb8-f6e31af2279a admin admin] PATH_INFO: `/v3/projects/9eb3fcaa2ae34223bde2a637b4dcc221/users/1533b195375840d5885ffd5946a40d14/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:07.367822 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c8fff-c433-4b60-8eb8-f6e31af2279a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eb3fcaa2ae34223bde2a637b4dcc221, user_id=1533b195375840d5885ffd5946a40d14, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:07.370553 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c8fff-c433-4b60-8eb8-f6e31af2279a admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:07.384860 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1026/2045] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:56:07 2022] PUT /identity/v3/projects/9eb3fcaa2ae34223bde2a637b4dcc221/users/1533b195375840d5885ffd5946a40d14/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:07.396479 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea395f9-87ef-4c71-ae0d-1dfc456eff99 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:07.396767 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea395f9-87ef-4c71-ae0d-1dfc456eff99 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:07.397038 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea395f9-87ef-4c71-ae0d-1dfc456eff99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:07.411826 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:07.427924 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-bea395f9-87ef-4c71-ae0d-1dfc456eff99 None None] MFA Rules not processed for user `1533b195375840d5885ffd5946a40d14`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:07.429048 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bea395f9-87ef-4c71-ae0d-1dfc456eff99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:07.503191 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1020/2046] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:07.507887 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c8fff-c433-4b60-8eb8-f6e31af2279a admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:07.573876 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c8fff-c433-4b60-8eb8-f6e31af2279a admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:07.578967 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0f75d-1978-4a72-bd9a-b116bb66ad44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:07.579571 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0f75d-1978-4a72-bd9a-b116bb66ad44 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:07.579850 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0f75d-1978-4a72-bd9a-b116bb66ad44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:07.580123 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0f75d-1978-4a72-bd9a-b116bb66ad44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:07.580754 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0f75d-1978-4a72-bd9a-b116bb66ad44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:07.582739 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0f75d-1978-4a72-bd9a-b116bb66ad44 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:07.617353 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1027/2047] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:56:07 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:56:07.622438 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea395f9-87ef-4c71-ae0d-1dfc456eff99 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:07.634882 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea395f9-87ef-4c71-ae0d-1dfc456eff99 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:07.697260 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821fadb-83d2-43b3-aa60-037762842109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:07.697808 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821fadb-83d2-43b3-aa60-037762842109 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:07.698137 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821fadb-83d2-43b3-aa60-037762842109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:07.698410 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821fadb-83d2-43b3-aa60-037762842109 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:07.699041 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821fadb-83d2-43b3-aa60-037762842109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:07.701163 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821fadb-83d2-43b3-aa60-037762842109 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:07.727309 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1021/2048] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:56:07 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:56:07.732347 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0f75d-1978-4a72-bd9a-b116bb66ad44 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:07.744986 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0f75d-1978-4a72-bd9a-b116bb66ad44 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:07.750645 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988875c-083b-4580-bf60-7c27fae69409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:07.751250 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988875c-083b-4580-bf60-7c27fae69409 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:07.751534 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988875c-083b-4580-bf60-7c27fae69409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:07.751806 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988875c-083b-4580-bf60-7c27fae69409 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:07.752453 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988875c-083b-4580-bf60-7c27fae69409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:07.754107 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988875c-083b-4580-bf60-7c27fae69409 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:07.765237 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1028/2049] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:07.769405 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821fadb-83d2-43b3-aa60-037762842109 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:07.780962 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821fadb-83d2-43b3-aa60-037762842109 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:07.785788 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b23b8d-d1be-4708-8467-8916d1a28661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:07.786523 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b23b8d-d1be-4708-8467-8916d1a28661 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:07.786815 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b23b8d-d1be-4708-8467-8916d1a28661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:07.787107 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b23b8d-d1be-4708-8467-8916d1a28661 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:07.787782 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b23b8d-d1be-4708-8467-8916d1a28661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:07.789975 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b23b8d-d1be-4708-8467-8916d1a28661 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:07.801947 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1022/2050] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:07.806587 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988875c-083b-4580-bf60-7c27fae69409 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:07.816837 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988875c-083b-4580-bf60-7c27fae69409 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:07.821858 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720ed41-e748-4726-8c61-19d7ea47200d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:07.822636 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720ed41-e748-4726-8c61-19d7ea47200d admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:07.823372 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720ed41-e748-4726-8c61-19d7ea47200d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:07.823648 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720ed41-e748-4726-8c61-19d7ea47200d admin admin] PATH_INFO: `/v3/projects/85e598f2beab4c83887c8caf7452bed2/users/fe5a1c4d80b64f5899070b125f69b81e/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:07.838578 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720ed41-e748-4726-8c61-19d7ea47200d admin admin] RBAC: Authorizing `identity:create_grant(project_id=85e598f2beab4c83887c8caf7452bed2, user_id=fe5a1c4d80b64f5899070b125f69b81e, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:07.841557 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720ed41-e748-4726-8c61-19d7ea47200d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:07.859288 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1029/2051] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:56:07 2022] PUT /identity/v3/projects/85e598f2beab4c83887c8caf7452bed2/users/fe5a1c4d80b64f5899070b125f69b81e/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:07.870222 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e60a4c-8b8d-42ef-b2a1-8c8e86894b83 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:07.870502 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e60a4c-8b8d-42ef-b2a1-8c8e86894b83 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:07.870901 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e60a4c-8b8d-42ef-b2a1-8c8e86894b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:07.901682 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a2e60a4c-8b8d-42ef-b2a1-8c8e86894b83 None None] MFA Rules not processed for user `fe5a1c4d80b64f5899070b125f69b81e`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:07.902899 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a2e60a4c-8b8d-42ef-b2a1-8c8e86894b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:07.973741 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1023/2052] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:07.979718 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720ed41-e748-4726-8c61-19d7ea47200d admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:08.059093 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720ed41-e748-4726-8c61-19d7ea47200d admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:08.063912 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e333426-1d1c-4275-9e87-f00c5f758626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:08.064523 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e333426-1d1c-4275-9e87-f00c5f758626 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:08.064802 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e333426-1d1c-4275-9e87-f00c5f758626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:08.065075 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e333426-1d1c-4275-9e87-f00c5f758626 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:08.065712 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e333426-1d1c-4275-9e87-f00c5f758626 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:08.067655 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e333426-1d1c-4275-9e87-f00c5f758626 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:08.094834 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:08.103449 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1030/2053] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:56:07 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:56:08.107486 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e60a4c-8b8d-42ef-b2a1-8c8e86894b83 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:08.123569 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:08.131455 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e60a4c-8b8d-42ef-b2a1-8c8e86894b83 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:08.273728 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b106b-2cc8-4e72-ae21-99f493fc65c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:08.275287 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b106b-2cc8-4e72-ae21-99f493fc65c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:08.275717 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b106b-2cc8-4e72-ae21-99f493fc65c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:08.276070 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b106b-2cc8-4e72-ae21-99f493fc65c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:08.277040 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b106b-2cc8-4e72-ae21-99f493fc65c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:08.279968 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b106b-2cc8-4e72-ae21-99f493fc65c6 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:08.309879 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1024/2054] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:56:08 2022] POST /identity/v3/users => generated 294 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:56:08.311273 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e333426-1d1c-4275-9e87-f00c5f758626 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:08.323661 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e333426-1d1c-4275-9e87-f00c5f758626 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:08.328616 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c1ee5-0053-43d9-a666-a619d8a62d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:08.329258 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c1ee5-0053-43d9-a666-a619d8a62d48 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:08.329540 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c1ee5-0053-43d9-a666-a619d8a62d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:08.329873 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c1ee5-0053-43d9-a666-a619d8a62d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:08.330634 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c1ee5-0053-43d9-a666-a619d8a62d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:08.332359 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c1ee5-0053-43d9-a666-a619d8a62d48 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:08.345206 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1031/2055] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:56:08.349330 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b106b-2cc8-4e72-ae21-99f493fc65c6 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:08.362184 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b106b-2cc8-4e72-ae21-99f493fc65c6 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:08.368449 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa82a86-a6e2-4ab4-8562-cc96f3a3442e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:08.369733 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa82a86-a6e2-4ab4-8562-cc96f3a3442e admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:08.369733 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa82a86-a6e2-4ab4-8562-cc96f3a3442e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:08.369733 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa82a86-a6e2-4ab4-8562-cc96f3a3442e admin admin] PATH_INFO: `/v3/projects/cf1e5d0714394d71b89f217b82ba5974/users/cfcb7bf543c84f66a8c690e42f28a8f8/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:08.387473 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa82a86-a6e2-4ab4-8562-cc96f3a3442e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf1e5d0714394d71b89f217b82ba5974, user_id=cfcb7bf543c84f66a8c690e42f28a8f8, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:08.390276 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa82a86-a6e2-4ab4-8562-cc96f3a3442e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:08.409779 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1025/2056] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:56:08 2022] PUT /identity/v3/projects/cf1e5d0714394d71b89f217b82ba5974/users/cfcb7bf543c84f66a8c690e42f28a8f8/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:08.414016 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c1ee5-0053-43d9-a666-a619d8a62d48 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:08.425894 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c1ee5-0053-43d9-a666-a619d8a62d48 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:08.508233 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e94cb-827a-403f-a663-1e74815efeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:08.509453 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e94cb-827a-403f-a663-1e74815efeb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:08.509948 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e94cb-827a-403f-a663-1e74815efeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:08.510250 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e94cb-827a-403f-a663-1e74815efeb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:08.511103 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e94cb-827a-403f-a663-1e74815efeb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:08.513408 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e94cb-827a-403f-a663-1e74815efeb1 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:08.525517 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1032/2057] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:56:08.534602 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa82a86-a6e2-4ab4-8562-cc96f3a3442e admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:08.554111 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa82a86-a6e2-4ab4-8562-cc96f3a3442e admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:08.561446 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0dca2-ccd3-4572-a9f5-24d6734fd3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:08.562717 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0dca2-ccd3-4572-a9f5-24d6734fd3a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:08.562995 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0dca2-ccd3-4572-a9f5-24d6734fd3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:08.563273 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0dca2-ccd3-4572-a9f5-24d6734fd3a0 admin admin] PATH_INFO: `/v3/projects/cf1e5d0714394d71b89f217b82ba5974/users/cfcb7bf543c84f66a8c690e42f28a8f8/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:08.565353 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0dca2-ccd3-4572-a9f5-24d6734fd3a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf1e5d0714394d71b89f217b82ba5974, user_id=cfcb7bf543c84f66a8c690e42f28a8f8, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:08.568113 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0dca2-ccd3-4572-a9f5-24d6734fd3a0 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:08.583708 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1026/2058] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:56:08 2022] PUT /identity/v3/projects/cf1e5d0714394d71b89f217b82ba5974/users/cfcb7bf543c84f66a8c690e42f28a8f8/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:08.594211 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d155a0-1774-40c2-8859-148df36b08e8 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:08.594499 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d155a0-1774-40c2-8859-148df36b08e8 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:08.594766 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d155a0-1774-40c2-8859-148df36b08e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:08.636090 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-30d155a0-1774-40c2-8859-148df36b08e8 None None] MFA Rules not processed for user `cfcb7bf543c84f66a8c690e42f28a8f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:08.637593 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-30d155a0-1774-40c2-8859-148df36b08e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:08.743633 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1033/2059] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:08.759361 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0dca2-ccd3-4572-a9f5-24d6734fd3a0 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:08.761110 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5ee0dca2-ccd3-4572-a9f5-24d6734fd3a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:08.851175 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0dca2-ccd3-4572-a9f5-24d6734fd3a0 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:08.855113 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6147970-89d3-4076-9f52-f11a988b3ad6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:08.855771 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6147970-89d3-4076-9f52-f11a988b3ad6 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:08.856048 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6147970-89d3-4076-9f52-f11a988b3ad6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:08.856318 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6147970-89d3-4076-9f52-f11a988b3ad6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:08.913482 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6147970-89d3-4076-9f52-f11a988b3ad6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:08.914971 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6147970-89d3-4076-9f52-f11a988b3ad6 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:08.925495 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1027/2060] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:10.544222 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d155a0-1774-40c2-8859-148df36b08e8 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:10.545981 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-30d155a0-1774-40c2-8859-148df36b08e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:10.558705 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d155a0-1774-40c2-8859-148df36b08e8 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:10.562852 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbae12-18db-4e06-baeb-c5fcb04e2543 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:10.563528 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbae12-18db-4e06-baeb-c5fcb04e2543 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:10.563873 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbae12-18db-4e06-baeb-c5fcb04e2543 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:10.564214 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbae12-18db-4e06-baeb-c5fcb04e2543 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:10.625737 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cbae12-18db-4e06-baeb-c5fcb04e2543 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:10.627221 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cbae12-18db-4e06-baeb-c5fcb04e2543 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:10.636611 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1034/2061] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:11.402012 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6147970-89d3-4076-9f52-f11a988b3ad6 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:11.410914 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6147970-89d3-4076-9f52-f11a988b3ad6 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:11.415427 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a40b95-395b-4f1b-aea2-36c99773b08b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:11.416029 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a40b95-395b-4f1b-aea2-36c99773b08b service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:11.416461 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a40b95-395b-4f1b-aea2-36c99773b08b service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:11.416754 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a40b95-395b-4f1b-aea2-36c99773b08b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:11.426657 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a40b95-395b-4f1b-aea2-36c99773b08b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:11.428101 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a40b95-395b-4f1b-aea2-36c99773b08b service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:11.433128 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:11.441417 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1028/2062] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:15.407787 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbae12-18db-4e06-baeb-c5fcb04e2543 service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:15.419540 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:15.476738 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbae12-18db-4e06-baeb-c5fcb04e2543 service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:15.482296 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9633aea-f482-4b18-bc30-6b5e098f1e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:15.482949 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9633aea-f482-4b18-bc30-6b5e098f1e27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:15.483228 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9633aea-f482-4b18-bc30-6b5e098f1e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:15.483499 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9633aea-f482-4b18-bc30-6b5e098f1e27 admin admin] PATH_INFO: `/v3/users/1533b195375840d5885ffd5946a40d14` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:15.484728 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9633aea-f482-4b18-bc30-6b5e098f1e27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1533b195375840d5885ffd5946a40d14)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:15.488118 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9633aea-f482-4b18-bc30-6b5e098f1e27 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:15.548425 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f9633aea-f482-4b18-bc30-6b5e098f1e27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1533b195375840d5885ffd5946a40d14'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:15.555265 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f9633aea-f482-4b18-bc30-6b5e098f1e27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1533b195375840d5885ffd5946a40d14'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:15.566599 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f9633aea-f482-4b18-bc30-6b5e098f1e27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1533b195375840d5885ffd5946a40d14'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:15.585946 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f9633aea-f482-4b18-bc30-6b5e098f1e27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1533b195375840d5885ffd5946a40d14'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:15.586685 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f9633aea-f482-4b18-bc30-6b5e098f1e27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1533b195375840d5885ffd5946a40d14'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:15.593265 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1035/2063] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:56:15 2022] DELETE /identity/v3/users/1533b195375840d5885ffd5946a40d14 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:15.598234 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8607c74-f16c-4179-8665-3ed96ceb2b38 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:15.598738 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8607c74-f16c-4179-8665-3ed96ceb2b38 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:15.598847 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8607c74-f16c-4179-8665-3ed96ceb2b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:15.618386 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b8607c74-f16c-4179-8665-3ed96ceb2b38 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:15.619607 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b8607c74-f16c-4179-8665-3ed96ceb2b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:15.689802 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1029/2064] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:15.702686 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9633aea-f482-4b18-bc30-6b5e098f1e27 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:15.704559 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f9633aea-f482-4b18-bc30-6b5e098f1e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:15.771701 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9633aea-f482-4b18-bc30-6b5e098f1e27 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:15.775288 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21893a8-e2b0-4a8c-8dfb-2967162b465c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:15.775927 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21893a8-e2b0-4a8c-8dfb-2967162b465c service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:15.776203 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21893a8-e2b0-4a8c-8dfb-2967162b465c service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:15.776471 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21893a8-e2b0-4a8c-8dfb-2967162b465c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:15.786397 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21893a8-e2b0-4a8c-8dfb-2967162b465c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:15.788000 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21893a8-e2b0-4a8c-8dfb-2967162b465c service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:15.798889 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1036/2065] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:16.187997 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8607c74-f16c-4179-8665-3ed96ceb2b38 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:16.189771 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b8607c74-f16c-4179-8665-3ed96ceb2b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:16.211218 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8607c74-f16c-4179-8665-3ed96ceb2b38 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:16.227022 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd637ba-8e60-4d5c-b1d8-fabce5953bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:16.234699 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd637ba-8e60-4d5c-b1d8-fabce5953bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:16.236412 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd637ba-8e60-4d5c-b1d8-fabce5953bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:16.236776 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd637ba-8e60-4d5c-b1d8-fabce5953bd3 admin admin] PATH_INFO: `/v3/projects/9eb3fcaa2ae34223bde2a637b4dcc221` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:16.238413 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd637ba-8e60-4d5c-b1d8-fabce5953bd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eb3fcaa2ae34223bde2a637b4dcc221)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:16.240392 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd637ba-8e60-4d5c-b1d8-fabce5953bd3 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:16.290775 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8dd637ba-8e60-4d5c-b1d8-fabce5953bd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eb3fcaa2ae34223bde2a637b4dcc221', 'request_id': 'req-8dd637ba-8e60-4d5c-b1d8-fabce5953bd3'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:16.296531 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8dd637ba-8e60-4d5c-b1d8-fabce5953bd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eb3fcaa2ae34223bde2a637b4dcc221', 'request_id': 'req-8dd637ba-8e60-4d5c-b1d8-fabce5953bd3'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:16.302707 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8dd637ba-8e60-4d5c-b1d8-fabce5953bd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eb3fcaa2ae34223bde2a637b4dcc221', 'request_id': 'req-8dd637ba-8e60-4d5c-b1d8-fabce5953bd3'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:16.316641 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8dd637ba-8e60-4d5c-b1d8-fabce5953bd3 admin admin] The token cache is being invalidate because project 9eb3fcaa2ae34223bde2a637b4dcc221 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:56:16.316926 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8dd637ba-8e60-4d5c-b1d8-fabce5953bd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:16.317748 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8dd637ba-8e60-4d5c-b1d8-fabce5953bd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:16.319269 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1030/2066] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:56:16 2022] DELETE /identity/v3/projects/9eb3fcaa2ae34223bde2a637b4dcc221 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:16.323344 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21893a8-e2b0-4a8c-8dfb-2967162b465c service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:16.334358 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21893a8-e2b0-4a8c-8dfb-2967162b465c service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:16.363650 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:16.395392 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392c860-9a11-46a7-a608-f31c86bc2c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:16.396008 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392c860-9a11-46a7-a608-f31c86bc2c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:16.396286 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392c860-9a11-46a7-a608-f31c86bc2c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:16.396558 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392c860-9a11-46a7-a608-f31c86bc2c8e admin admin] PATH_INFO: `/v3/users/fe5a1c4d80b64f5899070b125f69b81e` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:16.397780 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a392c860-9a11-46a7-a608-f31c86bc2c8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe5a1c4d80b64f5899070b125f69b81e)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:16.399829 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a392c860-9a11-46a7-a608-f31c86bc2c8e admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:16.450427 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-a392c860-9a11-46a7-a608-f31c86bc2c8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe5a1c4d80b64f5899070b125f69b81e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:16.457297 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-a392c860-9a11-46a7-a608-f31c86bc2c8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe5a1c4d80b64f5899070b125f69b81e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:16.466247 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-a392c860-9a11-46a7-a608-f31c86bc2c8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe5a1c4d80b64f5899070b125f69b81e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:16.479173 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-a392c860-9a11-46a7-a608-f31c86bc2c8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe5a1c4d80b64f5899070b125f69b81e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:16.479834 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-a392c860-9a11-46a7-a608-f31c86bc2c8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe5a1c4d80b64f5899070b125f69b81e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:16.486364 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1037/2067] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:56:16 2022] DELETE /identity/v3/users/fe5a1c4d80b64f5899070b125f69b81e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:16.780309 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd637ba-8e60-4d5c-b1d8-fabce5953bd3 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:16.782161 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8dd637ba-8e60-4d5c-b1d8-fabce5953bd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:16.811612 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd637ba-8e60-4d5c-b1d8-fabce5953bd3 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:16.870644 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e55fb-70a9-46f5-8166-5dd03c820f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:16.871274 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e55fb-70a9-46f5-8166-5dd03c820f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:16.871561 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e55fb-70a9-46f5-8166-5dd03c820f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:16.871943 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e55fb-70a9-46f5-8166-5dd03c820f68 admin admin] PATH_INFO: `/v3/projects/85e598f2beab4c83887c8caf7452bed2` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:16.873008 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e55fb-70a9-46f5-8166-5dd03c820f68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85e598f2beab4c83887c8caf7452bed2)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:16.875072 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e55fb-70a9-46f5-8166-5dd03c820f68 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:16.903847 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:16.930298 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-fe9e55fb-70a9-46f5-8166-5dd03c820f68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85e598f2beab4c83887c8caf7452bed2', 'request_id': 'req-fe9e55fb-70a9-46f5-8166-5dd03c820f68'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:16.935852 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-fe9e55fb-70a9-46f5-8166-5dd03c820f68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85e598f2beab4c83887c8caf7452bed2', 'request_id': 'req-fe9e55fb-70a9-46f5-8166-5dd03c820f68'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:16.942610 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-fe9e55fb-70a9-46f5-8166-5dd03c820f68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85e598f2beab4c83887c8caf7452bed2', 'request_id': 'req-fe9e55fb-70a9-46f5-8166-5dd03c820f68'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:16.956644 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-fe9e55fb-70a9-46f5-8166-5dd03c820f68 admin admin] The token cache is being invalidate because project 85e598f2beab4c83887c8caf7452bed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:56:16.957078 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-fe9e55fb-70a9-46f5-8166-5dd03c820f68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:16.957827 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-fe9e55fb-70a9-46f5-8166-5dd03c820f68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:16.959491 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1031/2068] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:56:16 2022] DELETE /identity/v3/projects/85e598f2beab4c83887c8caf7452bed2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:16.963874 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392c860-9a11-46a7-a608-f31c86bc2c8e admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:16.965505 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a392c860-9a11-46a7-a608-f31c86bc2c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:16.979313 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392c860-9a11-46a7-a608-f31c86bc2c8e admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:17.043121 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabfe5a-f953-4bdc-bd96-4cd1b82ea0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:17.043856 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabfe5a-f953-4bdc-bd96-4cd1b82ea0f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:17.044135 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabfe5a-f953-4bdc-bd96-4cd1b82ea0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:17.044402 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabfe5a-f953-4bdc-bd96-4cd1b82ea0f3 admin admin] PATH_INFO: `/v3/users/cfcb7bf543c84f66a8c690e42f28a8f8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:17.045573 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dabfe5a-f953-4bdc-bd96-4cd1b82ea0f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfcb7bf543c84f66a8c690e42f28a8f8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:17.047722 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dabfe5a-f953-4bdc-bd96-4cd1b82ea0f3 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:17.099770 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8dabfe5a-f953-4bdc-bd96-4cd1b82ea0f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfcb7bf543c84f66a8c690e42f28a8f8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:17.104570 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:17.107995 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8dabfe5a-f953-4bdc-bd96-4cd1b82ea0f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfcb7bf543c84f66a8c690e42f28a8f8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:17.116703 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8dabfe5a-f953-4bdc-bd96-4cd1b82ea0f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfcb7bf543c84f66a8c690e42f28a8f8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:17.130144 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8dabfe5a-f953-4bdc-bd96-4cd1b82ea0f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfcb7bf543c84f66a8c690e42f28a8f8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:17.130872 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8dabfe5a-f953-4bdc-bd96-4cd1b82ea0f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfcb7bf543c84f66a8c690e42f28a8f8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:17.137424 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1038/2069] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:56:16 2022] DELETE /identity/v3/users/cfcb7bf543c84f66a8c690e42f28a8f8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:17.285791 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e55fb-70a9-46f5-8166-5dd03c820f68 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:17.287584 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-fe9e55fb-70a9-46f5-8166-5dd03c820f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:17.306375 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e55fb-70a9-46f5-8166-5dd03c820f68 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:17.384403 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ca9b7-f6b7-4559-b13f-42698d05704e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:17.385260 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ca9b7-f6b7-4559-b13f-42698d05704e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:17.385569 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ca9b7-f6b7-4559-b13f-42698d05704e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:17.386174 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ca9b7-f6b7-4559-b13f-42698d05704e admin admin] PATH_INFO: `/v3/users/dc2b620887a6400eb2be5f9db2ad0127` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:17.388617 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ca9b7-f6b7-4559-b13f-42698d05704e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc2b620887a6400eb2be5f9db2ad0127)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:17.390470 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ca9b7-f6b7-4559-b13f-42698d05704e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:17.449483 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-bc2ca9b7-f6b7-4559-b13f-42698d05704e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc2b620887a6400eb2be5f9db2ad0127'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:17.469127 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-bc2ca9b7-f6b7-4559-b13f-42698d05704e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc2b620887a6400eb2be5f9db2ad0127'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:17.478858 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabfe5a-f953-4bdc-bd96-4cd1b82ea0f3 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:17.480438 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8dabfe5a-f953-4bdc-bd96-4cd1b82ea0f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:17.489603 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-bc2ca9b7-f6b7-4559-b13f-42698d05704e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc2b620887a6400eb2be5f9db2ad0127'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:17.494608 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabfe5a-f953-4bdc-bd96-4cd1b82ea0f3 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:17.499617 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f50f94-b402-4d19-b9c9-f2e7e9ed9deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:17.500470 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f50f94-b402-4d19-b9c9-f2e7e9ed9deb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:17.500835 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f50f94-b402-4d19-b9c9-f2e7e9ed9deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:17.501157 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f50f94-b402-4d19-b9c9-f2e7e9ed9deb admin admin] PATH_INFO: `/v3/projects/cf1e5d0714394d71b89f217b82ba5974` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:17.502571 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f50f94-b402-4d19-b9c9-f2e7e9ed9deb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf1e5d0714394d71b89f217b82ba5974)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:17.504790 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f50f94-b402-4d19-b9c9-f2e7e9ed9deb admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:17.507595 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-bc2ca9b7-f6b7-4559-b13f-42698d05704e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc2b620887a6400eb2be5f9db2ad0127'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:17.508966 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-bc2ca9b7-f6b7-4559-b13f-42698d05704e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc2b620887a6400eb2be5f9db2ad0127'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:17.520217 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1032/2070] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:56:17 2022] DELETE /identity/v3/users/dc2b620887a6400eb2be5f9db2ad0127 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:56:17.526284 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccca07e-146a-4d56-8eda-2368296aa426 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:17.526633 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccca07e-146a-4d56-8eda-2368296aa426 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:17.526964 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccca07e-146a-4d56-8eda-2368296aa426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:17.555809 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-1ccca07e-146a-4d56-8eda-2368296aa426 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:17.557023 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1ccca07e-146a-4d56-8eda-2368296aa426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:17.559136 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-74f50f94-b402-4d19-b9c9-f2e7e9ed9deb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf1e5d0714394d71b89f217b82ba5974', 'request_id': 'req-74f50f94-b402-4d19-b9c9-f2e7e9ed9deb'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:17.567391 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-74f50f94-b402-4d19-b9c9-f2e7e9ed9deb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf1e5d0714394d71b89f217b82ba5974', 'request_id': 'req-74f50f94-b402-4d19-b9c9-f2e7e9ed9deb'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:17.574866 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-74f50f94-b402-4d19-b9c9-f2e7e9ed9deb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf1e5d0714394d71b89f217b82ba5974', 'request_id': 'req-74f50f94-b402-4d19-b9c9-f2e7e9ed9deb'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:17.583748 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:17.586206 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-74f50f94-b402-4d19-b9c9-f2e7e9ed9deb admin admin] The token cache is being invalidate because project cf1e5d0714394d71b89f217b82ba5974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:56:17.586490 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-74f50f94-b402-4d19-b9c9-f2e7e9ed9deb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:17.587135 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-74f50f94-b402-4d19-b9c9-f2e7e9ed9deb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:17.588620 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1039/2071] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:56:17 2022] DELETE /identity/v3/projects/cf1e5d0714394d71b89f217b82ba5974 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:56:17.593787 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ebff0-a080-44cb-af79-674bccb9ec8b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:17.594238 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ebff0-a080-44cb-af79-674bccb9ec8b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:17.594495 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ebff0-a080-44cb-af79-674bccb9ec8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:17.616363 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-b22ebff0-a080-44cb-af79-674bccb9ec8b None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:17.617628 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b22ebff0-a080-44cb-af79-674bccb9ec8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:17.620220 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1033/2072] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:56:17.627463 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1040/2073] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:56:17.630820 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccca07e-146a-4d56-8eda-2368296aa426 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:17.632434 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1ccca07e-146a-4d56-8eda-2368296aa426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:17.635143 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e60626-2bba-4cf4-930c-23ddf2086386 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:17.635432 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e60626-2bba-4cf4-930c-23ddf2086386 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:17.635703 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e60626-2bba-4cf4-930c-23ddf2086386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:17.657113 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-88e60626-2bba-4cf4-930c-23ddf2086386 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:17.658768 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-88e60626-2bba-4cf4-930c-23ddf2086386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:17.667532 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1041/2074] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:56:17.671948 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e60626-2bba-4cf4-930c-23ddf2086386 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:17.680930 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e60626-2bba-4cf4-930c-23ddf2086386 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:17.687392 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d6c25-7067-446c-8e9c-1bee1d2cf755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:17.688006 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d6c25-7067-446c-8e9c-1bee1d2cf755 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:17.688403 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d6c25-7067-446c-8e9c-1bee1d2cf755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:17.688675 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d6c25-7067-446c-8e9c-1bee1d2cf755 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:17.689322 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d6c25-7067-446c-8e9c-1bee1d2cf755 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:56:17.689625 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d6c25-7067-446c-8e9c-1bee1d2cf755 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:17.691279 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d6c25-7067-446c-8e9c-1bee1d2cf755 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:17.696136 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccca07e-146a-4d56-8eda-2368296aa426 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:17.699931 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8251e-5b2d-478a-91b0-ef4a5255d734 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:17.700712 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8251e-5b2d-478a-91b0-ef4a5255d734 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:17.701008 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8251e-5b2d-478a-91b0-ef4a5255d734 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:17.701270 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8251e-5b2d-478a-91b0-ef4a5255d734 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:17.705866 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1042/2075] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:56:17.708776 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d6c25-7067-446c-8e9c-1bee1d2cf755 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:17.712353 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8251e-5b2d-478a-91b0-ef4a5255d734 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:17.714123 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8251e-5b2d-478a-91b0-ef4a5255d734 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:17.718889 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d6c25-7067-446c-8e9c-1bee1d2cf755 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:17.723924 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95a12f-bfdc-4fe6-9620-c4e28243b7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:17.724614 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95a12f-bfdc-4fe6-9620-c4e28243b7e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:17.725065 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95a12f-bfdc-4fe6-9620-c4e28243b7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:17.725310 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1034/2076] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:17.725433 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95a12f-bfdc-4fe6-9620-c4e28243b7e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:17.726509 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95a12f-bfdc-4fe6-9620-c4e28243b7e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:17.728623 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95a12f-bfdc-4fe6-9620-c4e28243b7e1 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:17.759531 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1043/2077] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:56:17 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:56:17.763829 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8251e-5b2d-478a-91b0-ef4a5255d734 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:17.774487 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8251e-5b2d-478a-91b0-ef4a5255d734 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:17.842366 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e184ece-5511-4277-aba0-b7501fe45c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:17.842997 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e184ece-5511-4277-aba0-b7501fe45c8d admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:17.843275 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e184ece-5511-4277-aba0-b7501fe45c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:17.843545 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e184ece-5511-4277-aba0-b7501fe45c8d admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:17.844368 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e184ece-5511-4277-aba0-b7501fe45c8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:17.846856 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e184ece-5511-4277-aba0-b7501fe45c8d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:17.880312 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1035/2078] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:56:17 2022] POST /identity/v3/users => generated 284 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:56:17.884504 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95a12f-bfdc-4fe6-9620-c4e28243b7e1 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:17.895407 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95a12f-bfdc-4fe6-9620-c4e28243b7e1 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:17.900580 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7449b7b-000e-4cb6-8a73-cc2a60e8abbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:17.901223 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7449b7b-000e-4cb6-8a73-cc2a60e8abbd admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:17.901502 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7449b7b-000e-4cb6-8a73-cc2a60e8abbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:17.901826 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7449b7b-000e-4cb6-8a73-cc2a60e8abbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:17.902601 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7449b7b-000e-4cb6-8a73-cc2a60e8abbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:17.904379 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7449b7b-000e-4cb6-8a73-cc2a60e8abbd admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:17.915088 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1044/2079] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:17.919743 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e184ece-5511-4277-aba0-b7501fe45c8d admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:17.931930 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e184ece-5511-4277-aba0-b7501fe45c8d admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:17.937270 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2ccf1-aab7-4bfc-8883-fb0e69ef75e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:17.937907 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2ccf1-aab7-4bfc-8883-fb0e69ef75e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:17.938195 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2ccf1-aab7-4bfc-8883-fb0e69ef75e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:17.938469 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2ccf1-aab7-4bfc-8883-fb0e69ef75e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:17.939116 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2ccf1-aab7-4bfc-8883-fb0e69ef75e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:17.940737 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2ccf1-aab7-4bfc-8883-fb0e69ef75e2 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:17.951043 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1036/2080] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:17.955169 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7449b7b-000e-4cb6-8a73-cc2a60e8abbd admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:17.965400 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7449b7b-000e-4cb6-8a73-cc2a60e8abbd admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:17.970270 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71dfaf3-4fbd-40d2-b573-2bdec66dd437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:17.970926 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71dfaf3-4fbd-40d2-b573-2bdec66dd437 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:17.971206 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71dfaf3-4fbd-40d2-b573-2bdec66dd437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:17.971482 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71dfaf3-4fbd-40d2-b573-2bdec66dd437 admin admin] PATH_INFO: `/v3/projects/714d148ee7cb45c08860efac3ff8f1a0/users/4f9dac1b60a04e7d968fee9f935f605f/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:17.986642 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71dfaf3-4fbd-40d2-b573-2bdec66dd437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=714d148ee7cb45c08860efac3ff8f1a0, user_id=4f9dac1b60a04e7d968fee9f935f605f, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:17.989301 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71dfaf3-4fbd-40d2-b573-2bdec66dd437 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:18.010790 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1045/2081] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:56:17 2022] PUT /identity/v3/projects/714d148ee7cb45c08860efac3ff8f1a0/users/4f9dac1b60a04e7d968fee9f935f605f/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:18.021487 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f14f0c-1957-467b-86f7-ec048566c765 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:18.021853 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f14f0c-1957-467b-86f7-ec048566c765 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:18.022203 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f14f0c-1957-467b-86f7-ec048566c765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:18.028539 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71dfaf3-4fbd-40d2-b573-2bdec66dd437 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:18.030871 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d71dfaf3-4fbd-40d2-b573-2bdec66dd437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:18.054320 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-97f14f0c-1957-467b-86f7-ec048566c765 None None] MFA Rules not processed for user `4f9dac1b60a04e7d968fee9f935f605f`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:18.055714 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-97f14f0c-1957-467b-86f7-ec048566c765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:18.065285 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:18.103359 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:18.105023 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71dfaf3-4fbd-40d2-b573-2bdec66dd437 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:18.111231 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c19b9-62fa-410f-a247-8809ae80b834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:18.111955 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c19b9-62fa-410f-a247-8809ae80b834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:18.112246 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c19b9-62fa-410f-a247-8809ae80b834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:18.112519 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c19b9-62fa-410f-a247-8809ae80b834 admin admin] PATH_INFO: `/v3/projects/83f4f2a1a9fb438090ab536e56e4bb80` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:18.113660 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c19b9-62fa-410f-a247-8809ae80b834 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83f4f2a1a9fb438090ab536e56e4bb80)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:18.115654 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c19b9-62fa-410f-a247-8809ae80b834 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:18.131981 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1037/2082] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:56:18.145393 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f14f0c-1957-467b-86f7-ec048566c765 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:18.147370 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-97f14f0c-1957-467b-86f7-ec048566c765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:18.178434 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-1c4c19b9-62fa-410f-a247-8809ae80b834 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83f4f2a1a9fb438090ab536e56e4bb80', 'request_id': 'req-1c4c19b9-62fa-410f-a247-8809ae80b834'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:18.191443 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-1c4c19b9-62fa-410f-a247-8809ae80b834 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83f4f2a1a9fb438090ab536e56e4bb80', 'request_id': 'req-1c4c19b9-62fa-410f-a247-8809ae80b834'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:18.199969 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-1c4c19b9-62fa-410f-a247-8809ae80b834 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83f4f2a1a9fb438090ab536e56e4bb80', 'request_id': 'req-1c4c19b9-62fa-410f-a247-8809ae80b834'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:18.214461 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-1c4c19b9-62fa-410f-a247-8809ae80b834 admin admin] The token cache is being invalidate because project 83f4f2a1a9fb438090ab536e56e4bb80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:56:18.215033 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-1c4c19b9-62fa-410f-a247-8809ae80b834 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:18.215842 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-1c4c19b9-62fa-410f-a247-8809ae80b834 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:18.217855 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1046/2083] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:56:18 2022] DELETE /identity/v3/projects/83f4f2a1a9fb438090ab536e56e4bb80 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:18.222048 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c19b9-62fa-410f-a247-8809ae80b834 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:18.223615 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1c4c19b9-62fa-410f-a247-8809ae80b834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:18.233540 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f14f0c-1957-467b-86f7-ec048566c765 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:18.288315 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d732956-404b-476d-920f-f11ab60ead8b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34fd9f7932e14a409d7668d40ff6680e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:18.288951 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d732956-404b-476d-920f-f11ab60ead8b service glance] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:18.289350 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d732956-404b-476d-920f-f11ab60ead8b service glance] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:18.289772 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d732956-404b-476d-920f-f11ab60ead8b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:18.293881 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7d732956-404b-476d-920f-f11ab60ead8b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:18.296175 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c19b9-62fa-410f-a247-8809ae80b834 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:18.300232 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88853df-4e8f-4750-b7fc-bb9b9a2314b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:18.300887 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88853df-4e8f-4750-b7fc-bb9b9a2314b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:18.301161 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88853df-4e8f-4750-b7fc-bb9b9a2314b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:18.301432 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88853df-4e8f-4750-b7fc-bb9b9a2314b1 admin admin] PATH_INFO: `/v3/users/d029234b2e7846f78579975415b6bd52` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:18.302798 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88853df-4e8f-4750-b7fc-bb9b9a2314b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d029234b2e7846f78579975415b6bd52)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:18.305237 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88853df-4e8f-4750-b7fc-bb9b9a2314b1 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:18.360170 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-b88853df-4e8f-4750-b7fc-bb9b9a2314b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd029234b2e7846f78579975415b6bd52'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:18.367291 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-b88853df-4e8f-4750-b7fc-bb9b9a2314b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd029234b2e7846f78579975415b6bd52'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:18.370270 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d732956-404b-476d-920f-f11ab60ead8b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:18.370937 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:18.371940 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d732956-404b-476d-920f-f11ab60ead8b service glance] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:18.376084 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-b88853df-4e8f-4750-b7fc-bb9b9a2314b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd029234b2e7846f78579975415b6bd52'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:18.382223 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1038/2084] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:56:18.390180 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-b88853df-4e8f-4750-b7fc-bb9b9a2314b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd029234b2e7846f78579975415b6bd52'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:18.390918 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-b88853df-4e8f-4750-b7fc-bb9b9a2314b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd029234b2e7846f78579975415b6bd52'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:18.396931 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1047/2085] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:56:18 2022] DELETE /identity/v3/users/d029234b2e7846f78579975415b6bd52 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:56:18.711933 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d732956-404b-476d-920f-f11ab60ead8b service glance] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:18.728768 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d732956-404b-476d-920f-f11ab60ead8b service glance] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:18.811128 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:18.823794 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def97000-66b8-467b-bc74-56f2061eedd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:18.824376 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def97000-66b8-467b-bc74-56f2061eedd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:18.824579 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def97000-66b8-467b-bc74-56f2061eedd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:18.824941 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def97000-66b8-467b-bc74-56f2061eedd3 admin admin] PATH_INFO: `/v3/projects/5e512c0bf08242d8bdf6143eb03c7b3e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:18.827110 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def97000-66b8-467b-bc74-56f2061eedd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e512c0bf08242d8bdf6143eb03c7b3e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:18.829935 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def97000-66b8-467b-bc74-56f2061eedd3 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:18.910257 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-def97000-66b8-467b-bc74-56f2061eedd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e512c0bf08242d8bdf6143eb03c7b3e', 'request_id': 'req-def97000-66b8-467b-bc74-56f2061eedd3'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:18.918332 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-def97000-66b8-467b-bc74-56f2061eedd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e512c0bf08242d8bdf6143eb03c7b3e', 'request_id': 'req-def97000-66b8-467b-bc74-56f2061eedd3'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:18.927065 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-def97000-66b8-467b-bc74-56f2061eedd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e512c0bf08242d8bdf6143eb03c7b3e', 'request_id': 'req-def97000-66b8-467b-bc74-56f2061eedd3'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:18.942032 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-def97000-66b8-467b-bc74-56f2061eedd3 admin admin] The token cache is being invalidate because project 5e512c0bf08242d8bdf6143eb03c7b3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:56:18.942331 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-def97000-66b8-467b-bc74-56f2061eedd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:18.943036 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-def97000-66b8-467b-bc74-56f2061eedd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:18.944878 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1039/2086] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:56:18 2022] DELETE /identity/v3/projects/5e512c0bf08242d8bdf6143eb03c7b3e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:18.949605 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db975064-ac87-43bf-9738-6f242ca5b86e None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:18.950183 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db975064-ac87-43bf-9738-6f242ca5b86e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:18.950388 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db975064-ac87-43bf-9738-6f242ca5b86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:18.988474 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-db975064-ac87-43bf-9738-6f242ca5b86e None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:18.989703 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-db975064-ac87-43bf-9738-6f242ca5b86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:19.050328 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1048/2087] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:19.058415 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f09f2-0fbc-4e47-a7c4-71996a976edc None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:19.058726 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f09f2-0fbc-4e47-a7c4-71996a976edc None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:19.059007 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f09f2-0fbc-4e47-a7c4-71996a976edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:19.079465 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-303f09f2-0fbc-4e47-a7c4-71996a976edc None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:19.080692 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-303f09f2-0fbc-4e47-a7c4-71996a976edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:19.088811 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1040/2088] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:19.093385 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db975064-ac87-43bf-9738-6f242ca5b86e None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:19.104690 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db975064-ac87-43bf-9738-6f242ca5b86e None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:19.111766 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6fc75-f412-4b2b-a067-2dae7a4e8b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:19.112505 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6fc75-f412-4b2b-a067-2dae7a4e8b22 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:19.112874 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6fc75-f412-4b2b-a067-2dae7a4e8b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:19.113238 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6fc75-f412-4b2b-a067-2dae7a4e8b22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:19.114099 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6fc75-f412-4b2b-a067-2dae7a4e8b22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:56:19.114406 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6fc75-f412-4b2b-a067-2dae7a4e8b22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:19.116338 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6fc75-f412-4b2b-a067-2dae7a4e8b22 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:19.130169 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1049/2089] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:56:19.134850 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f09f2-0fbc-4e47-a7c4-71996a976edc None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:19.144501 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f09f2-0fbc-4e47-a7c4-71996a976edc None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:19.149667 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151d584-46db-486e-9402-a155c60b017e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:19.150403 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151d584-46db-486e-9402-a155c60b017e admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:19.150679 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151d584-46db-486e-9402-a155c60b017e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:19.150977 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151d584-46db-486e-9402-a155c60b017e admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:19.151612 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151d584-46db-486e-9402-a155c60b017e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:19.153565 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151d584-46db-486e-9402-a155c60b017e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:19.185431 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1041/2090] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:56:19 2022] POST /identity/v3/projects => generated 399 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:56:19.191279 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6fc75-f412-4b2b-a067-2dae7a4e8b22 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:19.205672 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6fc75-f412-4b2b-a067-2dae7a4e8b22 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:19.270391 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac3eb5-4c47-4535-8bbe-a1c1e7a92596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:19.271257 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac3eb5-4c47-4535-8bbe-a1c1e7a92596 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:19.271568 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac3eb5-4c47-4535-8bbe-a1c1e7a92596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:19.271864 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac3eb5-4c47-4535-8bbe-a1c1e7a92596 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:19.272743 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac3eb5-4c47-4535-8bbe-a1c1e7a92596 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:19.275542 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac3eb5-4c47-4535-8bbe-a1c1e7a92596 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:19.304402 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1050/2091] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:56:19 2022] POST /identity/v3/users => generated 300 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:56:19.308578 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151d584-46db-486e-9402-a155c60b017e admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:19.320039 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151d584-46db-486e-9402-a155c60b017e admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:19.325386 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5b730-0ad9-4f4c-ab19-02f90ddf45d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:19.326072 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5b730-0ad9-4f4c-ab19-02f90ddf45d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:19.326375 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5b730-0ad9-4f4c-ab19-02f90ddf45d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:19.326686 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5b730-0ad9-4f4c-ab19-02f90ddf45d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:19.327311 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5b730-0ad9-4f4c-ab19-02f90ddf45d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:19.329052 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5b730-0ad9-4f4c-ab19-02f90ddf45d7 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:19.339397 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1042/2092] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:19.343727 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac3eb5-4c47-4535-8bbe-a1c1e7a92596 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:19.360241 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac3eb5-4c47-4535-8bbe-a1c1e7a92596 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:19.366091 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12cfd1a-f26c-4ee6-9ae0-69faa6cd835c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:19.366730 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cfd1a-f26c-4ee6-9ae0-69faa6cd835c admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:19.367007 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cfd1a-f26c-4ee6-9ae0-69faa6cd835c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:19.367286 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cfd1a-f26c-4ee6-9ae0-69faa6cd835c admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:19.367927 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12cfd1a-f26c-4ee6-9ae0-69faa6cd835c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:19.369554 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12cfd1a-f26c-4ee6-9ae0-69faa6cd835c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:19.383634 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1051/2093] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:56:19.388040 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5b730-0ad9-4f4c-ab19-02f90ddf45d7 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:19.398322 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5b730-0ad9-4f4c-ab19-02f90ddf45d7 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:19.403358 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c16b20-288e-4821-8f54-2eff21010ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:19.404074 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c16b20-288e-4821-8f54-2eff21010ca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:19.404436 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c16b20-288e-4821-8f54-2eff21010ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:19.404804 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c16b20-288e-4821-8f54-2eff21010ca9 admin admin] PATH_INFO: `/v3/projects/fd9af3de437e45f7ab950e3bb02d5d88/users/9b4b38cf7a9048c9871105090e246487/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:19.420280 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c16b20-288e-4821-8f54-2eff21010ca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd9af3de437e45f7ab950e3bb02d5d88, user_id=9b4b38cf7a9048c9871105090e246487, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:19.423144 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c16b20-288e-4821-8f54-2eff21010ca9 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:19.437222 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1043/2094] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:56:19 2022] PUT /identity/v3/projects/fd9af3de437e45f7ab950e3bb02d5d88/users/9b4b38cf7a9048c9871105090e246487/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:19.447492 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3328080-52c5-447c-915b-3c5164eef34d None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:19.447786 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3328080-52c5-447c-915b-3c5164eef34d None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:19.448058 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3328080-52c5-447c-915b-3c5164eef34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:19.478606 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-f3328080-52c5-447c-915b-3c5164eef34d None None] MFA Rules not processed for user `9b4b38cf7a9048c9871105090e246487`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:19.479822 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f3328080-52c5-447c-915b-3c5164eef34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:19.517583 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:19.559132 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1052/2095] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:19 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:19.563945 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c16b20-288e-4821-8f54-2eff21010ca9 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:19.636374 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c16b20-288e-4821-8f54-2eff21010ca9 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:19.641943 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d93412-8c55-471d-87bd-710b197828b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:19.642559 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d93412-8c55-471d-87bd-710b197828b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:19.642900 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d93412-8c55-471d-87bd-710b197828b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:19.643155 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d93412-8c55-471d-87bd-710b197828b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:19.643947 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d93412-8c55-471d-87bd-710b197828b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:19.645977 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d93412-8c55-471d-87bd-710b197828b5 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:19.673714 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1044/2096] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:56:19 2022] POST /identity/v3/projects => generated 401 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:56:19.678104 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3328080-52c5-447c-915b-3c5164eef34d None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:19.689325 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3328080-52c5-447c-915b-3c5164eef34d None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:19.746426 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117166a-7510-4936-aefd-51ccf1e6166e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:19.747141 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117166a-7510-4936-aefd-51ccf1e6166e admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:19.747499 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117166a-7510-4936-aefd-51ccf1e6166e admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:19.747787 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117166a-7510-4936-aefd-51ccf1e6166e admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:19.748425 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117166a-7510-4936-aefd-51ccf1e6166e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:19.750411 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117166a-7510-4936-aefd-51ccf1e6166e admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:19.773729 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1053/2097] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:56:19 2022] POST /identity/v3/users => generated 307 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:56:19.779389 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d93412-8c55-471d-87bd-710b197828b5 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:19.792487 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:19.797013 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d93412-8c55-471d-87bd-710b197828b5 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:19.803564 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aab8f0-6e6b-4044-a8e6-c0a0ab692580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:19.804181 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aab8f0-6e6b-4044-a8e6-c0a0ab692580 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:19.804460 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aab8f0-6e6b-4044-a8e6-c0a0ab692580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:19.804730 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aab8f0-6e6b-4044-a8e6-c0a0ab692580 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:19.805585 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aab8f0-6e6b-4044-a8e6-c0a0ab692580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:19.807606 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aab8f0-6e6b-4044-a8e6-c0a0ab692580 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:19.818890 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1045/2098] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:19.823444 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117166a-7510-4936-aefd-51ccf1e6166e admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:19.835589 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117166a-7510-4936-aefd-51ccf1e6166e admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:19.841301 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36921537-9f89-4a28-b06b-f22fdd60d91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:19.841997 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36921537-9f89-4a28-b06b-f22fdd60d91a admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:19.842276 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36921537-9f89-4a28-b06b-f22fdd60d91a admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:19.842550 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36921537-9f89-4a28-b06b-f22fdd60d91a admin admin] PATH_INFO: `/v3/projects/1632f3efbfc64a1d89273814c72c2402/users/8b4de68a44654367a6aaca1c1ba0fc33/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:19.859737 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36921537-9f89-4a28-b06b-f22fdd60d91a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1632f3efbfc64a1d89273814c72c2402, user_id=8b4de68a44654367a6aaca1c1ba0fc33, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:19.862436 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36921537-9f89-4a28-b06b-f22fdd60d91a admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:19.878726 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1054/2099] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:56:19 2022] PUT /identity/v3/projects/1632f3efbfc64a1d89273814c72c2402/users/8b4de68a44654367a6aaca1c1ba0fc33/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:19.883246 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aab8f0-6e6b-4044-a8e6-c0a0ab692580 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:19.902411 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aab8f0-6e6b-4044-a8e6-c0a0ab692580 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:19.992047 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d9e8f-fde1-4878-9cc3-48f1ab0fe399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:19.993027 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d9e8f-fde1-4878-9cc3-48f1ab0fe399 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:19.993359 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d9e8f-fde1-4878-9cc3-48f1ab0fe399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:19.993597 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d9e8f-fde1-4878-9cc3-48f1ab0fe399 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:19.994294 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d9e8f-fde1-4878-9cc3-48f1ab0fe399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:19.996193 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d9e8f-fde1-4878-9cc3-48f1ab0fe399 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:20.013596 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1046/2100] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:56:20.014823 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36921537-9f89-4a28-b06b-f22fdd60d91a admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:20.033514 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36921537-9f89-4a28-b06b-f22fdd60d91a admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:20.037931 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5bf07c-eca7-494c-894e-ebe2b2893c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:20.038596 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bf07c-eca7-494c-894e-ebe2b2893c99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:20.038872 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bf07c-eca7-494c-894e-ebe2b2893c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:20.039143 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bf07c-eca7-494c-894e-ebe2b2893c99 admin admin] PATH_INFO: `/v3/projects/1632f3efbfc64a1d89273814c72c2402/users/8b4de68a44654367a6aaca1c1ba0fc33/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:20.041035 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5bf07c-eca7-494c-894e-ebe2b2893c99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1632f3efbfc64a1d89273814c72c2402, user_id=8b4de68a44654367a6aaca1c1ba0fc33, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:20.044679 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5bf07c-eca7-494c-894e-ebe2b2893c99 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:20.059969 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1055/2101] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:56:20 2022] PUT /identity/v3/projects/1632f3efbfc64a1d89273814c72c2402/users/8b4de68a44654367a6aaca1c1ba0fc33/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:20.072267 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9dd3a-8d2d-4b7d-a011-c8f9a348911a None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:20.072544 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9dd3a-8d2d-4b7d-a011-c8f9a348911a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:20.072807 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9dd3a-8d2d-4b7d-a011-c8f9a348911a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:20.112572 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-7ed9dd3a-8d2d-4b7d-a011-c8f9a348911a None None] MFA Rules not processed for user `8b4de68a44654367a6aaca1c1ba0fc33`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:20.113932 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7ed9dd3a-8d2d-4b7d-a011-c8f9a348911a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:20.198273 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1047/2102] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:20 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:20.209178 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5bf07c-eca7-494c-894e-ebe2b2893c99 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:20.211096 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-0c5bf07c-eca7-494c-894e-ebe2b2893c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:20.268948 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5bf07c-eca7-494c-894e-ebe2b2893c99 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:20.272552 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871b2c8-a34e-4e50-a938-e1753cff1201 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:20.273145 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871b2c8-a34e-4e50-a938-e1753cff1201 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:20.273419 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871b2c8-a34e-4e50-a938-e1753cff1201 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:20.273685 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871b2c8-a34e-4e50-a938-e1753cff1201 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:20.282494 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871b2c8-a34e-4e50-a938-e1753cff1201 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:20.283950 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871b2c8-a34e-4e50-a938-e1753cff1201 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:20.294168 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1056/2103] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:20 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:20.376634 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9dd3a-8d2d-4b7d-a011-c8f9a348911a None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:20.386675 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9dd3a-8d2d-4b7d-a011-c8f9a348911a None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:20.390696 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c56e1-d57d-4116-ab31-afd0354e3676 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:20.391324 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c56e1-d57d-4116-ab31-afd0354e3676 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:20.391602 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c56e1-d57d-4116-ab31-afd0354e3676 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:20.391878 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c56e1-d57d-4116-ab31-afd0354e3676 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:20.456938 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c56e1-d57d-4116-ab31-afd0354e3676 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:20.459236 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c56e1-d57d-4116-ab31-afd0354e3676 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:20.474604 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1048/2104] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:20 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:24.664323 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871b2c8-a34e-4e50-a938-e1753cff1201 service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:24.666785 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-0871b2c8-a34e-4e50-a938-e1753cff1201 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:24.700158 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c56e1-d57d-4116-ab31-afd0354e3676 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:24.710444 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:24.721858 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:24.750931 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871b2c8-a34e-4e50-a938-e1753cff1201 service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:24.756582 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ed7ee-7258-4a99-87a3-ba34905ff662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:24.757340 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ed7ee-7258-4a99-87a3-ba34905ff662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:24.757635 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ed7ee-7258-4a99-87a3-ba34905ff662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:24.758012 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ed7ee-7258-4a99-87a3-ba34905ff662 admin admin] PATH_INFO: `/v3/users/efb9172e2c74408280b2a19fe6ad9b26` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:24.759455 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ed7ee-7258-4a99-87a3-ba34905ff662 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efb9172e2c74408280b2a19fe6ad9b26)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:24.761683 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ed7ee-7258-4a99-87a3-ba34905ff662 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:24.800459 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c56e1-d57d-4116-ab31-afd0354e3676 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:24.807185 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c41a86-d83d-44ce-9053-aaa8e008c9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:24.807973 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c41a86-d83d-44ce-9053-aaa8e008c9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:24.808249 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c41a86-d83d-44ce-9053-aaa8e008c9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:24.808521 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c41a86-d83d-44ce-9053-aaa8e008c9ce admin admin] PATH_INFO: `/v3/users/9b4b38cf7a9048c9871105090e246487` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:24.810153 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c41a86-d83d-44ce-9053-aaa8e008c9ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b4b38cf7a9048c9871105090e246487)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:24.813340 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c41a86-d83d-44ce-9053-aaa8e008c9ce admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:24.840773 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9d2ed7ee-7258-4a99-87a3-ba34905ff662 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efb9172e2c74408280b2a19fe6ad9b26'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:24.849185 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9d2ed7ee-7258-4a99-87a3-ba34905ff662 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efb9172e2c74408280b2a19fe6ad9b26'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:24.859681 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9d2ed7ee-7258-4a99-87a3-ba34905ff662 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efb9172e2c74408280b2a19fe6ad9b26'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:24.869171 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a8c41a86-d83d-44ce-9053-aaa8e008c9ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b4b38cf7a9048c9871105090e246487'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:24.877374 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9d2ed7ee-7258-4a99-87a3-ba34905ff662 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efb9172e2c74408280b2a19fe6ad9b26'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:24.878306 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9d2ed7ee-7258-4a99-87a3-ba34905ff662 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efb9172e2c74408280b2a19fe6ad9b26'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:24.882970 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a8c41a86-d83d-44ce-9053-aaa8e008c9ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b4b38cf7a9048c9871105090e246487'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:24.888334 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1057/2105] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:56:24 2022] DELETE /identity/v3/users/efb9172e2c74408280b2a19fe6ad9b26 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:24.890677 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a8c41a86-d83d-44ce-9053-aaa8e008c9ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b4b38cf7a9048c9871105090e246487'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:24.892605 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239c01f-c547-4bf4-8552-5302f1aa0b08 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:24.893151 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239c01f-c547-4bf4-8552-5302f1aa0b08 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:24.893429 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239c01f-c547-4bf4-8552-5302f1aa0b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:24.900006 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a8c41a86-d83d-44ce-9053-aaa8e008c9ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b4b38cf7a9048c9871105090e246487'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:24.900708 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a8c41a86-d83d-44ce-9053-aaa8e008c9ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b4b38cf7a9048c9871105090e246487'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:24.908080 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1049/2106] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:56:24 2022] DELETE /identity/v3/users/9b4b38cf7a9048c9871105090e246487 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:56:24.914272 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0be5c4-7100-409f-bde5-80e74f5fe8b1 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:24.914568 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0be5c4-7100-409f-bde5-80e74f5fe8b1 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:24.914687 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-4239c01f-c547-4bf4-8552-5302f1aa0b08 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:24.914896 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0be5c4-7100-409f-bde5-80e74f5fe8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:24.915918 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-4239c01f-c547-4bf4-8552-5302f1aa0b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:24.945026 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-3d0be5c4-7100-409f-bde5-80e74f5fe8b1 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:24.946341 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3d0be5c4-7100-409f-bde5-80e74f5fe8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:25.004704 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1058/2107] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:56:25.010744 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239c01f-c547-4bf4-8552-5302f1aa0b08 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:25.012070 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-4239c01f-c547-4bf4-8552-5302f1aa0b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:25.018558 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1050/2108] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:25.032157 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0be5c4-7100-409f-bde5-80e74f5fe8b1 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:25.034149 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3d0be5c4-7100-409f-bde5-80e74f5fe8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:25.078379 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:25.079681 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:25.089997 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239c01f-c547-4bf4-8552-5302f1aa0b08 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:25.097231 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ac159-d059-407d-b76c-3d95af5f85b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:25.097920 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ac159-d059-407d-b76c-3d95af5f85b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:25.098205 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ac159-d059-407d-b76c-3d95af5f85b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:25.098481 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ac159-d059-407d-b76c-3d95af5f85b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:25.109797 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ac159-d059-407d-b76c-3d95af5f85b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:25.111278 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ac159-d059-407d-b76c-3d95af5f85b5 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:25.111664 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0be5c4-7100-409f-bde5-80e74f5fe8b1 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:25.115624 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b8a7d-b139-4cfc-8641-4f6f650697ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:25.116462 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b8a7d-b139-4cfc-8641-4f6f650697ab service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:25.116935 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b8a7d-b139-4cfc-8641-4f6f650697ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:25.117384 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b8a7d-b139-4cfc-8641-4f6f650697ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:25.121200 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1059/2109] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:56:25.128752 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b8a7d-b139-4cfc-8641-4f6f650697ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:25.130340 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b8a7d-b139-4cfc-8641-4f6f650697ab service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:25.142357 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1051/2110] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:25.527670 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ac159-d059-407d-b76c-3d95af5f85b5 service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:25.530026 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f12ac159-d059-407d-b76c-3d95af5f85b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:25.548952 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b8a7d-b139-4cfc-8641-4f6f650697ab service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:25.550698 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2c1b8a7d-b139-4cfc-8641-4f6f650697ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:25.578203 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b8a7d-b139-4cfc-8641-4f6f650697ab service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:25.580174 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ac159-d059-407d-b76c-3d95af5f85b5 service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:25.583268 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfac89-fb6f-4b85-af4f-59651dcae241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:25.583997 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfac89-fb6f-4b85-af4f-59651dcae241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:25.584329 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfac89-fb6f-4b85-af4f-59651dcae241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:25.584660 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfac89-fb6f-4b85-af4f-59651dcae241 admin admin] PATH_INFO: `/v3/projects/fd9af3de437e45f7ab950e3bb02d5d88` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:25.585888 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebfac89-fb6f-4b85-af4f-59651dcae241 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd9af3de437e45f7ab950e3bb02d5d88)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:25.589117 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebfac89-fb6f-4b85-af4f-59651dcae241 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:25.591411 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e5657-42fe-441f-aab8-e228ab81a311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:25.592476 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e5657-42fe-441f-aab8-e228ab81a311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:25.592960 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e5657-42fe-441f-aab8-e228ab81a311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:25.593446 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e5657-42fe-441f-aab8-e228ab81a311 admin admin] PATH_INFO: `/v3/projects/fa1c8f8b10c04dd2ad540f5421bff42d` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:25.596239 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e5657-42fe-441f-aab8-e228ab81a311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa1c8f8b10c04dd2ad540f5421bff42d)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:25.600383 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e5657-42fe-441f-aab8-e228ab81a311 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:25.650494 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-bebfac89-fb6f-4b85-af4f-59651dcae241 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd9af3de437e45f7ab950e3bb02d5d88', 'request_id': 'req-bebfac89-fb6f-4b85-af4f-59651dcae241'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:25.656481 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-bebfac89-fb6f-4b85-af4f-59651dcae241 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd9af3de437e45f7ab950e3bb02d5d88', 'request_id': 'req-bebfac89-fb6f-4b85-af4f-59651dcae241'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:25.663192 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-bebfac89-fb6f-4b85-af4f-59651dcae241 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd9af3de437e45f7ab950e3bb02d5d88', 'request_id': 'req-bebfac89-fb6f-4b85-af4f-59651dcae241'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:25.663711 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-7e4e5657-42fe-441f-aab8-e228ab81a311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa1c8f8b10c04dd2ad540f5421bff42d', 'request_id': 'req-7e4e5657-42fe-441f-aab8-e228ab81a311'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:25.679239 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-bebfac89-fb6f-4b85-af4f-59651dcae241 admin admin] The token cache is being invalidate because project fd9af3de437e45f7ab950e3bb02d5d88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:56:25.679588 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-bebfac89-fb6f-4b85-af4f-59651dcae241 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:25.680365 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-bebfac89-fb6f-4b85-af4f-59651dcae241 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:25.682055 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1052/2111] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:56:25 2022] DELETE /identity/v3/projects/fd9af3de437e45f7ab950e3bb02d5d88 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:25.683462 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-7e4e5657-42fe-441f-aab8-e228ab81a311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa1c8f8b10c04dd2ad540f5421bff42d', 'request_id': 'req-7e4e5657-42fe-441f-aab8-e228ab81a311'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:25.686617 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfac89-fb6f-4b85-af4f-59651dcae241 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:25.688325 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bebfac89-fb6f-4b85-af4f-59651dcae241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:25.691802 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-7e4e5657-42fe-441f-aab8-e228ab81a311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa1c8f8b10c04dd2ad540f5421bff42d', 'request_id': 'req-7e4e5657-42fe-441f-aab8-e228ab81a311'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:25.703734 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-7e4e5657-42fe-441f-aab8-e228ab81a311 admin admin] The token cache is being invalidate because project fa1c8f8b10c04dd2ad540f5421bff42d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:56:25.704040 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-7e4e5657-42fe-441f-aab8-e228ab81a311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:25.704746 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-7e4e5657-42fe-441f-aab8-e228ab81a311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:25.706535 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1060/2112] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:56:25 2022] DELETE /identity/v3/projects/fa1c8f8b10c04dd2ad540f5421bff42d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:25.710898 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538182f-b9ca-4ebd-aca4-cae458c90318 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:25.711196 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538182f-b9ca-4ebd-aca4-cae458c90318 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:25.711462 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538182f-b9ca-4ebd-aca4-cae458c90318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:25.741647 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-0538182f-b9ca-4ebd-aca4-cae458c90318 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:25.743667 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-0538182f-b9ca-4ebd-aca4-cae458c90318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:25.773372 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfac89-fb6f-4b85-af4f-59651dcae241 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:25.827053 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1061/2113] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:56:25.835165 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b11f4d-f009-492e-b0ff-5193d3c7f516 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:25.835702 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b11f4d-f009-492e-b0ff-5193d3c7f516 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:25.836042 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b11f4d-f009-492e-b0ff-5193d3c7f516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:25.849093 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44137885-8629-490c-ae54-e665cbe83c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:25.850083 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44137885-8629-490c-ae54-e665cbe83c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:25.850566 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44137885-8629-490c-ae54-e665cbe83c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:25.851313 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44137885-8629-490c-ae54-e665cbe83c46 admin admin] PATH_INFO: `/v3/users/8b4de68a44654367a6aaca1c1ba0fc33` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:25.852765 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44137885-8629-490c-ae54-e665cbe83c46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b4de68a44654367a6aaca1c1ba0fc33)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:25.856031 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44137885-8629-490c-ae54-e665cbe83c46 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:25.862124 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-09b11f4d-f009-492e-b0ff-5193d3c7f516 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:25.863462 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-09b11f4d-f009-492e-b0ff-5193d3c7f516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:25.863655 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:25.873148 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1062/2114] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:25.877720 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b11f4d-f009-492e-b0ff-5193d3c7f516 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:25.889257 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b11f4d-f009-492e-b0ff-5193d3c7f516 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:25.896231 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ecdb6-5ff6-47e0-bac9-4d404ac84d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:25.897224 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ecdb6-5ff6-47e0-bac9-4d404ac84d43 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:25.897795 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ecdb6-5ff6-47e0-bac9-4d404ac84d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:25.898195 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ecdb6-5ff6-47e0-bac9-4d404ac84d43 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:25.899455 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ecdb6-5ff6-47e0-bac9-4d404ac84d43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:56:25.899455 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ecdb6-5ff6-47e0-bac9-4d404ac84d43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:25.902741 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ecdb6-5ff6-47e0-bac9-4d404ac84d43 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:25.915898 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1063/2115] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:56:25.920498 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ecdb6-5ff6-47e0-bac9-4d404ac84d43 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:25.921356 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-44137885-8629-490c-ae54-e665cbe83c46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b4de68a44654367a6aaca1c1ba0fc33'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:25.931407 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ecdb6-5ff6-47e0-bac9-4d404ac84d43 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:25.935639 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-44137885-8629-490c-ae54-e665cbe83c46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b4de68a44654367a6aaca1c1ba0fc33'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:25.936850 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03876c02-f8fc-4cfe-aca8-de2bbba749c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:25.937515 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03876c02-f8fc-4cfe-aca8-de2bbba749c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:25.937933 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03876c02-f8fc-4cfe-aca8-de2bbba749c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:25.938580 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03876c02-f8fc-4cfe-aca8-de2bbba749c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:25.939023 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03876c02-f8fc-4cfe-aca8-de2bbba749c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:25.940994 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03876c02-f8fc-4cfe-aca8-de2bbba749c5 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:25.944689 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-44137885-8629-490c-ae54-e665cbe83c46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b4de68a44654367a6aaca1c1ba0fc33'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:25.953934 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-44137885-8629-490c-ae54-e665cbe83c46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b4de68a44654367a6aaca1c1ba0fc33'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:25.955034 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-44137885-8629-490c-ae54-e665cbe83c46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b4de68a44654367a6aaca1c1ba0fc33'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:25.965242 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1053/2116] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:56:25 2022] DELETE /identity/v3/users/8b4de68a44654367a6aaca1c1ba0fc33 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:56:25.973551 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1064/2117] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:56:25 2022] POST /identity/v3/projects => generated 357 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:56:25.978548 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44137885-8629-490c-ae54-e665cbe83c46 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:25.980269 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-44137885-8629-490c-ae54-e665cbe83c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:26.075520 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44137885-8629-490c-ae54-e665cbe83c46 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:26.148621 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6f418-9030-4a60-bda4-b12d079ff670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:26.149301 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6f418-9030-4a60-bda4-b12d079ff670 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:26.149581 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6f418-9030-4a60-bda4-b12d079ff670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:26.149964 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6f418-9030-4a60-bda4-b12d079ff670 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:26.150727 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6f418-9030-4a60-bda4-b12d079ff670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:26.152984 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6f418-9030-4a60-bda4-b12d079ff670 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:26.191294 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1054/2118] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:56:25 2022] POST /identity/v3/users => generated 279 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:56:26.193213 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03876c02-f8fc-4cfe-aca8-de2bbba749c5 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:26.206047 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03876c02-f8fc-4cfe-aca8-de2bbba749c5 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:26.212365 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b456b2-7c08-4e69-b2bf-7b0543e796a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:26.213190 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b456b2-7c08-4e69-b2bf-7b0543e796a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:26.213538 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b456b2-7c08-4e69-b2bf-7b0543e796a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:26.213944 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b456b2-7c08-4e69-b2bf-7b0543e796a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:26.214662 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b456b2-7c08-4e69-b2bf-7b0543e796a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:26.217251 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b456b2-7c08-4e69-b2bf-7b0543e796a8 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:26.233421 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1065/2119] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:26.237819 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6f418-9030-4a60-bda4-b12d079ff670 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:26.250103 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6f418-9030-4a60-bda4-b12d079ff670 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:26.255116 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d14701-9e71-49a9-a193-a0177135ff4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:26.255724 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d14701-9e71-49a9-a193-a0177135ff4e admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:26.256049 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d14701-9e71-49a9-a193-a0177135ff4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:26.256659 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d14701-9e71-49a9-a193-a0177135ff4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:26.256971 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d14701-9e71-49a9-a193-a0177135ff4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:26.259114 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d14701-9e71-49a9-a193-a0177135ff4e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:26.270864 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1055/2120] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:26.275693 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b456b2-7c08-4e69-b2bf-7b0543e796a8 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:26.290441 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b456b2-7c08-4e69-b2bf-7b0543e796a8 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:26.297803 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5e741-9dab-458d-aa90-713e94288ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:26.298812 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5e741-9dab-458d-aa90-713e94288ff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:26.299166 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5e741-9dab-458d-aa90-713e94288ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:26.299516 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5e741-9dab-458d-aa90-713e94288ff1 admin admin] PATH_INFO: `/v3/projects/fcc855834de24fb5bfe4cb01ee62bbf4/users/322ad88715204335884a6d4b2df5fae5/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:26.303483 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d14701-9e71-49a9-a193-a0177135ff4e admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:26.305248 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-70d14701-9e71-49a9-a193-a0177135ff4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:26.319899 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d14701-9e71-49a9-a193-a0177135ff4e admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:26.325193 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5e741-9dab-458d-aa90-713e94288ff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcc855834de24fb5bfe4cb01ee62bbf4, user_id=322ad88715204335884a6d4b2df5fae5, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:26.327924 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f483f63-4bac-4013-afc1-aea1c239736f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:26.328075 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5e741-9dab-458d-aa90-713e94288ff1 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:26.328947 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f483f63-4bac-4013-afc1-aea1c239736f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:26.329426 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f483f63-4bac-4013-afc1-aea1c239736f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:26.329937 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f483f63-4bac-4013-afc1-aea1c239736f admin admin] PATH_INFO: `/v3/projects/1632f3efbfc64a1d89273814c72c2402` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:26.332821 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f483f63-4bac-4013-afc1-aea1c239736f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1632f3efbfc64a1d89273814c72c2402)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:26.338748 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f483f63-4bac-4013-afc1-aea1c239736f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:26.341787 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:26.352175 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:26.354978 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1066/2121] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:56:26 2022] PUT /identity/v3/projects/fcc855834de24fb5bfe4cb01ee62bbf4/users/322ad88715204335884a6d4b2df5fae5/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:26.366873 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d4619-59b6-4b27-9864-5ad25fd03528 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:26.367150 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d4619-59b6-4b27-9864-5ad25fd03528 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:26.367470 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d4619-59b6-4b27-9864-5ad25fd03528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:26.407118 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-a67d4619-59b6-4b27-9864-5ad25fd03528 None None] MFA Rules not processed for user `322ad88715204335884a6d4b2df5fae5`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:26.408321 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a67d4619-59b6-4b27-9864-5ad25fd03528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:26.420491 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5f483f63-4bac-4013-afc1-aea1c239736f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1632f3efbfc64a1d89273814c72c2402', 'request_id': 'req-5f483f63-4bac-4013-afc1-aea1c239736f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:26.429738 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5f483f63-4bac-4013-afc1-aea1c239736f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1632f3efbfc64a1d89273814c72c2402', 'request_id': 'req-5f483f63-4bac-4013-afc1-aea1c239736f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:26.442394 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5f483f63-4bac-4013-afc1-aea1c239736f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1632f3efbfc64a1d89273814c72c2402', 'request_id': 'req-5f483f63-4bac-4013-afc1-aea1c239736f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:26.469002 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5f483f63-4bac-4013-afc1-aea1c239736f admin admin] The token cache is being invalidate because project 1632f3efbfc64a1d89273814c72c2402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:56:26.469210 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5f483f63-4bac-4013-afc1-aea1c239736f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:26.469865 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5f483f63-4bac-4013-afc1-aea1c239736f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:26.474726 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1056/2122] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:56:26 2022] DELETE /identity/v3/projects/1632f3efbfc64a1d89273814c72c2402 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:56:26.474726 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f814f9-5ff6-4ab5-b9ab-b49f982b730e None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:26.474726 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f814f9-5ff6-4ab5-b9ab-b49f982b730e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:26.474726 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f814f9-5ff6-4ab5-b9ab-b49f982b730e None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:26.475075 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1057/2123] 10.222.0.52 () {54 vars in 921 bytes} [Sun Aug 28 00:56:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:56:26.476181 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73efd7-1b97-4f42-b7eb-cbab11fbc961 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:26.476455 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73efd7-1b97-4f42-b7eb-cbab11fbc961 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:26.476717 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73efd7-1b97-4f42-b7eb-cbab11fbc961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:26.498627 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-af73efd7-1b97-4f42-b7eb-cbab11fbc961 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:26.500042 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-af73efd7-1b97-4f42-b7eb-cbab11fbc961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:26.504011 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1067/2124] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:56:26.505271 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d1d44-5e98-4be2-afb1-cd20e234a1bb None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:26.505554 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d1d44-5e98-4be2-afb1-cd20e234a1bb None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:26.506432 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d1d44-5e98-4be2-afb1-cd20e234a1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:26.529149 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-981d1d44-5e98-4be2-afb1-cd20e234a1bb None None] MFA Rules not processed for user `ae87149f6ab04a9997263598737ae27e`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:26.530451 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-981d1d44-5e98-4be2-afb1-cd20e234a1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:26.612315 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1058/2125] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:56:26.612315 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73efd7-1b97-4f42-b7eb-cbab11fbc961 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:26.612806 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-af73efd7-1b97-4f42-b7eb-cbab11fbc961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:26.616010 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1068/2126] 10.222.0.52 () {58 vars in 1018 bytes} [Sun Aug 28 00:56:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:26.622629 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9320352-a762-44ec-8d36-994205de1c8e None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:26.623330 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9320352-a762-44ec-8d36-994205de1c8e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:26.623330 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9320352-a762-44ec-8d36-994205de1c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:26.645225 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-c9320352-a762-44ec-8d36-994205de1c8e None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:26.646528 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c9320352-a762-44ec-8d36-994205de1c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:26.655311 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1069/2127] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:26.658035 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9320352-a762-44ec-8d36-994205de1c8e None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:26.659645 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c9320352-a762-44ec-8d36-994205de1c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:26.675038 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9320352-a762-44ec-8d36-994205de1c8e None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:26.680862 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8b61f-26cf-4d27-b369-9975ea33c27b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae87149f6ab04a9997263598737ae27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:26.681581 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8b61f-26cf-4d27-b369-9975ea33c27b service placement] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:26.681959 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8b61f-26cf-4d27-b369-9975ea33c27b service placement] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:26.682321 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8b61f-26cf-4d27-b369-9975ea33c27b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:26.692760 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8b61f-26cf-4d27-b369-9975ea33c27b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:26.694431 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8b61f-26cf-4d27-b369-9975ea33c27b service placement] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:26.696257 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73efd7-1b97-4f42-b7eb-cbab11fbc961 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:26.700120 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c073cb7-1eea-4506-94c1-04ff3da48f22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:26.700984 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c073cb7-1eea-4506-94c1-04ff3da48f22 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:26.701135 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c073cb7-1eea-4506-94c1-04ff3da48f22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:26.701403 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c073cb7-1eea-4506-94c1-04ff3da48f22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:26.705150 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1070/2128] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:26.705926 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8b61f-26cf-4d27-b369-9975ea33c27b service placement] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:26.711840 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c073cb7-1eea-4506-94c1-04ff3da48f22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:26.713337 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c073cb7-1eea-4506-94c1-04ff3da48f22 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:26.716463 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8b61f-26cf-4d27-b369-9975ea33c27b service placement] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:26.723167 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50124c6e-9644-43fc-84b6-f5ff93475b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:26.724141 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50124c6e-9644-43fc-84b6-f5ff93475b39 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:26.724552 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1059/2129] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:26 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:26.733207 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50124c6e-9644-43fc-84b6-f5ff93475b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:26.733506 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50124c6e-9644-43fc-84b6-f5ff93475b39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:26.736415 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50124c6e-9644-43fc-84b6-f5ff93475b39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:56:26.736415 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50124c6e-9644-43fc-84b6-f5ff93475b39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:26.736415 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50124c6e-9644-43fc-84b6-f5ff93475b39 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:26.742070 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c073cb7-1eea-4506-94c1-04ff3da48f22 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:26.743534 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4c073cb7-1eea-4506-94c1-04ff3da48f22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:26.754614 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1071/2130] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:56:26.758526 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50124c6e-9644-43fc-84b6-f5ff93475b39 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:26.759414 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c073cb7-1eea-4506-94c1-04ff3da48f22 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:26.764842 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b36219-1fbe-4058-989f-6baadb889e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:26.765468 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b36219-1fbe-4058-989f-6baadb889e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:26.765742 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b36219-1fbe-4058-989f-6baadb889e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:26.766117 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b36219-1fbe-4058-989f-6baadb889e32 admin admin] PATH_INFO: `/v3/users/322ad88715204335884a6d4b2df5fae5` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:26.767247 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b36219-1fbe-4058-989f-6baadb889e32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=322ad88715204335884a6d4b2df5fae5)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:26.769223 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b36219-1fbe-4058-989f-6baadb889e32 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:26.770765 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50124c6e-9644-43fc-84b6-f5ff93475b39 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:26.776799 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262b533-e8db-4f23-8be9-88c6e59facee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:26.777499 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262b533-e8db-4f23-8be9-88c6e59facee admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:26.777808 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262b533-e8db-4f23-8be9-88c6e59facee admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:26.778682 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262b533-e8db-4f23-8be9-88c6e59facee admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:26.779293 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262b533-e8db-4f23-8be9-88c6e59facee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:26.781549 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262b533-e8db-4f23-8be9-88c6e59facee admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:26.817511 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:26.823908 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1072/2131] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:56:26 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:56:26.826215 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262b533-e8db-4f23-8be9-88c6e59facee admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:26.845953 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-51b36219-1fbe-4058-989f-6baadb889e32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '322ad88715204335884a6d4b2df5fae5'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:26.861864 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-51b36219-1fbe-4058-989f-6baadb889e32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '322ad88715204335884a6d4b2df5fae5'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:26.869120 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-51b36219-1fbe-4058-989f-6baadb889e32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '322ad88715204335884a6d4b2df5fae5'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:26.878177 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:26.880400 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-51b36219-1fbe-4058-989f-6baadb889e32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '322ad88715204335884a6d4b2df5fae5'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:26.883637 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-51b36219-1fbe-4058-989f-6baadb889e32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '322ad88715204335884a6d4b2df5fae5'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:26.891902 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1060/2132] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:56:26 2022] DELETE /identity/v3/users/322ad88715204335884a6d4b2df5fae5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:26.896823 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef389c00-fd55-4c8f-a385-f3027f311974 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:26.897130 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef389c00-fd55-4c8f-a385-f3027f311974 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:26.897406 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef389c00-fd55-4c8f-a385-f3027f311974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:26.917332 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-ef389c00-fd55-4c8f-a385-f3027f311974 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:26.918589 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ef389c00-fd55-4c8f-a385-f3027f311974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:26.933955 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262b533-e8db-4f23-8be9-88c6e59facee admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:27.003667 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db14cf8-a6f3-4994-a8cc-0b81bbb5cc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:27.004466 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db14cf8-a6f3-4994-a8cc-0b81bbb5cc68 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:27.004665 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1061/2133] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:27.004750 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db14cf8-a6f3-4994-a8cc-0b81bbb5cc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:27.004829 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db14cf8-a6f3-4994-a8cc-0b81bbb5cc68 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:27.005430 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db14cf8-a6f3-4994-a8cc-0b81bbb5cc68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:27.007416 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db14cf8-a6f3-4994-a8cc-0b81bbb5cc68 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:27.016502 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef389c00-fd55-4c8f-a385-f3027f311974 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:27.016502 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ef389c00-fd55-4c8f-a385-f3027f311974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:27.035458 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1073/2134] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:56:26 2022] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:56:27.039932 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db14cf8-a6f3-4994-a8cc-0b81bbb5cc68 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:27.041991 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6db14cf8-a6f3-4994-a8cc-0b81bbb5cc68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:27.056539 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db14cf8-a6f3-4994-a8cc-0b81bbb5cc68 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:27.062476 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f4418-ce05-4b05-be96-4a019c1bf603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:27.062855 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f4418-ce05-4b05-be96-4a019c1bf603 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:27.063135 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f4418-ce05-4b05-be96-4a019c1bf603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:27.063405 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f4418-ce05-4b05-be96-4a019c1bf603 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:27.064287 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f4418-ce05-4b05-be96-4a019c1bf603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:27.065864 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f4418-ce05-4b05-be96-4a019c1bf603 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:27.077996 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1074/2135] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:56:27.081685 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f4418-ce05-4b05-be96-4a019c1bf603 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:27.085668 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef389c00-fd55-4c8f-a385-f3027f311974 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:27.090174 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c0876-9ad6-43a1-82f7-8648adc45c89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:27.090887 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c0876-9ad6-43a1-82f7-8648adc45c89 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:27.091171 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c0876-9ad6-43a1-82f7-8648adc45c89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:27.091450 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c0876-9ad6-43a1-82f7-8648adc45c89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:27.093517 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f4418-ce05-4b05-be96-4a019c1bf603 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:27.099642 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f0449-cc9c-4ff3-8b94-dcb9d090660d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:27.100633 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f0449-cc9c-4ff3-8b94-dcb9d090660d admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:27.101456 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f0449-cc9c-4ff3-8b94-dcb9d090660d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:27.103946 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f0449-cc9c-4ff3-8b94-dcb9d090660d admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:27.105029 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f0449-cc9c-4ff3-8b94-dcb9d090660d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:27.107334 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f0449-cc9c-4ff3-8b94-dcb9d090660d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:27.110688 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c0876-9ad6-43a1-82f7-8648adc45c89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:27.112146 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c0876-9ad6-43a1-82f7-8648adc45c89 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:27.124265 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1075/2136] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:27.126901 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1062/2137] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:27.128243 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f0449-cc9c-4ff3-8b94-dcb9d090660d admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:27.138827 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f0449-cc9c-4ff3-8b94-dcb9d090660d admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:27.143462 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e000074-b23a-4777-a234-b90951b098d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:27.144125 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e000074-b23a-4777-a234-b90951b098d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:27.144427 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e000074-b23a-4777-a234-b90951b098d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:27.144702 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e000074-b23a-4777-a234-b90951b098d0 admin admin] PATH_INFO: `/v3/projects/a7e3bd26d0fa4340aff1a1a56cc57f39/users/2dd73c0ffdfc46d283748aa3fe735993/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:27.166830 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e000074-b23a-4777-a234-b90951b098d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7e3bd26d0fa4340aff1a1a56cc57f39, user_id=2dd73c0ffdfc46d283748aa3fe735993, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:27.171806 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e000074-b23a-4777-a234-b90951b098d0 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:27.185874 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1076/2138] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:56:27 2022] PUT /identity/v3/projects/a7e3bd26d0fa4340aff1a1a56cc57f39/users/2dd73c0ffdfc46d283748aa3fe735993/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:27.197708 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8088a55-d1b4-4611-8d0f-f40ef2ecaecc None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:27.198139 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8088a55-d1b4-4611-8d0f-f40ef2ecaecc None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:27.198484 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8088a55-d1b4-4611-8d0f-f40ef2ecaecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:27.219276 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e000074-b23a-4777-a234-b90951b098d0 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:27.222003 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8e000074-b23a-4777-a234-b90951b098d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:27.237701 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b8088a55-d1b4-4611-8d0f-f40ef2ecaecc None None] MFA Rules not processed for user `2dd73c0ffdfc46d283748aa3fe735993`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:27.238994 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b8088a55-d1b4-4611-8d0f-f40ef2ecaecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:27.299920 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:27.303813 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e000074-b23a-4777-a234-b90951b098d0 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:27.317101 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502d258-76ae-4e2a-9120-25143f444477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:27.317791 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502d258-76ae-4e2a-9120-25143f444477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:27.318103 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502d258-76ae-4e2a-9120-25143f444477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:27.318379 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502d258-76ae-4e2a-9120-25143f444477 admin admin] PATH_INFO: `/v3/users/69b8ff3b6cff499a96ed291323b48bdb` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:27.320389 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502d258-76ae-4e2a-9120-25143f444477 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69b8ff3b6cff499a96ed291323b48bdb)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:27.322376 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502d258-76ae-4e2a-9120-25143f444477 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:27.334985 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1063/2139] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:27.339981 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8088a55-d1b4-4611-8d0f-f40ef2ecaecc None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:27.347567 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:27.360062 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8088a55-d1b4-4611-8d0f-f40ef2ecaecc None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:27.367354 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a217374-75c1-4199-a287-25cdfd6564c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:27.368205 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a217374-75c1-4199-a287-25cdfd6564c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:27.368552 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a217374-75c1-4199-a287-25cdfd6564c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:27.368892 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a217374-75c1-4199-a287-25cdfd6564c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:27.370599 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a217374-75c1-4199-a287-25cdfd6564c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:27.375507 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a217374-75c1-4199-a287-25cdfd6564c8 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:27.402248 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9502d258-76ae-4e2a-9120-25143f444477 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69b8ff3b6cff499a96ed291323b48bdb'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:27.413378 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1064/2140] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:56:27 2022] POST /identity/v3/projects => generated 381 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:56:27.416404 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9502d258-76ae-4e2a-9120-25143f444477 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69b8ff3b6cff499a96ed291323b48bdb'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:27.417540 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a217374-75c1-4199-a287-25cdfd6564c8 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:27.426455 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9502d258-76ae-4e2a-9120-25143f444477 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69b8ff3b6cff499a96ed291323b48bdb'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:27.442834 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9502d258-76ae-4e2a-9120-25143f444477 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69b8ff3b6cff499a96ed291323b48bdb'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:27.443754 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9502d258-76ae-4e2a-9120-25143f444477 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69b8ff3b6cff499a96ed291323b48bdb'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:27.454356 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1077/2141] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:56:27 2022] DELETE /identity/v3/users/69b8ff3b6cff499a96ed291323b48bdb => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:56:27.502674 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502d258-76ae-4e2a-9120-25143f444477 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:27.505166 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9502d258-76ae-4e2a-9120-25143f444477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:27.555021 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a217374-75c1-4199-a287-25cdfd6564c8 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:27.630536 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502d258-76ae-4e2a-9120-25143f444477 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:27.636580 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24de2b-50b7-4543-8078-1daa32d38bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:27.637526 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24de2b-50b7-4543-8078-1daa32d38bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:27.638155 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24de2b-50b7-4543-8078-1daa32d38bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:27.639167 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24de2b-50b7-4543-8078-1daa32d38bd0 admin admin] PATH_INFO: `/v3/projects/fcc855834de24fb5bfe4cb01ee62bbf4` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:27.640664 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24de2b-50b7-4543-8078-1daa32d38bd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcc855834de24fb5bfe4cb01ee62bbf4)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:27.644868 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24de2b-50b7-4543-8078-1daa32d38bd0 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:27.657820 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a4170-cf48-4d74-a300-a0bd770b85a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:27.658924 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a4170-cf48-4d74-a300-a0bd770b85a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:27.659764 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a4170-cf48-4d74-a300-a0bd770b85a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:27.660040 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a4170-cf48-4d74-a300-a0bd770b85a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:27.660740 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a4170-cf48-4d74-a300-a0bd770b85a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:27.662859 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a4170-cf48-4d74-a300-a0bd770b85a9 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:27.706384 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1065/2142] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:56:27 2022] POST /identity/v3/users => generated 297 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:56:27.707337 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a4170-cf48-4d74-a300-a0bd770b85a9 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:27.709422 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c28a4170-cf48-4d74-a300-a0bd770b85a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:27.723303 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a4170-cf48-4d74-a300-a0bd770b85a9 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:27.729056 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3b24de2b-50b7-4543-8078-1daa32d38bd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcc855834de24fb5bfe4cb01ee62bbf4', 'request_id': 'req-3b24de2b-50b7-4543-8078-1daa32d38bd0'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:27.757986 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3b24de2b-50b7-4543-8078-1daa32d38bd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcc855834de24fb5bfe4cb01ee62bbf4', 'request_id': 'req-3b24de2b-50b7-4543-8078-1daa32d38bd0'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:27.766539 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3b24de2b-50b7-4543-8078-1daa32d38bd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcc855834de24fb5bfe4cb01ee62bbf4', 'request_id': 'req-3b24de2b-50b7-4543-8078-1daa32d38bd0'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:27.777721 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3b24de2b-50b7-4543-8078-1daa32d38bd0 admin admin] The token cache is being invalidate because project fcc855834de24fb5bfe4cb01ee62bbf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:56:27.778167 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3b24de2b-50b7-4543-8078-1daa32d38bd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:27.778871 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3b24de2b-50b7-4543-8078-1daa32d38bd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:27.780758 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:27.785997 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1078/2143] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:56:27 2022] DELETE /identity/v3/projects/fcc855834de24fb5bfe4cb01ee62bbf4 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:27.785997 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24de2b-50b7-4543-8078-1daa32d38bd0 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:27.785997 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3b24de2b-50b7-4543-8078-1daa32d38bd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:27.802156 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca99ded-3b96-42e8-be93-78115edcc044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:27.804067 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca99ded-3b96-42e8-be93-78115edcc044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:27.804610 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca99ded-3b96-42e8-be93-78115edcc044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:27.805085 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca99ded-3b96-42e8-be93-78115edcc044 admin admin] PATH_INFO: `/v3/projects/cd12e696095a4f419598c246fb301406` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:27.806727 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca99ded-3b96-42e8-be93-78115edcc044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd12e696095a4f419598c246fb301406)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:27.809418 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca99ded-3b96-42e8-be93-78115edcc044 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:27.820569 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24de2b-50b7-4543-8078-1daa32d38bd0 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:27.826875 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e8b18-b570-4495-b30b-36260d5a2b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:27.827925 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e8b18-b570-4495-b30b-36260d5a2b79 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:27.828561 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e8b18-b570-4495-b30b-36260d5a2b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:27.829117 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e8b18-b570-4495-b30b-36260d5a2b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:27.830282 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e8b18-b570-4495-b30b-36260d5a2b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:27.832955 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e8b18-b570-4495-b30b-36260d5a2b79 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:27.848642 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1079/2144] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:27.855253 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e8b18-b570-4495-b30b-36260d5a2b79 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:27.866887 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e8b18-b570-4495-b30b-36260d5a2b79 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:27.890960 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:27.899869 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-eca99ded-3b96-42e8-be93-78115edcc044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd12e696095a4f419598c246fb301406', 'request_id': 'req-eca99ded-3b96-42e8-be93-78115edcc044'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:27.913681 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-eca99ded-3b96-42e8-be93-78115edcc044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd12e696095a4f419598c246fb301406', 'request_id': 'req-eca99ded-3b96-42e8-be93-78115edcc044'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:27.928131 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-eca99ded-3b96-42e8-be93-78115edcc044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd12e696095a4f419598c246fb301406', 'request_id': 'req-eca99ded-3b96-42e8-be93-78115edcc044'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:27.956745 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-eca99ded-3b96-42e8-be93-78115edcc044 admin admin] The token cache is being invalidate because project cd12e696095a4f419598c246fb301406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:56:27.957311 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-eca99ded-3b96-42e8-be93-78115edcc044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:27.958303 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-eca99ded-3b96-42e8-be93-78115edcc044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:27.960776 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1066/2145] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:56:27 2022] DELETE /identity/v3/projects/cd12e696095a4f419598c246fb301406 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:27.967410 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca99ded-3b96-42e8-be93-78115edcc044 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:27.968467 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91880fc-fc0a-4fb9-90c7-53af8c0bd462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:27.969188 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91880fc-fc0a-4fb9-90c7-53af8c0bd462 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:27.969468 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91880fc-fc0a-4fb9-90c7-53af8c0bd462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:27.969741 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91880fc-fc0a-4fb9-90c7-53af8c0bd462 admin admin] PATH_INFO: `/v3/projects/bf4ee75d06af4f32837c513f13296f57/users/36b579b6ec074b67a8cf33d9fb1e8b94/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:27.971226 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-eca99ded-3b96-42e8-be93-78115edcc044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:27.988492 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca99ded-3b96-42e8-be93-78115edcc044 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:27.992381 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91880fc-fc0a-4fb9-90c7-53af8c0bd462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf4ee75d06af4f32837c513f13296f57, user_id=36b579b6ec074b67a8cf33d9fb1e8b94, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:27.994130 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e4072-ee6b-4430-9c11-5f7f23ebdb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:27.994792 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e4072-ee6b-4430-9c11-5f7f23ebdb6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:27.995103 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e4072-ee6b-4430-9c11-5f7f23ebdb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:27.995379 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e4072-ee6b-4430-9c11-5f7f23ebdb6a admin admin] PATH_INFO: `/v3/users/c4f4b7a3657042a184dd205fcc32eee4` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:27.996748 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e4072-ee6b-4430-9c11-5f7f23ebdb6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4f4b7a3657042a184dd205fcc32eee4)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:27.997288 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91880fc-fc0a-4fb9-90c7-53af8c0bd462 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:27.998948 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e4072-ee6b-4430-9c11-5f7f23ebdb6a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:28.019458 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1080/2146] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:56:27 2022] PUT /identity/v3/projects/bf4ee75d06af4f32837c513f13296f57/users/36b579b6ec074b67a8cf33d9fb1e8b94/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:28.023302 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91880fc-fc0a-4fb9-90c7-53af8c0bd462 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:28.025429 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b91880fc-fc0a-4fb9-90c7-53af8c0bd462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:28.079454 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b75e4072-ee6b-4430-9c11-5f7f23ebdb6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4f4b7a3657042a184dd205fcc32eee4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:28.099633 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b75e4072-ee6b-4430-9c11-5f7f23ebdb6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4f4b7a3657042a184dd205fcc32eee4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:28.110226 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b75e4072-ee6b-4430-9c11-5f7f23ebdb6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4f4b7a3657042a184dd205fcc32eee4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:28.119804 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b75e4072-ee6b-4430-9c11-5f7f23ebdb6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4f4b7a3657042a184dd205fcc32eee4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:28.120503 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b75e4072-ee6b-4430-9c11-5f7f23ebdb6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4f4b7a3657042a184dd205fcc32eee4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:28.133248 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1067/2147] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:56:27 2022] DELETE /identity/v3/users/c4f4b7a3657042a184dd205fcc32eee4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:28.136358 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91880fc-fc0a-4fb9-90c7-53af8c0bd462 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:28.221282 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b79d79-bdb3-4fc7-888d-e8493d3fa7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:28.221966 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b79d79-bdb3-4fc7-888d-e8493d3fa7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:28.222248 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b79d79-bdb3-4fc7-888d-e8493d3fa7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:28.222521 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b79d79-bdb3-4fc7-888d-e8493d3fa7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:28.223187 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b79d79-bdb3-4fc7-888d-e8493d3fa7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:28.224850 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b79d79-bdb3-4fc7-888d-e8493d3fa7c8 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:28.237877 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1081/2148] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:56:28.240603 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e4072-ee6b-4430-9c11-5f7f23ebdb6a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:28.242486 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b75e4072-ee6b-4430-9c11-5f7f23ebdb6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:28.256278 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e4072-ee6b-4430-9c11-5f7f23ebdb6a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:28.261304 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987319fc-3183-42fe-aff1-d35c2f914210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:28.261995 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987319fc-3183-42fe-aff1-d35c2f914210 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:28.262594 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987319fc-3183-42fe-aff1-d35c2f914210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:28.262872 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987319fc-3183-42fe-aff1-d35c2f914210 admin admin] PATH_INFO: `/v3/projects/bf4ee75d06af4f32837c513f13296f57/users/36b579b6ec074b67a8cf33d9fb1e8b94/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:28.265208 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987319fc-3183-42fe-aff1-d35c2f914210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf4ee75d06af4f32837c513f13296f57, user_id=36b579b6ec074b67a8cf33d9fb1e8b94, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:28.268467 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987319fc-3183-42fe-aff1-d35c2f914210 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:28.283942 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1068/2149] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:56:28 2022] PUT /identity/v3/projects/bf4ee75d06af4f32837c513f13296f57/users/36b579b6ec074b67a8cf33d9fb1e8b94/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:28.294903 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7081ada-68d5-491b-95a0-d3061c7a1785 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:28.295594 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7081ada-68d5-491b-95a0-d3061c7a1785 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:28.296127 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7081ada-68d5-491b-95a0-d3061c7a1785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:28.321965 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987319fc-3183-42fe-aff1-d35c2f914210 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:28.323739 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-987319fc-3183-42fe-aff1-d35c2f914210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:28.330337 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-f7081ada-68d5-491b-95a0-d3061c7a1785 None None] MFA Rules not processed for user `36b579b6ec074b67a8cf33d9fb1e8b94`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:28.332409 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f7081ada-68d5-491b-95a0-d3061c7a1785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:28.376352 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:28.382381 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:28.400209 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987319fc-3183-42fe-aff1-d35c2f914210 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:28.404892 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5f8bb-fe57-4069-b672-9dfc13286652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:28.405604 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5f8bb-fe57-4069-b672-9dfc13286652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:28.406046 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5f8bb-fe57-4069-b672-9dfc13286652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:28.406240 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5f8bb-fe57-4069-b672-9dfc13286652 admin admin] PATH_INFO: `/v3/projects/9f7e899db2ce4a86b1afd0f0677c1aca` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:28.407450 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5f8bb-fe57-4069-b672-9dfc13286652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f7e899db2ce4a86b1afd0f0677c1aca)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:28.409461 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5f8bb-fe57-4069-b672-9dfc13286652 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:28.415982 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1082/2150] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:28 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:28.427611 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7081ada-68d5-491b-95a0-d3061c7a1785 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:28.429040 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f7081ada-68d5-491b-95a0-d3061c7a1785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:28.460048 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-37a5f8bb-fe57-4069-b672-9dfc13286652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f7e899db2ce4a86b1afd0f0677c1aca', 'request_id': 'req-37a5f8bb-fe57-4069-b672-9dfc13286652'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:28.466198 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-37a5f8bb-fe57-4069-b672-9dfc13286652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f7e899db2ce4a86b1afd0f0677c1aca', 'request_id': 'req-37a5f8bb-fe57-4069-b672-9dfc13286652'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:28.473392 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-37a5f8bb-fe57-4069-b672-9dfc13286652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f7e899db2ce4a86b1afd0f0677c1aca', 'request_id': 'req-37a5f8bb-fe57-4069-b672-9dfc13286652'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:28.486725 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-37a5f8bb-fe57-4069-b672-9dfc13286652 admin admin] The token cache is being invalidate because project 9f7e899db2ce4a86b1afd0f0677c1aca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:56:28.487008 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-37a5f8bb-fe57-4069-b672-9dfc13286652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:28.487644 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-37a5f8bb-fe57-4069-b672-9dfc13286652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:28.489168 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1069/2151] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:56:28 2022] DELETE /identity/v3/projects/9f7e899db2ce4a86b1afd0f0677c1aca => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:28.489691 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7081ada-68d5-491b-95a0-d3061c7a1785 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:28.494036 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897d163-877d-4718-805b-d2e0bc1798dd None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:28.494317 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897d163-877d-4718-805b-d2e0bc1798dd None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:28.494589 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897d163-877d-4718-805b-d2e0bc1798dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:28.513729 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-2897d163-877d-4718-805b-d2e0bc1798dd None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:28.514963 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2897d163-877d-4718-805b-d2e0bc1798dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:28.541597 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f0e9b-3a61-4f37-bc8b-3459f4f1e025 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:28.542293 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f0e9b-3a61-4f37-bc8b-3459f4f1e025 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:28.542584 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f0e9b-3a61-4f37-bc8b-3459f4f1e025 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:28.542848 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f0e9b-3a61-4f37-bc8b-3459f4f1e025 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:28.544797 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b70f0e9b-3a61-4f37-bc8b-3459f4f1e025 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:28.592710 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1070/2152] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:28.601489 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02393b69-2876-430a-96a8-e5f864931786 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:28.601793 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02393b69-2876-430a-96a8-e5f864931786 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:28.602130 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02393b69-2876-430a-96a8-e5f864931786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:28.614321 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f0e9b-3a61-4f37-bc8b-3459f4f1e025 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:28.615777 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f0e9b-3a61-4f37-bc8b-3459f4f1e025 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:28.621871 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-02393b69-2876-430a-96a8-e5f864931786 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:28.623382 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-02393b69-2876-430a-96a8-e5f864931786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:28.625656 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1083/2153] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:28 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:56:28.635823 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1071/2154] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:28.636493 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f0e9b-3a61-4f37-bc8b-3459f4f1e025 service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:28.648017 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f0e9b-3a61-4f37-bc8b-3459f4f1e025 service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:28.652878 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b6fd5-6f01-47d8-9166-c7cc8a62adda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:28.653770 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b6fd5-6f01-47d8-9166-c7cc8a62adda admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:28.654094 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b6fd5-6f01-47d8-9166-c7cc8a62adda admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:28.654388 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b6fd5-6f01-47d8-9166-c7cc8a62adda admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:28.655078 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b6fd5-6f01-47d8-9166-c7cc8a62adda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:56:28.655368 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b6fd5-6f01-47d8-9166-c7cc8a62adda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:28.657051 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b6fd5-6f01-47d8-9166-c7cc8a62adda admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:28.673051 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1084/2155] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:56:28.676390 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02393b69-2876-430a-96a8-e5f864931786 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:28.687657 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02393b69-2876-430a-96a8-e5f864931786 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:28.692432 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738ed49-d4aa-49f4-ae2c-cb5a97e55fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:28.693041 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738ed49-d4aa-49f4-ae2c-cb5a97e55fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:28.693319 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738ed49-d4aa-49f4-ae2c-cb5a97e55fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:28.693597 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738ed49-d4aa-49f4-ae2c-cb5a97e55fd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:28.694277 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738ed49-d4aa-49f4-ae2c-cb5a97e55fd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:28.696182 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738ed49-d4aa-49f4-ae2c-cb5a97e55fd7 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:28.733675 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1072/2156] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:56:28 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:56:28.737399 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b6fd5-6f01-47d8-9166-c7cc8a62adda admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:28.737969 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738ed49-d4aa-49f4-ae2c-cb5a97e55fd7 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:28.739561 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-269b6fd5-6f01-47d8-9166-c7cc8a62adda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:28.752703 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b6fd5-6f01-47d8-9166-c7cc8a62adda admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:28.773214 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:28.790552 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:28.807166 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738ed49-d4aa-49f4-ae2c-cb5a97e55fd7 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:28.807406 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c839f8-e51c-421f-85b6-4e3dfd525150 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:28.807789 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c839f8-e51c-421f-85b6-4e3dfd525150 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:28.808071 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c839f8-e51c-421f-85b6-4e3dfd525150 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:28.808344 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c839f8-e51c-421f-85b6-4e3dfd525150 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:28.810737 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-36c839f8-e51c-421f-85b6-4e3dfd525150 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:28.813236 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9b049-751c-4210-9d7f-fada07700149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:28.814194 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9b049-751c-4210-9d7f-fada07700149 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:28.814516 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9b049-751c-4210-9d7f-fada07700149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:28.814795 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9b049-751c-4210-9d7f-fada07700149 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:28.815931 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9b049-751c-4210-9d7f-fada07700149 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:28.818188 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9b049-751c-4210-9d7f-fada07700149 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:28.844134 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1073/2157] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:56:28 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:56:28.848665 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9b049-751c-4210-9d7f-fada07700149 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:28.859828 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9b049-751c-4210-9d7f-fada07700149 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:28.864901 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0bd00c-e985-46e0-baa1-d7df932f8469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:28.865546 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bd00c-e985-46e0-baa1-d7df932f8469 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:28.865776 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bd00c-e985-46e0-baa1-d7df932f8469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:28.866112 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bd00c-e985-46e0-baa1-d7df932f8469 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:28.866861 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0bd00c-e985-46e0-baa1-d7df932f8469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:28.868376 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0bd00c-e985-46e0-baa1-d7df932f8469 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:28.879379 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1074/2158] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:56:28.881399 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c839f8-e51c-421f-85b6-4e3dfd525150 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:28.882929 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0bd00c-e985-46e0-baa1-d7df932f8469 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:28.883063 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c839f8-e51c-421f-85b6-4e3dfd525150 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:28.892428 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1085/2159] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:28.893142 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0bd00c-e985-46e0-baa1-d7df932f8469 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:28.898145 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae816bb8-7884-4ae1-9c40-9f1a62146690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:28.898689 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae816bb8-7884-4ae1-9c40-9f1a62146690 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:28.898970 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae816bb8-7884-4ae1-9c40-9f1a62146690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:28.899243 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae816bb8-7884-4ae1-9c40-9f1a62146690 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:28.899887 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae816bb8-7884-4ae1-9c40-9f1a62146690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:28.901488 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae816bb8-7884-4ae1-9c40-9f1a62146690 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:28.913676 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1075/2160] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:28.917801 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c839f8-e51c-421f-85b6-4e3dfd525150 service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:28.928621 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c839f8-e51c-421f-85b6-4e3dfd525150 service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:28.933458 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321e8e1-6ec0-4859-b77d-78442c6927af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:28.934017 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321e8e1-6ec0-4859-b77d-78442c6927af admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:28.934328 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321e8e1-6ec0-4859-b77d-78442c6927af admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:28.934899 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321e8e1-6ec0-4859-b77d-78442c6927af admin admin] PATH_INFO: `/v3/projects/c0921a80c4d34c959f142365189bc8bd/users/ab6f617c14234e4ea8de0961b08ee257/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:28.949184 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321e8e1-6ec0-4859-b77d-78442c6927af admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0921a80c4d34c959f142365189bc8bd, user_id=ab6f617c14234e4ea8de0961b08ee257, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:28.951991 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321e8e1-6ec0-4859-b77d-78442c6927af admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:28.969794 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1086/2161] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:56:28 2022] PUT /identity/v3/projects/c0921a80c4d34c959f142365189bc8bd/users/ab6f617c14234e4ea8de0961b08ee257/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:56:28.980425 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c2799-0fd1-4d40-aa3f-5ce9416ec1f5 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:28.980740 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c2799-0fd1-4d40-aa3f-5ce9416ec1f5 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:28.981117 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c2799-0fd1-4d40-aa3f-5ce9416ec1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:29.012148 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-032c2799-0fd1-4d40-aa3f-5ce9416ec1f5 None None] MFA Rules not processed for user `ab6f617c14234e4ea8de0961b08ee257`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:29.013425 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-032c2799-0fd1-4d40-aa3f-5ce9416ec1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:29.085457 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1076/2162] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:29.090129 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321e8e1-6ec0-4859-b77d-78442c6927af admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:29.165061 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321e8e1-6ec0-4859-b77d-78442c6927af admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:29.172304 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93000ec3-fa67-4dda-ac7b-7cd9872de2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:29.172963 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93000ec3-fa67-4dda-ac7b-7cd9872de2b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:29.173280 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93000ec3-fa67-4dda-ac7b-7cd9872de2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:29.173581 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93000ec3-fa67-4dda-ac7b-7cd9872de2b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:29.174325 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93000ec3-fa67-4dda-ac7b-7cd9872de2b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:29.176411 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93000ec3-fa67-4dda-ac7b-7cd9872de2b9 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:29.209271 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1087/2163] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:56:29 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:56:29.212998 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c2799-0fd1-4d40-aa3f-5ce9416ec1f5 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:29.226683 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c2799-0fd1-4d40-aa3f-5ce9416ec1f5 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:29.304426 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ab66b-7474-4d86-86ec-a55569b4a33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:29.305038 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ab66b-7474-4d86-86ec-a55569b4a33d admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:29.306167 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ab66b-7474-4d86-86ec-a55569b4a33d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:29.306459 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ab66b-7474-4d86-86ec-a55569b4a33d admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:29.307281 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ab66b-7474-4d86-86ec-a55569b4a33d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:29.309371 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ab66b-7474-4d86-86ec-a55569b4a33d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:29.333662 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1077/2164] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:56:29 2022] POST /identity/v3/users => generated 299 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:56:29.337441 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93000ec3-fa67-4dda-ac7b-7cd9872de2b9 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:29.347782 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93000ec3-fa67-4dda-ac7b-7cd9872de2b9 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:29.353185 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c907bc-01e5-4a63-b01d-896a467b04b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:29.353796 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c907bc-01e5-4a63-b01d-896a467b04b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:29.354111 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c907bc-01e5-4a63-b01d-896a467b04b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:29.354381 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c907bc-01e5-4a63-b01d-896a467b04b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:29.355025 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c907bc-01e5-4a63-b01d-896a467b04b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:29.356816 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c907bc-01e5-4a63-b01d-896a467b04b1 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:29.369922 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1088/2165] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:29.373423 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ab66b-7474-4d86-86ec-a55569b4a33d admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:29.384123 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ab66b-7474-4d86-86ec-a55569b4a33d admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:29.389180 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dafbcba-1b65-42cb-9b09-533f22351438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:29.389892 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafbcba-1b65-42cb-9b09-533f22351438 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:29.390229 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafbcba-1b65-42cb-9b09-533f22351438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:29.390485 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafbcba-1b65-42cb-9b09-533f22351438 admin admin] PATH_INFO: `/v3/projects/8d7842a9d86544cfb9edcac89ac7c5bb/users/3c8d2a74f4234ba2ac242edc6ed1ab74/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:29.406665 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dafbcba-1b65-42cb-9b09-533f22351438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d7842a9d86544cfb9edcac89ac7c5bb, user_id=3c8d2a74f4234ba2ac242edc6ed1ab74, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:29.410016 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dafbcba-1b65-42cb-9b09-533f22351438 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:29.423825 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1078/2166] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:56:29 2022] PUT /identity/v3/projects/8d7842a9d86544cfb9edcac89ac7c5bb/users/3c8d2a74f4234ba2ac242edc6ed1ab74/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:56:29.427745 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c907bc-01e5-4a63-b01d-896a467b04b1 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:29.439355 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c907bc-01e5-4a63-b01d-896a467b04b1 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:29.468890 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:29.504235 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09754e98-d0f7-428d-959f-7833ad8a7738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:29.504839 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09754e98-d0f7-428d-959f-7833ad8a7738 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:29.505117 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09754e98-d0f7-428d-959f-7833ad8a7738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:29.505395 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09754e98-d0f7-428d-959f-7833ad8a7738 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:29.506072 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09754e98-d0f7-428d-959f-7833ad8a7738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:29.507683 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09754e98-d0f7-428d-959f-7833ad8a7738 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:29.521107 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1089/2167] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:29.522319 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dafbcba-1b65-42cb-9b09-533f22351438 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:29.533073 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dafbcba-1b65-42cb-9b09-533f22351438 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:29.539385 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e7b85-3310-4ac6-ba58-875d5566c854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:29.540415 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e7b85-3310-4ac6-ba58-875d5566c854 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:29.540415 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e7b85-3310-4ac6-ba58-875d5566c854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:29.540624 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e7b85-3310-4ac6-ba58-875d5566c854 admin admin] PATH_INFO: `/v3/projects/8d7842a9d86544cfb9edcac89ac7c5bb/users/3c8d2a74f4234ba2ac242edc6ed1ab74/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:29.542644 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e7b85-3310-4ac6-ba58-875d5566c854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d7842a9d86544cfb9edcac89ac7c5bb, user_id=3c8d2a74f4234ba2ac242edc6ed1ab74, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:29.545768 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e7b85-3310-4ac6-ba58-875d5566c854 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:29.552689 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:29.559678 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1079/2168] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:56:29 2022] PUT /identity/v3/projects/8d7842a9d86544cfb9edcac89ac7c5bb/users/3c8d2a74f4234ba2ac242edc6ed1ab74/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:29.571183 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c5299-dab4-4723-bbd0-a76bf8620e6d None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:29.571476 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c5299-dab4-4723-bbd0-a76bf8620e6d None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:29.571756 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c5299-dab4-4723-bbd0-a76bf8620e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:29.610170 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-226c5299-dab4-4723-bbd0-a76bf8620e6d None None] MFA Rules not processed for user `3c8d2a74f4234ba2ac242edc6ed1ab74`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:29.611444 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-226c5299-dab4-4723-bbd0-a76bf8620e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:29.699685 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1090/2169] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:29 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:29.712229 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e7b85-3310-4ac6-ba58-875d5566c854 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:29.782157 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e7b85-3310-4ac6-ba58-875d5566c854 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:29.786512 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbf22e-1b14-4f9d-9f73-3bed132a8889 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:29.787176 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbf22e-1b14-4f9d-9f73-3bed132a8889 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:29.787460 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbf22e-1b14-4f9d-9f73-3bed132a8889 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:29.787777 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbf22e-1b14-4f9d-9f73-3bed132a8889 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:29.849679 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dbf22e-1b14-4f9d-9f73-3bed132a8889 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:29.851559 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dbf22e-1b14-4f9d-9f73-3bed132a8889 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:29.861406 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1080/2170] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:30.632396 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e609d-19c0-47f6-bc03-4065ecb9914b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:30.632899 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e609d-19c0-47f6-bc03-4065ecb9914b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:30.633008 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e609d-19c0-47f6-bc03-4065ecb9914b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:30.654633 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-367e609d-19c0-47f6-bc03-4065ecb9914b None None] MFA Rules not processed for user `687249b94db247b4b608e416559d0556`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:30.655845 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-367e609d-19c0-47f6-bc03-4065ecb9914b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:30.717061 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1091/2171] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:31.583102 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbf22e-1b14-4f9d-9f73-3bed132a8889 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:31.584740 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-77dbf22e-1b14-4f9d-9f73-3bed132a8889 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:31.686894 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbf22e-1b14-4f9d-9f73-3bed132a8889 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:31.697186 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18c740-73f7-496a-89a6-4f04ec8eb907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:31.697983 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18c740-73f7-496a-89a6-4f04ec8eb907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:31.698267 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18c740-73f7-496a-89a6-4f04ec8eb907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:31.698533 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18c740-73f7-496a-89a6-4f04ec8eb907 admin admin] PATH_INFO: `/v3/users/2dd73c0ffdfc46d283748aa3fe735993` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:31.699946 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18c740-73f7-496a-89a6-4f04ec8eb907 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dd73c0ffdfc46d283748aa3fe735993)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:31.702535 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18c740-73f7-496a-89a6-4f04ec8eb907 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:31.781263 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9d18c740-73f7-496a-89a6-4f04ec8eb907 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dd73c0ffdfc46d283748aa3fe735993'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:31.787572 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:31.798890 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9d18c740-73f7-496a-89a6-4f04ec8eb907 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dd73c0ffdfc46d283748aa3fe735993'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:31.805735 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9d18c740-73f7-496a-89a6-4f04ec8eb907 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dd73c0ffdfc46d283748aa3fe735993'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:31.816038 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9d18c740-73f7-496a-89a6-4f04ec8eb907 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dd73c0ffdfc46d283748aa3fe735993'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:31.816658 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9d18c740-73f7-496a-89a6-4f04ec8eb907 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dd73c0ffdfc46d283748aa3fe735993'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:31.822967 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1081/2172] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:56:31 2022] DELETE /identity/v3/users/2dd73c0ffdfc46d283748aa3fe735993 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:31.827731 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b661ee-89bf-4555-93f6-d8e23fcade74 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:31.828212 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b661ee-89bf-4555-93f6-d8e23fcade74 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:31.828378 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b661ee-89bf-4555-93f6-d8e23fcade74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:31.853207 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-72b661ee-89bf-4555-93f6-d8e23fcade74 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:31.854529 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-72b661ee-89bf-4555-93f6-d8e23fcade74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:31.904189 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:31.916360 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1092/2173] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:56:31.926617 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18c740-73f7-496a-89a6-4f04ec8eb907 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:31.928275 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9d18c740-73f7-496a-89a6-4f04ec8eb907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:31.987284 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18c740-73f7-496a-89a6-4f04ec8eb907 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:31.991828 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38418239-9e6f-449b-94d7-9477d1517cdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:31.992437 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38418239-9e6f-449b-94d7-9477d1517cdd service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:31.992708 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38418239-9e6f-449b-94d7-9477d1517cdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:31.992968 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38418239-9e6f-449b-94d7-9477d1517cdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:32.004231 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38418239-9e6f-449b-94d7-9477d1517cdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:32.005772 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38418239-9e6f-449b-94d7-9477d1517cdd service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:32.016202 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1082/2174] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:32.306237 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b661ee-89bf-4555-93f6-d8e23fcade74 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:32.307647 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-72b661ee-89bf-4555-93f6-d8e23fcade74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:32.321530 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b661ee-89bf-4555-93f6-d8e23fcade74 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:32.326927 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec6be9-bb13-4c03-8a02-eccfc6cb45af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:32.327781 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec6be9-bb13-4c03-8a02-eccfc6cb45af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:32.328085 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec6be9-bb13-4c03-8a02-eccfc6cb45af admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:32.328443 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec6be9-bb13-4c03-8a02-eccfc6cb45af admin admin] PATH_INFO: `/v3/projects/a7e3bd26d0fa4340aff1a1a56cc57f39` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:32.329687 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec6be9-bb13-4c03-8a02-eccfc6cb45af admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7e3bd26d0fa4340aff1a1a56cc57f39)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:32.331767 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec6be9-bb13-4c03-8a02-eccfc6cb45af admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:32.385451 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-60ec6be9-bb13-4c03-8a02-eccfc6cb45af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7e3bd26d0fa4340aff1a1a56cc57f39', 'request_id': 'req-60ec6be9-bb13-4c03-8a02-eccfc6cb45af'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:32.393966 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-60ec6be9-bb13-4c03-8a02-eccfc6cb45af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7e3bd26d0fa4340aff1a1a56cc57f39', 'request_id': 'req-60ec6be9-bb13-4c03-8a02-eccfc6cb45af'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:32.400571 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-60ec6be9-bb13-4c03-8a02-eccfc6cb45af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7e3bd26d0fa4340aff1a1a56cc57f39', 'request_id': 'req-60ec6be9-bb13-4c03-8a02-eccfc6cb45af'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:32.411731 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-60ec6be9-bb13-4c03-8a02-eccfc6cb45af admin admin] The token cache is being invalidate because project a7e3bd26d0fa4340aff1a1a56cc57f39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:56:32.412016 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-60ec6be9-bb13-4c03-8a02-eccfc6cb45af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:32.412895 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-60ec6be9-bb13-4c03-8a02-eccfc6cb45af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:32.414556 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1093/2175] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:56:32 2022] DELETE /identity/v3/projects/a7e3bd26d0fa4340aff1a1a56cc57f39 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:32.418814 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38418239-9e6f-449b-94d7-9477d1517cdd service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:32.428597 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38418239-9e6f-449b-94d7-9477d1517cdd service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:32.489556 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630e256-6509-4c28-adbb-08cd1d7af9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:32.490222 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630e256-6509-4c28-adbb-08cd1d7af9bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:32.490501 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630e256-6509-4c28-adbb-08cd1d7af9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:32.490938 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630e256-6509-4c28-adbb-08cd1d7af9bc admin admin] PATH_INFO: `/v3/users/36b579b6ec074b67a8cf33d9fb1e8b94` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:32.492138 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630e256-6509-4c28-adbb-08cd1d7af9bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=36b579b6ec074b67a8cf33d9fb1e8b94)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:32.494160 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630e256-6509-4c28-adbb-08cd1d7af9bc admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:32.551392 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-2630e256-6509-4c28-adbb-08cd1d7af9bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36b579b6ec074b67a8cf33d9fb1e8b94'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:32.563370 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-2630e256-6509-4c28-adbb-08cd1d7af9bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36b579b6ec074b67a8cf33d9fb1e8b94'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:32.570189 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-2630e256-6509-4c28-adbb-08cd1d7af9bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36b579b6ec074b67a8cf33d9fb1e8b94'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:32.572778 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:32.579363 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-2630e256-6509-4c28-adbb-08cd1d7af9bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36b579b6ec074b67a8cf33d9fb1e8b94'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:32.580172 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-2630e256-6509-4c28-adbb-08cd1d7af9bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36b579b6ec074b67a8cf33d9fb1e8b94'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:32.587378 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1083/2176] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:56:32 2022] DELETE /identity/v3/users/36b579b6ec074b67a8cf33d9fb1e8b94 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:32.974961 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec6be9-bb13-4c03-8a02-eccfc6cb45af admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:32.977368 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-60ec6be9-bb13-4c03-8a02-eccfc6cb45af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:33.010368 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec6be9-bb13-4c03-8a02-eccfc6cb45af admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:33.102565 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1595f40-55d1-43e3-a44f-ae0395b9d253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:33.103307 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1595f40-55d1-43e3-a44f-ae0395b9d253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:33.103683 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1595f40-55d1-43e3-a44f-ae0395b9d253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:33.104012 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1595f40-55d1-43e3-a44f-ae0395b9d253 admin admin] PATH_INFO: `/v3/projects/bf4ee75d06af4f32837c513f13296f57` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:33.107408 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1595f40-55d1-43e3-a44f-ae0395b9d253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf4ee75d06af4f32837c513f13296f57)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:33.109411 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1595f40-55d1-43e3-a44f-ae0395b9d253 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:33.188132 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c1595f40-55d1-43e3-a44f-ae0395b9d253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf4ee75d06af4f32837c513f13296f57', 'request_id': 'req-c1595f40-55d1-43e3-a44f-ae0395b9d253'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:33.196713 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c1595f40-55d1-43e3-a44f-ae0395b9d253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf4ee75d06af4f32837c513f13296f57', 'request_id': 'req-c1595f40-55d1-43e3-a44f-ae0395b9d253'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:33.206529 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c1595f40-55d1-43e3-a44f-ae0395b9d253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf4ee75d06af4f32837c513f13296f57', 'request_id': 'req-c1595f40-55d1-43e3-a44f-ae0395b9d253'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:33.222475 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c1595f40-55d1-43e3-a44f-ae0395b9d253 admin admin] The token cache is being invalidate because project bf4ee75d06af4f32837c513f13296f57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:56:33.222779 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c1595f40-55d1-43e3-a44f-ae0395b9d253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:33.223447 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c1595f40-55d1-43e3-a44f-ae0395b9d253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:33.225665 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1094/2177] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:56:32 2022] DELETE /identity/v3/projects/bf4ee75d06af4f32837c513f13296f57 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:33.231564 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281078dd-024f-480d-9f44-7f1285c0d5b0 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:33.232103 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281078dd-024f-480d-9f44-7f1285c0d5b0 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:33.232239 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281078dd-024f-480d-9f44-7f1285c0d5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:33.257617 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-281078dd-024f-480d-9f44-7f1285c0d5b0 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:33.259262 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-281078dd-024f-480d-9f44-7f1285c0d5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:33.325864 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1084/2178] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:33.333536 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cfeef-66ae-460b-b2cc-ff632aeb2d3d None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:33.333829 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cfeef-66ae-460b-b2cc-ff632aeb2d3d None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:33.334125 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cfeef-66ae-460b-b2cc-ff632aeb2d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:33.349030 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:33.355547 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-e16cfeef-66ae-460b-b2cc-ff632aeb2d3d None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:33.357234 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e16cfeef-66ae-460b-b2cc-ff632aeb2d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:33.369324 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1095/2179] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:33.370551 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281078dd-024f-480d-9f44-7f1285c0d5b0 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:33.381305 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281078dd-024f-480d-9f44-7f1285c0d5b0 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:33.385599 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b4d4a-67d9-4d1e-ba34-69b06121aaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:33.386250 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b4d4a-67d9-4d1e-ba34-69b06121aaab admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:33.386524 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b4d4a-67d9-4d1e-ba34-69b06121aaab admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:33.386788 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b4d4a-67d9-4d1e-ba34-69b06121aaab admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:33.387495 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b4d4a-67d9-4d1e-ba34-69b06121aaab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:56:33.387837 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b4d4a-67d9-4d1e-ba34-69b06121aaab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:33.389403 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b4d4a-67d9-4d1e-ba34-69b06121aaab admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:33.402849 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1085/2180] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:56:33.407976 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16cfeef-66ae-460b-b2cc-ff632aeb2d3d None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:33.418252 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16cfeef-66ae-460b-b2cc-ff632aeb2d3d None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:33.423437 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071db12d-3155-4555-91a1-df349be8d311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:33.424055 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071db12d-3155-4555-91a1-df349be8d311 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:33.424327 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071db12d-3155-4555-91a1-df349be8d311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:33.424594 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071db12d-3155-4555-91a1-df349be8d311 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:33.425231 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071db12d-3155-4555-91a1-df349be8d311 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:33.427180 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071db12d-3155-4555-91a1-df349be8d311 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:33.461238 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1096/2181] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:56:33 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:56:33.462552 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b4d4a-67d9-4d1e-ba34-69b06121aaab admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:33.473502 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b4d4a-67d9-4d1e-ba34-69b06121aaab admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:33.537495 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbfd14-39b7-4b9b-b255-3a3a573e5faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:33.538598 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbfd14-39b7-4b9b-b255-3a3a573e5faf admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:33.539027 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbfd14-39b7-4b9b-b255-3a3a573e5faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:33.539475 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbfd14-39b7-4b9b-b255-3a3a573e5faf admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:33.540112 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbfd14-39b7-4b9b-b255-3a3a573e5faf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:33.542195 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbfd14-39b7-4b9b-b255-3a3a573e5faf admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:33.565451 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1086/2182] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:56:33 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:56:33.570436 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071db12d-3155-4555-91a1-df349be8d311 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:33.581390 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071db12d-3155-4555-91a1-df349be8d311 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:33.589082 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc721e-f981-4305-a472-71038cbe5195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:33.589706 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc721e-f981-4305-a472-71038cbe5195 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:33.590017 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc721e-f981-4305-a472-71038cbe5195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:33.590282 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc721e-f981-4305-a472-71038cbe5195 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:33.591095 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc721e-f981-4305-a472-71038cbe5195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:33.592718 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc721e-f981-4305-a472-71038cbe5195 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:33.604520 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1097/2183] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:56:33.608829 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbfd14-39b7-4b9b-b255-3a3a573e5faf admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:33.620816 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbfd14-39b7-4b9b-b255-3a3a573e5faf admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:33.626217 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336140b1-f689-4ea0-a286-f60fdc50e555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:33.627143 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336140b1-f689-4ea0-a286-f60fdc50e555 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:33.627425 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336140b1-f689-4ea0-a286-f60fdc50e555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:33.627711 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336140b1-f689-4ea0-a286-f60fdc50e555 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:33.628350 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336140b1-f689-4ea0-a286-f60fdc50e555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:33.630060 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336140b1-f689-4ea0-a286-f60fdc50e555 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:33.642785 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1087/2184] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:33.647044 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc721e-f981-4305-a472-71038cbe5195 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:33.659974 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc721e-f981-4305-a472-71038cbe5195 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:33.665179 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc2129-5e90-47eb-81b7-6edfcfb2ae2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:33.665871 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc2129-5e90-47eb-81b7-6edfcfb2ae2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:33.666165 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc2129-5e90-47eb-81b7-6edfcfb2ae2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:33.666443 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc2129-5e90-47eb-81b7-6edfcfb2ae2c admin admin] PATH_INFO: `/v3/projects/79d80697e0564f6baa10af46a9d0150e/users/483d4427a02a4e7c92bd48739a436ae4/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:33.687659 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc2129-5e90-47eb-81b7-6edfcfb2ae2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=79d80697e0564f6baa10af46a9d0150e, user_id=483d4427a02a4e7c92bd48739a436ae4, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:33.691422 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc2129-5e90-47eb-81b7-6edfcfb2ae2c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:33.706946 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1098/2185] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:56:33 2022] PUT /identity/v3/projects/79d80697e0564f6baa10af46a9d0150e/users/483d4427a02a4e7c92bd48739a436ae4/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:56:33.718575 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e0bf8-419c-42dd-a0b7-6a8e626b5765 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:33.718887 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e0bf8-419c-42dd-a0b7-6a8e626b5765 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:33.719158 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e0bf8-419c-42dd-a0b7-6a8e626b5765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:33.751127 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f75e0bf8-419c-42dd-a0b7-6a8e626b5765 None None] MFA Rules not processed for user `483d4427a02a4e7c92bd48739a436ae4`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:33.752397 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f75e0bf8-419c-42dd-a0b7-6a8e626b5765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:33.807521 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:33.829404 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1088/2186] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:33.834008 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc2129-5e90-47eb-81b7-6edfcfb2ae2c admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:33.905134 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc2129-5e90-47eb-81b7-6edfcfb2ae2c admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:33.919737 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67262f36-b140-469f-87fe-4341a5ff0836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:33.920373 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67262f36-b140-469f-87fe-4341a5ff0836 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:33.920651 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67262f36-b140-469f-87fe-4341a5ff0836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:33.920920 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67262f36-b140-469f-87fe-4341a5ff0836 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:33.921625 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67262f36-b140-469f-87fe-4341a5ff0836 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:33.923596 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67262f36-b140-469f-87fe-4341a5ff0836 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:33.970092 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1099/2187] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:56:33 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:56:33.972691 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e0bf8-419c-42dd-a0b7-6a8e626b5765 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:33.986636 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e0bf8-419c-42dd-a0b7-6a8e626b5765 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:34.049333 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e081c7a-3433-464d-8027-be4f526c3263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:34.050371 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e081c7a-3433-464d-8027-be4f526c3263 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:34.050917 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e081c7a-3433-464d-8027-be4f526c3263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:34.051274 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e081c7a-3433-464d-8027-be4f526c3263 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:34.052201 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e081c7a-3433-464d-8027-be4f526c3263 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:34.054390 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e081c7a-3433-464d-8027-be4f526c3263 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:34.082957 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1089/2188] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:56:33 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:56:34.084462 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67262f36-b140-469f-87fe-4341a5ff0836 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:34.095923 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67262f36-b140-469f-87fe-4341a5ff0836 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:34.101551 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719fbd6-9fcc-416a-b522-23d1a7c09fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:34.106518 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719fbd6-9fcc-416a-b522-23d1a7c09fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:34.106803 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719fbd6-9fcc-416a-b522-23d1a7c09fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:34.107081 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719fbd6-9fcc-416a-b522-23d1a7c09fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:34.107835 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719fbd6-9fcc-416a-b522-23d1a7c09fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:34.109553 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719fbd6-9fcc-416a-b522-23d1a7c09fc9 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:34.120699 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1100/2189] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:56:34.124937 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e081c7a-3433-464d-8027-be4f526c3263 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:34.136626 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e081c7a-3433-464d-8027-be4f526c3263 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:34.141440 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e38051-348e-471d-8a71-735e423b8e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:34.142085 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e38051-348e-471d-8a71-735e423b8e02 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:34.142364 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e38051-348e-471d-8a71-735e423b8e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:34.142628 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e38051-348e-471d-8a71-735e423b8e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:34.143273 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e38051-348e-471d-8a71-735e423b8e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:34.144893 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e38051-348e-471d-8a71-735e423b8e02 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:34.156351 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1090/2190] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:34.160776 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719fbd6-9fcc-416a-b522-23d1a7c09fc9 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:34.174059 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719fbd6-9fcc-416a-b522-23d1a7c09fc9 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:34.178761 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2737b-f647-4100-a19f-39a042aa0327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:34.179463 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2737b-f647-4100-a19f-39a042aa0327 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:34.179742 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2737b-f647-4100-a19f-39a042aa0327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:34.180014 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2737b-f647-4100-a19f-39a042aa0327 admin admin] PATH_INFO: `/v3/projects/9927875af43b4a7b8fb5f1d3c806d67c/users/efea56ada5db418db8347769b73b3c46/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:34.196536 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d2737b-f647-4100-a19f-39a042aa0327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9927875af43b4a7b8fb5f1d3c806d67c, user_id=efea56ada5db418db8347769b73b3c46, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:34.199166 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d2737b-f647-4100-a19f-39a042aa0327 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:34.216624 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1101/2191] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:56:34 2022] PUT /identity/v3/projects/9927875af43b4a7b8fb5f1d3c806d67c/users/efea56ada5db418db8347769b73b3c46/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:34.227236 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de646d5-dbce-431a-aa03-cf774811b54f None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:34.227511 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de646d5-dbce-431a-aa03-cf774811b54f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:34.227861 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de646d5-dbce-431a-aa03-cf774811b54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:34.256408 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-5de646d5-dbce-431a-aa03-cf774811b54f None None] MFA Rules not processed for user `efea56ada5db418db8347769b73b3c46`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:34.258611 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5de646d5-dbce-431a-aa03-cf774811b54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:34.332215 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1091/2192] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:34.336592 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2737b-f647-4100-a19f-39a042aa0327 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:34.382737 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de646d5-dbce-431a-aa03-cf774811b54f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:34.384198 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5de646d5-dbce-431a-aa03-cf774811b54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:34.404853 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:34.415843 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2737b-f647-4100-a19f-39a042aa0327 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:34.422776 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4737556-d92f-4130-82d1-9e31350c95ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:34.424450 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4737556-d92f-4130-82d1-9e31350c95ce admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:34.424749 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4737556-d92f-4130-82d1-9e31350c95ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:34.425063 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4737556-d92f-4130-82d1-9e31350c95ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:34.426395 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4737556-d92f-4130-82d1-9e31350c95ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:34.428845 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4737556-d92f-4130-82d1-9e31350c95ce admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:34.456949 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de646d5-dbce-431a-aa03-cf774811b54f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:34.460600 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1102/2193] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:56:34 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:56:34.464803 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4737556-d92f-4130-82d1-9e31350c95ce admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:34.466749 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28abbb-a6ee-4c6b-bc8f-7174d9143324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:34.467384 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28abbb-a6ee-4c6b-bc8f-7174d9143324 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:34.467658 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28abbb-a6ee-4c6b-bc8f-7174d9143324 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:34.467927 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28abbb-a6ee-4c6b-bc8f-7174d9143324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:34.470042 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9f28abbb-a6ee-4c6b-bc8f-7174d9143324 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:34.485096 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:34.543010 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4737556-d92f-4130-82d1-9e31350c95ce admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:34.548375 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2aa9d-d037-499c-82ed-f776f35244c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:34.548946 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2aa9d-d037-499c-82ed-f776f35244c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:34.549237 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2aa9d-d037-499c-82ed-f776f35244c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:34.550043 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2aa9d-d037-499c-82ed-f776f35244c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:34.550217 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad2aa9d-d037-499c-82ed-f776f35244c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:34.555744 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad2aa9d-d037-499c-82ed-f776f35244c9 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:34.555971 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28abbb-a6ee-4c6b-bc8f-7174d9143324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:34.556762 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28abbb-a6ee-4c6b-bc8f-7174d9143324 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:34.567756 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1092/2194] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:34 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:56:34.583026 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1103/2195] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:56:34 2022] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:56:34.584606 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28abbb-a6ee-4c6b-bc8f-7174d9143324 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:34.596351 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28abbb-a6ee-4c6b-bc8f-7174d9143324 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:34.603244 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5031d-0ea4-4bca-acde-f4288d6fc5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:34.604113 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5031d-0ea4-4bca-acde-f4288d6fc5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:34.604588 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5031d-0ea4-4bca-acde-f4288d6fc5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:34.605295 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5031d-0ea4-4bca-acde-f4288d6fc5e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:34.607312 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5031d-0ea4-4bca-acde-f4288d6fc5e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:34.610285 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5031d-0ea4-4bca-acde-f4288d6fc5e8 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:34.621719 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1093/2196] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:34.626666 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2aa9d-d037-499c-82ed-f776f35244c9 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:34.639604 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2aa9d-d037-499c-82ed-f776f35244c9 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:34.644774 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220f9f7-fe40-40af-8f35-7b0700efa226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:34.645462 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220f9f7-fe40-40af-8f35-7b0700efa226 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:34.645737 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220f9f7-fe40-40af-8f35-7b0700efa226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:34.646044 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220f9f7-fe40-40af-8f35-7b0700efa226 admin admin] PATH_INFO: `/v3/projects/a7d0c97bd1b2483e90b0c990713bee60/users/df0dbb79b97f46b9854139412780c073/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:34.667370 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220f9f7-fe40-40af-8f35-7b0700efa226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7d0c97bd1b2483e90b0c990713bee60, user_id=df0dbb79b97f46b9854139412780c073, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:34.670446 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220f9f7-fe40-40af-8f35-7b0700efa226 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:34.686526 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1104/2197] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:56:34 2022] PUT /identity/v3/projects/a7d0c97bd1b2483e90b0c990713bee60/users/df0dbb79b97f46b9854139412780c073/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:56:34.691428 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5031d-0ea4-4bca-acde-f4288d6fc5e8 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:34.705285 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5031d-0ea4-4bca-acde-f4288d6fc5e8 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:34.804659 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ffbd0d-801a-4135-8cd4-4ac3b2023a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:34.805314 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffbd0d-801a-4135-8cd4-4ac3b2023a79 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:34.805611 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffbd0d-801a-4135-8cd4-4ac3b2023a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:34.805919 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffbd0d-801a-4135-8cd4-4ac3b2023a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:34.806575 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ffbd0d-801a-4135-8cd4-4ac3b2023a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:34.808196 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ffbd0d-801a-4135-8cd4-4ac3b2023a79 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:34.824117 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1094/2198] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:34.825325 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220f9f7-fe40-40af-8f35-7b0700efa226 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:34.836473 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220f9f7-fe40-40af-8f35-7b0700efa226 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:34.843645 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db4715-d09b-4570-9f46-60e469695a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:34.843645 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db4715-d09b-4570-9f46-60e469695a94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:34.843645 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db4715-d09b-4570-9f46-60e469695a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:34.843645 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db4715-d09b-4570-9f46-60e469695a94 admin admin] PATH_INFO: `/v3/projects/a7d0c97bd1b2483e90b0c990713bee60/users/df0dbb79b97f46b9854139412780c073/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:34.846103 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db4715-d09b-4570-9f46-60e469695a94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7d0c97bd1b2483e90b0c990713bee60, user_id=df0dbb79b97f46b9854139412780c073, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:34.849328 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db4715-d09b-4570-9f46-60e469695a94 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:34.871317 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1105/2199] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:56:34 2022] PUT /identity/v3/projects/a7d0c97bd1b2483e90b0c990713bee60/users/df0dbb79b97f46b9854139412780c073/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:56:34.874373 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239770a6-2229-43ee-b188-11c4e81c7f49 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:34.874373 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239770a6-2229-43ee-b188-11c4e81c7f49 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:34.874892 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239770a6-2229-43ee-b188-11c4e81c7f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:34.911441 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-239770a6-2229-43ee-b188-11c4e81c7f49 None None] MFA Rules not processed for user `df0dbb79b97f46b9854139412780c073`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:34.915287 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-239770a6-2229-43ee-b188-11c4e81c7f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:35.053476 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1095/2200] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:56:35.061692 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db4715-d09b-4570-9f46-60e469695a94 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:35.129904 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db4715-d09b-4570-9f46-60e469695a94 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:35.134548 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff9d6b-bb5f-4ae2-8745-4512b941b9a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:35.135374 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff9d6b-bb5f-4ae2-8745-4512b941b9a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:35.135751 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff9d6b-bb5f-4ae2-8745-4512b941b9a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:35.136029 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff9d6b-bb5f-4ae2-8745-4512b941b9a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:35.183276 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:35.200799 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff9d6b-bb5f-4ae2-8745-4512b941b9a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:35.202382 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff9d6b-bb5f-4ae2-8745-4512b941b9a9 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:35.212837 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1106/2201] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:36.744828 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239770a6-2229-43ee-b188-11c4e81c7f49 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:36.746370 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-239770a6-2229-43ee-b188-11c4e81c7f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:36.759434 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239770a6-2229-43ee-b188-11c4e81c7f49 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:36.763066 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e1ced-b0e0-4283-a4f5-16207cbd58a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:36.763662 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e1ced-b0e0-4283-a4f5-16207cbd58a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:36.763934 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e1ced-b0e0-4283-a4f5-16207cbd58a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:36.764194 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e1ced-b0e0-4283-a4f5-16207cbd58a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:36.777627 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:36.826514 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e1ced-b0e0-4283-a4f5-16207cbd58a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:36.827955 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e1ced-b0e0-4283-a4f5-16207cbd58a3 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:36.836784 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1096/2202] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:37.441398 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff9d6b-bb5f-4ae2-8745-4512b941b9a9 service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:37.452395 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff9d6b-bb5f-4ae2-8745-4512b941b9a9 service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:37.456866 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a9c5a-3c0b-401c-abda-0626a608fb8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:37.457582 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a9c5a-3c0b-401c-abda-0626a608fb8b service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:37.457960 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a9c5a-3c0b-401c-abda-0626a608fb8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:37.458473 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a9c5a-3c0b-401c-abda-0626a608fb8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:37.472993 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a9c5a-3c0b-401c-abda-0626a608fb8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:37.474619 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a9c5a-3c0b-401c-abda-0626a608fb8b service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:37.485796 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1107/2203] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:37 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:39.676844 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e1ced-b0e0-4283-a4f5-16207cbd58a3 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:39.678918 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-343e1ced-b0e0-4283-a4f5-16207cbd58a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:39.751867 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e1ced-b0e0-4283-a4f5-16207cbd58a3 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:39.756727 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c3907-a0b0-4c59-93e5-c2c30a55f2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:39.757379 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c3907-a0b0-4c59-93e5-c2c30a55f2a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:39.757629 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c3907-a0b0-4c59-93e5-c2c30a55f2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:39.757931 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c3907-a0b0-4c59-93e5-c2c30a55f2a2 admin admin] PATH_INFO: `/v3/users/ab6f617c14234e4ea8de0961b08ee257` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:39.759112 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c3907-a0b0-4c59-93e5-c2c30a55f2a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab6f617c14234e4ea8de0961b08ee257)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:39.761071 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c3907-a0b0-4c59-93e5-c2c30a55f2a2 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:39.810576 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c54c3907-a0b0-4c59-93e5-c2c30a55f2a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab6f617c14234e4ea8de0961b08ee257'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:39.822975 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c54c3907-a0b0-4c59-93e5-c2c30a55f2a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab6f617c14234e4ea8de0961b08ee257'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:39.832674 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c54c3907-a0b0-4c59-93e5-c2c30a55f2a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab6f617c14234e4ea8de0961b08ee257'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:39.843161 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c54c3907-a0b0-4c59-93e5-c2c30a55f2a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab6f617c14234e4ea8de0961b08ee257'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:39.843850 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c54c3907-a0b0-4c59-93e5-c2c30a55f2a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab6f617c14234e4ea8de0961b08ee257'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:39.854094 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1097/2204] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:56:39 2022] DELETE /identity/v3/users/ab6f617c14234e4ea8de0961b08ee257 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:39.857200 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81b9c5-df0e-463c-8f53-d7ab31dffe23 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:39.857675 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81b9c5-df0e-463c-8f53-d7ab31dffe23 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:39.857762 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81b9c5-df0e-463c-8f53-d7ab31dffe23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:39.877663 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-fb81b9c5-df0e-463c-8f53-d7ab31dffe23 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:39.878961 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-fb81b9c5-df0e-463c-8f53-d7ab31dffe23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:39.939598 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1108/2205] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:39.948711 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c3907-a0b0-4c59-93e5-c2c30a55f2a2 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:39.950369 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c54c3907-a0b0-4c59-93e5-c2c30a55f2a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:39.994861 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:40.014797 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c3907-a0b0-4c59-93e5-c2c30a55f2a2 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:40.018639 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfadbd38-3297-4592-a1ab-c36676f7904f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:40.019231 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadbd38-3297-4592-a1ab-c36676f7904f service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:40.019505 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadbd38-3297-4592-a1ab-c36676f7904f service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:40.019776 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadbd38-3297-4592-a1ab-c36676f7904f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:40.028999 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfadbd38-3297-4592-a1ab-c36676f7904f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:40.030474 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfadbd38-3297-4592-a1ab-c36676f7904f service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:40.039540 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1098/2206] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:56:40.322479 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81b9c5-df0e-463c-8f53-d7ab31dffe23 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:40.322479 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-fb81b9c5-df0e-463c-8f53-d7ab31dffe23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:40.340096 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81b9c5-df0e-463c-8f53-d7ab31dffe23 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:40.345895 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05049a44-7db3-444a-8a9e-cfeb5a1fca86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:40.346544 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05049a44-7db3-444a-8a9e-cfeb5a1fca86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:40.346824 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05049a44-7db3-444a-8a9e-cfeb5a1fca86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:40.347098 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05049a44-7db3-444a-8a9e-cfeb5a1fca86 admin admin] PATH_INFO: `/v3/projects/c0921a80c4d34c959f142365189bc8bd` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:40.348221 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05049a44-7db3-444a-8a9e-cfeb5a1fca86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0921a80c4d34c959f142365189bc8bd)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:40.351661 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05049a44-7db3-444a-8a9e-cfeb5a1fca86 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:40.401235 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-05049a44-7db3-444a-8a9e-cfeb5a1fca86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0921a80c4d34c959f142365189bc8bd', 'request_id': 'req-05049a44-7db3-444a-8a9e-cfeb5a1fca86'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:40.414044 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-05049a44-7db3-444a-8a9e-cfeb5a1fca86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0921a80c4d34c959f142365189bc8bd', 'request_id': 'req-05049a44-7db3-444a-8a9e-cfeb5a1fca86'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:40.421337 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-05049a44-7db3-444a-8a9e-cfeb5a1fca86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0921a80c4d34c959f142365189bc8bd', 'request_id': 'req-05049a44-7db3-444a-8a9e-cfeb5a1fca86'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:40.432266 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-05049a44-7db3-444a-8a9e-cfeb5a1fca86 admin admin] The token cache is being invalidate because project c0921a80c4d34c959f142365189bc8bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:56:40.432660 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-05049a44-7db3-444a-8a9e-cfeb5a1fca86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:40.433388 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-05049a44-7db3-444a-8a9e-cfeb5a1fca86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:40.434973 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1109/2207] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:56:40 2022] DELETE /identity/v3/projects/c0921a80c4d34c959f142365189bc8bd => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:40.439102 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfadbd38-3297-4592-a1ab-c36676f7904f service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:40.454822 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfadbd38-3297-4592-a1ab-c36676f7904f service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:40.514950 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925fc87-d0c5-4275-8188-1a08bb5d30c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:40.515612 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925fc87-d0c5-4275-8188-1a08bb5d30c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:40.516045 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925fc87-d0c5-4275-8188-1a08bb5d30c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:40.516195 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925fc87-d0c5-4275-8188-1a08bb5d30c2 admin admin] PATH_INFO: `/v3/users/3c8d2a74f4234ba2ac242edc6ed1ab74` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:40.517250 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925fc87-d0c5-4275-8188-1a08bb5d30c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c8d2a74f4234ba2ac242edc6ed1ab74)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:40.519213 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925fc87-d0c5-4275-8188-1a08bb5d30c2 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:40.581214 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d925fc87-d0c5-4275-8188-1a08bb5d30c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c8d2a74f4234ba2ac242edc6ed1ab74'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:40.593920 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d925fc87-d0c5-4275-8188-1a08bb5d30c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c8d2a74f4234ba2ac242edc6ed1ab74'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:40.600614 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d925fc87-d0c5-4275-8188-1a08bb5d30c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c8d2a74f4234ba2ac242edc6ed1ab74'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:40.610325 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d925fc87-d0c5-4275-8188-1a08bb5d30c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c8d2a74f4234ba2ac242edc6ed1ab74'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:40.611187 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d925fc87-d0c5-4275-8188-1a08bb5d30c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c8d2a74f4234ba2ac242edc6ed1ab74'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:40.619013 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1099/2208] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:56:40 2022] DELETE /identity/v3/users/3c8d2a74f4234ba2ac242edc6ed1ab74 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:40.928078 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05049a44-7db3-444a-8a9e-cfeb5a1fca86 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:40.929684 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-05049a44-7db3-444a-8a9e-cfeb5a1fca86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:40.947804 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05049a44-7db3-444a-8a9e-cfeb5a1fca86 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:41.002700 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:41.020862 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201312b6-6419-4449-808b-7af350b79f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:41.022002 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201312b6-6419-4449-808b-7af350b79f40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:41.022747 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201312b6-6419-4449-808b-7af350b79f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:41.023252 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201312b6-6419-4449-808b-7af350b79f40 admin admin] PATH_INFO: `/v3/projects/8d7842a9d86544cfb9edcac89ac7c5bb` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:41.025873 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201312b6-6419-4449-808b-7af350b79f40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d7842a9d86544cfb9edcac89ac7c5bb)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:41.028462 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201312b6-6419-4449-808b-7af350b79f40 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:41.097020 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-201312b6-6419-4449-808b-7af350b79f40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d7842a9d86544cfb9edcac89ac7c5bb', 'request_id': 'req-201312b6-6419-4449-808b-7af350b79f40'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:41.105483 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-201312b6-6419-4449-808b-7af350b79f40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d7842a9d86544cfb9edcac89ac7c5bb', 'request_id': 'req-201312b6-6419-4449-808b-7af350b79f40'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:41.112291 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-201312b6-6419-4449-808b-7af350b79f40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d7842a9d86544cfb9edcac89ac7c5bb', 'request_id': 'req-201312b6-6419-4449-808b-7af350b79f40'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:41.122938 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-201312b6-6419-4449-808b-7af350b79f40 admin admin] The token cache is being invalidate because project 8d7842a9d86544cfb9edcac89ac7c5bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:56:41.123232 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-201312b6-6419-4449-808b-7af350b79f40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:41.123886 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-201312b6-6419-4449-808b-7af350b79f40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:41.125550 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1110/2209] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:56:40 2022] DELETE /identity/v3/projects/8d7842a9d86544cfb9edcac89ac7c5bb => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:41.135575 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186bfe9-686c-47c3-ba0f-4d6e5d4c2d3f None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:41.136046 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186bfe9-686c-47c3-ba0f-4d6e5d4c2d3f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:41.136163 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186bfe9-686c-47c3-ba0f-4d6e5d4c2d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:41.156407 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-4186bfe9-686c-47c3-ba0f-4d6e5d4c2d3f None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:41.157465 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4186bfe9-686c-47c3-ba0f-4d6e5d4c2d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:41.241141 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:41.254023 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1100/2210] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:41.262016 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851c53a-38c5-42b1-bf11-c27c0d69f342 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:41.262323 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851c53a-38c5-42b1-bf11-c27c0d69f342 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:41.263705 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851c53a-38c5-42b1-bf11-c27c0d69f342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:41.286184 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-8851c53a-38c5-42b1-bf11-c27c0d69f342 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:41.289009 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8851c53a-38c5-42b1-bf11-c27c0d69f342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:41.299513 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1111/2211] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:41.303866 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186bfe9-686c-47c3-ba0f-4d6e5d4c2d3f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:41.320079 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186bfe9-686c-47c3-ba0f-4d6e5d4c2d3f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:41.326246 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154e0f5-782c-47d5-9155-c235d976b33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:41.326839 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154e0f5-782c-47d5-9155-c235d976b33e admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:41.327117 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154e0f5-782c-47d5-9155-c235d976b33e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:41.327389 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154e0f5-782c-47d5-9155-c235d976b33e admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:41.328210 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154e0f5-782c-47d5-9155-c235d976b33e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:56:41.328518 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154e0f5-782c-47d5-9155-c235d976b33e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:41.330210 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154e0f5-782c-47d5-9155-c235d976b33e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:41.359296 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1101/2212] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:56:41.366580 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851c53a-38c5-42b1-bf11-c27c0d69f342 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:41.382227 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851c53a-38c5-42b1-bf11-c27c0d69f342 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:41.394121 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2fcf6-6b04-4580-bfb0-176dc97f8eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:41.394696 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2fcf6-6b04-4580-bfb0-176dc97f8eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:41.395060 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2fcf6-6b04-4580-bfb0-176dc97f8eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:41.396065 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2fcf6-6b04-4580-bfb0-176dc97f8eb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:41.396386 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2fcf6-6b04-4580-bfb0-176dc97f8eb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:41.398764 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2fcf6-6b04-4580-bfb0-176dc97f8eb9 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:41.443724 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1112/2213] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:56:41 2022] POST /identity/v3/projects => generated 371 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:56:41.448747 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154e0f5-782c-47d5-9155-c235d976b33e admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:41.470699 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154e0f5-782c-47d5-9155-c235d976b33e admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:41.544836 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d3b13-bdc0-4846-a528-487e85234420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:41.545455 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d3b13-bdc0-4846-a528-487e85234420 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:41.545737 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d3b13-bdc0-4846-a528-487e85234420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:41.546047 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d3b13-bdc0-4846-a528-487e85234420 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:41.547146 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d3b13-bdc0-4846-a528-487e85234420 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:41.549480 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d3b13-bdc0-4846-a528-487e85234420 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:41.572197 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1102/2214] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:56:41 2022] POST /identity/v3/users => generated 286 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:56:41.576374 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2fcf6-6b04-4580-bfb0-176dc97f8eb9 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:41.586736 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2fcf6-6b04-4580-bfb0-176dc97f8eb9 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:41.591419 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8658c-288a-4818-80e6-70f2f132548f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:41.592026 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8658c-288a-4818-80e6-70f2f132548f admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:41.592419 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8658c-288a-4818-80e6-70f2f132548f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:41.592694 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8658c-288a-4818-80e6-70f2f132548f admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:41.593349 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8658c-288a-4818-80e6-70f2f132548f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:41.594987 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8658c-288a-4818-80e6-70f2f132548f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:41.609751 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1113/2215] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:41.611107 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d3b13-bdc0-4846-a528-487e85234420 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:41.622581 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d3b13-bdc0-4846-a528-487e85234420 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:41.628519 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959be98f-64a0-4e01-864a-d7a215db6238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:41.629206 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959be98f-64a0-4e01-864a-d7a215db6238 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:41.629557 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959be98f-64a0-4e01-864a-d7a215db6238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:41.629946 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959be98f-64a0-4e01-864a-d7a215db6238 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:41.630675 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959be98f-64a0-4e01-864a-d7a215db6238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:41.632522 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959be98f-64a0-4e01-864a-d7a215db6238 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:41.648781 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1103/2216] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:41.650116 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8658c-288a-4818-80e6-70f2f132548f admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:41.662179 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8658c-288a-4818-80e6-70f2f132548f admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:41.667171 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bcd9e0-ab2c-457b-b583-af396ffa29fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:41.667964 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcd9e0-ab2c-457b-b583-af396ffa29fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:41.668246 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcd9e0-ab2c-457b-b583-af396ffa29fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:41.668519 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcd9e0-ab2c-457b-b583-af396ffa29fe admin admin] PATH_INFO: `/v3/projects/4e8d451e986a412cb6ebe7cb4a53b34a/users/58154820ef744238b008136db5cf0f9c/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:41.685054 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bcd9e0-ab2c-457b-b583-af396ffa29fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e8d451e986a412cb6ebe7cb4a53b34a, user_id=58154820ef744238b008136db5cf0f9c, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:41.688415 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bcd9e0-ab2c-457b-b583-af396ffa29fe admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:41.702469 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1114/2217] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:56:41 2022] PUT /identity/v3/projects/4e8d451e986a412cb6ebe7cb4a53b34a/users/58154820ef744238b008136db5cf0f9c/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:41.715065 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae8864-88fb-4179-85da-4d57db727b5b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:41.715563 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae8864-88fb-4179-85da-4d57db727b5b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:41.716019 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae8864-88fb-4179-85da-4d57db727b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:41.755178 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-00ae8864-88fb-4179-85da-4d57db727b5b None None] MFA Rules not processed for user `58154820ef744238b008136db5cf0f9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:41.756427 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-00ae8864-88fb-4179-85da-4d57db727b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:41.830621 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1104/2218] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:56:41.844115 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bcd9e0-ab2c-457b-b583-af396ffa29fe admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:41.846151 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c9bcd9e0-ab2c-457b-b583-af396ffa29fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:41.909621 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bcd9e0-ab2c-457b-b583-af396ffa29fe admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:41.913704 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83d116-4204-44a0-9fb0-a357e19cf16c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:41.914361 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83d116-4204-44a0-9fb0-a357e19cf16c service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:41.914640 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83d116-4204-44a0-9fb0-a357e19cf16c service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:41.914894 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83d116-4204-44a0-9fb0-a357e19cf16c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:41.926116 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83d116-4204-44a0-9fb0-a357e19cf16c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:41.928042 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83d116-4204-44a0-9fb0-a357e19cf16c service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:41.941253 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1115/2219] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:41.975332 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae8864-88fb-4179-85da-4d57db727b5b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:42.031980 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:42.044659 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae8864-88fb-4179-85da-4d57db727b5b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:42.049499 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d66aec-77c4-42c8-adc9-1659cae2e846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:42.050092 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d66aec-77c4-42c8-adc9-1659cae2e846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:42.050371 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d66aec-77c4-42c8-adc9-1659cae2e846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:42.050650 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d66aec-77c4-42c8-adc9-1659cae2e846 admin admin] PATH_INFO: `/v3/users/58154820ef744238b008136db5cf0f9c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:42.051784 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d66aec-77c4-42c8-adc9-1659cae2e846 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58154820ef744238b008136db5cf0f9c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:42.053763 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d66aec-77c4-42c8-adc9-1659cae2e846 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:42.101699 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-11d66aec-77c4-42c8-adc9-1659cae2e846 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58154820ef744238b008136db5cf0f9c'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:42.114271 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-11d66aec-77c4-42c8-adc9-1659cae2e846 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58154820ef744238b008136db5cf0f9c'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:42.121114 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-11d66aec-77c4-42c8-adc9-1659cae2e846 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58154820ef744238b008136db5cf0f9c'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:42.130266 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-11d66aec-77c4-42c8-adc9-1659cae2e846 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58154820ef744238b008136db5cf0f9c'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:42.130952 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-11d66aec-77c4-42c8-adc9-1659cae2e846 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58154820ef744238b008136db5cf0f9c'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:42.137552 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1105/2220] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:56:41 2022] DELETE /identity/v3/users/58154820ef744238b008136db5cf0f9c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:42.142510 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fb391-f197-4722-b2ed-0e64a295d10b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:42.142846 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fb391-f197-4722-b2ed-0e64a295d10b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:42.143128 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fb391-f197-4722-b2ed-0e64a295d10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:42.162569 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-231fb391-f197-4722-b2ed-0e64a295d10b None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:42.163821 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-231fb391-f197-4722-b2ed-0e64a295d10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:42.186231 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:42.232605 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1116/2221] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:42.246771 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d66aec-77c4-42c8-adc9-1659cae2e846 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:42.248238 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-11d66aec-77c4-42c8-adc9-1659cae2e846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:42.306310 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d66aec-77c4-42c8-adc9-1659cae2e846 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:42.310301 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ecd01-f655-44ff-9904-bf30dd533db1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:42.310933 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ecd01-f655-44ff-9904-bf30dd533db1 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:42.311185 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ecd01-f655-44ff-9904-bf30dd533db1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:42.311460 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ecd01-f655-44ff-9904-bf30dd533db1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:42.321618 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ecd01-f655-44ff-9904-bf30dd533db1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:42.323156 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ecd01-f655-44ff-9904-bf30dd533db1 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:42.333926 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1106/2222] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:42.603045 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fb391-f197-4722-b2ed-0e64a295d10b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:42.604527 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-231fb391-f197-4722-b2ed-0e64a295d10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:42.617871 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fb391-f197-4722-b2ed-0e64a295d10b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:42.622686 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000b52f-d9f1-4469-8ea5-822aabc34c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:42.623320 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000b52f-d9f1-4469-8ea5-822aabc34c8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:42.623608 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000b52f-d9f1-4469-8ea5-822aabc34c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:42.623865 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000b52f-d9f1-4469-8ea5-822aabc34c8b admin admin] PATH_INFO: `/v3/users/483d4427a02a4e7c92bd48739a436ae4` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:42.624983 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8000b52f-d9f1-4469-8ea5-822aabc34c8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=483d4427a02a4e7c92bd48739a436ae4)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:42.626967 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8000b52f-d9f1-4469-8ea5-822aabc34c8b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:42.676647 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8000b52f-d9f1-4469-8ea5-822aabc34c8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '483d4427a02a4e7c92bd48739a436ae4'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:42.684274 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8000b52f-d9f1-4469-8ea5-822aabc34c8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '483d4427a02a4e7c92bd48739a436ae4'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:42.692168 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8000b52f-d9f1-4469-8ea5-822aabc34c8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '483d4427a02a4e7c92bd48739a436ae4'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:42.707212 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ecd01-f655-44ff-9904-bf30dd533db1 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:42.708830 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-471ecd01-f655-44ff-9904-bf30dd533db1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:42.710431 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8000b52f-d9f1-4469-8ea5-822aabc34c8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '483d4427a02a4e7c92bd48739a436ae4'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:42.711343 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8000b52f-d9f1-4469-8ea5-822aabc34c8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '483d4427a02a4e7c92bd48739a436ae4'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:42.720090 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1117/2223] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:56:42 2022] DELETE /identity/v3/users/483d4427a02a4e7c92bd48739a436ae4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:42.723860 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ecd01-f655-44ff-9904-bf30dd533db1 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:42.724234 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c5911-d600-4968-944c-dc8ed1a6af1a None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:42.724862 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c5911-d600-4968-944c-dc8ed1a6af1a None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:42.725109 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c5911-d600-4968-944c-dc8ed1a6af1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:42.746252 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-417c5911-d600-4968-944c-dc8ed1a6af1a None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:42.747640 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-417c5911-d600-4968-944c-dc8ed1a6af1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:42.785316 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a062f05-4692-4e3c-ad6f-10fb82c05745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:42.785987 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a062f05-4692-4e3c-ad6f-10fb82c05745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:42.786267 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a062f05-4692-4e3c-ad6f-10fb82c05745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:42.786539 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a062f05-4692-4e3c-ad6f-10fb82c05745 admin admin] PATH_INFO: `/v3/projects/4e8d451e986a412cb6ebe7cb4a53b34a` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:42.787660 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a062f05-4692-4e3c-ad6f-10fb82c05745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e8d451e986a412cb6ebe7cb4a53b34a)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:42.789592 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a062f05-4692-4e3c-ad6f-10fb82c05745 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:42.808763 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:42.810879 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1118/2224] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:56:42.820565 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c5911-d600-4968-944c-dc8ed1a6af1a None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:42.822181 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-417c5911-d600-4968-944c-dc8ed1a6af1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:42.857527 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6a062f05-4692-4e3c-ad6f-10fb82c05745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e8d451e986a412cb6ebe7cb4a53b34a', 'request_id': 'req-6a062f05-4692-4e3c-ad6f-10fb82c05745'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:42.857527 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6a062f05-4692-4e3c-ad6f-10fb82c05745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e8d451e986a412cb6ebe7cb4a53b34a', 'request_id': 'req-6a062f05-4692-4e3c-ad6f-10fb82c05745'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:42.860892 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6a062f05-4692-4e3c-ad6f-10fb82c05745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e8d451e986a412cb6ebe7cb4a53b34a', 'request_id': 'req-6a062f05-4692-4e3c-ad6f-10fb82c05745'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:42.871265 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:42.875061 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6a062f05-4692-4e3c-ad6f-10fb82c05745 admin admin] The token cache is being invalidate because project 4e8d451e986a412cb6ebe7cb4a53b34a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:56:42.875358 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6a062f05-4692-4e3c-ad6f-10fb82c05745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:42.876212 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6a062f05-4692-4e3c-ad6f-10fb82c05745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:42.877994 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1107/2225] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:56:42 2022] DELETE /identity/v3/projects/4e8d451e986a412cb6ebe7cb4a53b34a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:42.882786 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061accb-d6b4-4c55-855e-53b884b4ac52 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:42.883070 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061accb-d6b4-4c55-855e-53b884b4ac52 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:42.883346 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061accb-d6b4-4c55-855e-53b884b4ac52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:42.889388 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c5911-d600-4968-944c-dc8ed1a6af1a None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:42.903580 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f061accb-d6b4-4c55-855e-53b884b4ac52 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:42.904785 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f061accb-d6b4-4c55-855e-53b884b4ac52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:42.939331 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf76ff5-9042-4829-a0d7-0e1518ef7700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:42.940086 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf76ff5-9042-4829-a0d7-0e1518ef7700 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:42.940398 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf76ff5-9042-4829-a0d7-0e1518ef7700 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:42.940675 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf76ff5-9042-4829-a0d7-0e1518ef7700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:42.942494 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-5bf76ff5-9042-4829-a0d7-0e1518ef7700 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:42.968043 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1108/2226] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:56:42.978641 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee615da-fd97-4c10-bc21-6353e5e75cf5 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:42.979083 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee615da-fd97-4c10-bc21-6353e5e75cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:42.979514 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee615da-fd97-4c10-bc21-6353e5e75cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:43.003382 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-bee615da-fd97-4c10-bc21-6353e5e75cf5 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:43.005168 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bee615da-fd97-4c10-bc21-6353e5e75cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:43.014429 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1109/2227] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:43.025386 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf76ff5-9042-4829-a0d7-0e1518ef7700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:43.025386 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf76ff5-9042-4829-a0d7-0e1518ef7700 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:43.025592 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee615da-fd97-4c10-bc21-6353e5e75cf5 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:43.028969 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1119/2228] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:56:43.031059 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee615da-fd97-4c10-bc21-6353e5e75cf5 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:43.035733 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a68c0-30b8-4d72-9b6a-a6df39abc71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:43.036832 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a68c0-30b8-4d72-9b6a-a6df39abc71a admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:43.036940 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a68c0-30b8-4d72-9b6a-a6df39abc71a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:43.037226 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a68c0-30b8-4d72-9b6a-a6df39abc71a admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:43.038296 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a68c0-30b8-4d72-9b6a-a6df39abc71a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:56:43.038600 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a68c0-30b8-4d72-9b6a-a6df39abc71a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:43.040365 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a68c0-30b8-4d72-9b6a-a6df39abc71a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:43.057000 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1110/2229] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:56:43.061591 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf76ff5-9042-4829-a0d7-0e1518ef7700 service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:43.072043 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf76ff5-9042-4829-a0d7-0e1518ef7700 service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:43.077469 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde89a2-e48a-4db0-8d0c-ecc8210f86cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:43.078193 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde89a2-e48a-4db0-8d0c-ecc8210f86cc admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:43.078565 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde89a2-e48a-4db0-8d0c-ecc8210f86cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:43.078903 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde89a2-e48a-4db0-8d0c-ecc8210f86cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:43.079670 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde89a2-e48a-4db0-8d0c-ecc8210f86cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:43.081718 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde89a2-e48a-4db0-8d0c-ecc8210f86cc admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:43.114543 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1120/2230] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:56:43 2022] POST /identity/v3/projects => generated 399 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:56:43.119852 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a68c0-30b8-4d72-9b6a-a6df39abc71a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:43.131339 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a68c0-30b8-4d72-9b6a-a6df39abc71a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:43.211894 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee4fa6-b639-4d8d-bcff-0e4f0cba7afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:43.212834 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee4fa6-b639-4d8d-bcff-0e4f0cba7afd admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:43.213116 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee4fa6-b639-4d8d-bcff-0e4f0cba7afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:43.213389 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee4fa6-b639-4d8d-bcff-0e4f0cba7afd admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:43.214069 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee4fa6-b639-4d8d-bcff-0e4f0cba7afd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:43.217073 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee4fa6-b639-4d8d-bcff-0e4f0cba7afd admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:43.253884 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1111/2231] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:56:43 2022] POST /identity/v3/users => generated 300 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:56:43.255395 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde89a2-e48a-4db0-8d0c-ecc8210f86cc admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:43.267345 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde89a2-e48a-4db0-8d0c-ecc8210f86cc admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:43.273128 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517e843-78a2-4101-ac24-8b204c41c0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:43.273785 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517e843-78a2-4101-ac24-8b204c41c0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:43.274140 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517e843-78a2-4101-ac24-8b204c41c0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:43.274592 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517e843-78a2-4101-ac24-8b204c41c0e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:43.275107 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517e843-78a2-4101-ac24-8b204c41c0e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:43.276883 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517e843-78a2-4101-ac24-8b204c41c0e2 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:43.293938 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1121/2232] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:43.297421 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee4fa6-b639-4d8d-bcff-0e4f0cba7afd admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:43.309390 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee4fa6-b639-4d8d-bcff-0e4f0cba7afd admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:43.314994 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478d25c-5259-4f77-bb2b-3725ef7013b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:43.315531 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478d25c-5259-4f77-bb2b-3725ef7013b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:43.315861 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478d25c-5259-4f77-bb2b-3725ef7013b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:43.316136 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478d25c-5259-4f77-bb2b-3725ef7013b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:43.316845 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478d25c-5259-4f77-bb2b-3725ef7013b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:43.319796 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478d25c-5259-4f77-bb2b-3725ef7013b2 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:43.337660 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517e843-78a2-4101-ac24-8b204c41c0e2 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:43.338130 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1112/2233] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:43.349144 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517e843-78a2-4101-ac24-8b204c41c0e2 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:43.360449 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac7f4a-92a2-4d0b-bd42-b648a89c382f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:43.361463 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac7f4a-92a2-4d0b-bd42-b648a89c382f admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:43.362061 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac7f4a-92a2-4d0b-bd42-b648a89c382f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:43.362440 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac7f4a-92a2-4d0b-bd42-b648a89c382f admin admin] PATH_INFO: `/v3/projects/e81bcfb6fd2d44d2bc2641c334d0ef0f/users/9d89f36272c740688310d84815fbf52c/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:43.386151 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac7f4a-92a2-4d0b-bd42-b648a89c382f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e81bcfb6fd2d44d2bc2641c334d0ef0f, user_id=9d89f36272c740688310d84815fbf52c, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:43.390016 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac7f4a-92a2-4d0b-bd42-b648a89c382f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:43.407705 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1122/2234] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:56:43 2022] PUT /identity/v3/projects/e81bcfb6fd2d44d2bc2641c334d0ef0f/users/9d89f36272c740688310d84815fbf52c/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:43.412022 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478d25c-5259-4f77-bb2b-3725ef7013b2 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:43.413869 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d478d25c-5259-4f77-bb2b-3725ef7013b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:43.418344 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46abc8-5851-44e9-a404-162ca82f752e None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:43.419050 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46abc8-5851-44e9-a404-162ca82f752e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:43.419460 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46abc8-5851-44e9-a404-162ca82f752e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:43.429094 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:43.435343 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478d25c-5259-4f77-bb2b-3725ef7013b2 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:43.493169 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-0f46abc8-5851-44e9-a404-162ca82f752e None None] MFA Rules not processed for user `9d89f36272c740688310d84815fbf52c`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:43.496891 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-0f46abc8-5851-44e9-a404-162ca82f752e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:43.565679 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:43.591851 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43540cb3-16da-450b-845a-9eafd40d1fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:43.592591 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43540cb3-16da-450b-845a-9eafd40d1fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:43.592871 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43540cb3-16da-450b-845a-9eafd40d1fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:43.593697 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43540cb3-16da-450b-845a-9eafd40d1fa9 admin admin] PATH_INFO: `/v3/projects/79d80697e0564f6baa10af46a9d0150e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:43.595008 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43540cb3-16da-450b-845a-9eafd40d1fa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79d80697e0564f6baa10af46a9d0150e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:43.597145 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43540cb3-16da-450b-845a-9eafd40d1fa9 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:43.627903 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1123/2235] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:43 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:43.648553 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46abc8-5851-44e9-a404-162ca82f752e None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:43.648553 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-0f46abc8-5851-44e9-a404-162ca82f752e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:43.667645 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-43540cb3-16da-450b-845a-9eafd40d1fa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79d80697e0564f6baa10af46a9d0150e', 'request_id': 'req-43540cb3-16da-450b-845a-9eafd40d1fa9'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:43.678482 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-43540cb3-16da-450b-845a-9eafd40d1fa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79d80697e0564f6baa10af46a9d0150e', 'request_id': 'req-43540cb3-16da-450b-845a-9eafd40d1fa9'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:43.687375 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-43540cb3-16da-450b-845a-9eafd40d1fa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79d80697e0564f6baa10af46a9d0150e', 'request_id': 'req-43540cb3-16da-450b-845a-9eafd40d1fa9'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:43.704795 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-43540cb3-16da-450b-845a-9eafd40d1fa9 admin admin] The token cache is being invalidate because project 79d80697e0564f6baa10af46a9d0150e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:56:43.705199 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-43540cb3-16da-450b-845a-9eafd40d1fa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:43.705772 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-43540cb3-16da-450b-845a-9eafd40d1fa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:43.707774 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1113/2236] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:56:43 2022] DELETE /identity/v3/projects/79d80697e0564f6baa10af46a9d0150e => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:43.711949 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43540cb3-16da-450b-845a-9eafd40d1fa9 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:43.714756 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-43540cb3-16da-450b-845a-9eafd40d1fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:43.735890 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46abc8-5851-44e9-a404-162ca82f752e None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:43.815120 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43540cb3-16da-450b-845a-9eafd40d1fa9 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:43.820412 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1338c-460f-4424-a49e-d20530cc2808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:43.820932 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1338c-460f-4424-a49e-d20530cc2808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:43.821200 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1338c-460f-4424-a49e-d20530cc2808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:43.821466 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1338c-460f-4424-a49e-d20530cc2808 admin admin] PATH_INFO: `/v3/users/efea56ada5db418db8347769b73b3c46` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:43.822703 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c1338c-460f-4424-a49e-d20530cc2808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efea56ada5db418db8347769b73b3c46)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:43.825160 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c1338c-460f-4424-a49e-d20530cc2808 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:43.830169 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a619c2-3b3a-48b8-a7d8-03f66279a75a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:43.830979 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a619c2-3b3a-48b8-a7d8-03f66279a75a service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:43.831375 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a619c2-3b3a-48b8-a7d8-03f66279a75a service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:43.831738 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a619c2-3b3a-48b8-a7d8-03f66279a75a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:43.834244 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e4a619c2-3b3a-48b8-a7d8-03f66279a75a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:43.874426 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:43.890770 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-11c1338c-460f-4424-a49e-d20530cc2808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efea56ada5db418db8347769b73b3c46'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:43.910294 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-11c1338c-460f-4424-a49e-d20530cc2808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efea56ada5db418db8347769b73b3c46'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:43.917261 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a619c2-3b3a-48b8-a7d8-03f66279a75a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:43.918987 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a619c2-3b3a-48b8-a7d8-03f66279a75a service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:43.921070 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-11c1338c-460f-4424-a49e-d20530cc2808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efea56ada5db418db8347769b73b3c46'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:43.930031 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1124/2237] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:43 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:56:43.931105 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-11c1338c-460f-4424-a49e-d20530cc2808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efea56ada5db418db8347769b73b3c46'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:43.931736 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-11c1338c-460f-4424-a49e-d20530cc2808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efea56ada5db418db8347769b73b3c46'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:43.939441 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1114/2238] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:56:43 2022] DELETE /identity/v3/users/efea56ada5db418db8347769b73b3c46 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:44.286860 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a619c2-3b3a-48b8-a7d8-03f66279a75a service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:44.308426 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a619c2-3b3a-48b8-a7d8-03f66279a75a service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:44.391332 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:44.425368 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16246425-1fc0-4e36-9968-ce33261ad4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:44.426254 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16246425-1fc0-4e36-9968-ce33261ad4c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:44.426591 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16246425-1fc0-4e36-9968-ce33261ad4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:44.426978 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16246425-1fc0-4e36-9968-ce33261ad4c1 admin admin] PATH_INFO: `/v3/projects/9927875af43b4a7b8fb5f1d3c806d67c` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:44.434047 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16246425-1fc0-4e36-9968-ce33261ad4c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9927875af43b4a7b8fb5f1d3c806d67c)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:44.434047 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16246425-1fc0-4e36-9968-ce33261ad4c1 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:44.530570 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-16246425-1fc0-4e36-9968-ce33261ad4c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9927875af43b4a7b8fb5f1d3c806d67c', 'request_id': 'req-16246425-1fc0-4e36-9968-ce33261ad4c1'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:44.542815 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-16246425-1fc0-4e36-9968-ce33261ad4c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9927875af43b4a7b8fb5f1d3c806d67c', 'request_id': 'req-16246425-1fc0-4e36-9968-ce33261ad4c1'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:44.553090 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-16246425-1fc0-4e36-9968-ce33261ad4c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9927875af43b4a7b8fb5f1d3c806d67c', 'request_id': 'req-16246425-1fc0-4e36-9968-ce33261ad4c1'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:44.596587 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-16246425-1fc0-4e36-9968-ce33261ad4c1 admin admin] The token cache is being invalidate because project 9927875af43b4a7b8fb5f1d3c806d67c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:56:44.596881 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-16246425-1fc0-4e36-9968-ce33261ad4c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:44.597787 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-16246425-1fc0-4e36-9968-ce33261ad4c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:44.603290 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1125/2239] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:56:44 2022] DELETE /identity/v3/projects/9927875af43b4a7b8fb5f1d3c806d67c => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:44.604537 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1338c-460f-4424-a49e-d20530cc2808 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:44.606735 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-11c1338c-460f-4424-a49e-d20530cc2808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:44.629940 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1338c-460f-4424-a49e-d20530cc2808 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:44.722964 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c40c3-c6f6-488c-87ff-9a9ee36686e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:44.724275 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c40c3-c6f6-488c-87ff-9a9ee36686e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:44.724558 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c40c3-c6f6-488c-87ff-9a9ee36686e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:44.724830 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c40c3-c6f6-488c-87ff-9a9ee36686e8 admin admin] PATH_INFO: `/v3/users/df0dbb79b97f46b9854139412780c073` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:44.727078 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c40c3-c6f6-488c-87ff-9a9ee36686e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df0dbb79b97f46b9854139412780c073)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:44.729313 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c40c3-c6f6-488c-87ff-9a9ee36686e8 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:44.804529 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84153ba-f234-415e-9f17-0fa4d6e62f71 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:44.814331 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84153ba-f234-415e-9f17-0fa4d6e62f71 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:44.814649 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84153ba-f234-415e-9f17-0fa4d6e62f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:44.818492 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-105c40c3-c6f6-488c-87ff-9a9ee36686e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df0dbb79b97f46b9854139412780c073'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:44.839143 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-105c40c3-c6f6-488c-87ff-9a9ee36686e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df0dbb79b97f46b9854139412780c073'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:44.839983 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-b84153ba-f234-415e-9f17-0fa4d6e62f71 None None] MFA Rules not processed for user `5f227aa72915442384469ddc844198dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:44.843514 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b84153ba-f234-415e-9f17-0fa4d6e62f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:44.847524 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-105c40c3-c6f6-488c-87ff-9a9ee36686e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df0dbb79b97f46b9854139412780c073'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:44.862676 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-105c40c3-c6f6-488c-87ff-9a9ee36686e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df0dbb79b97f46b9854139412780c073'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:44.863332 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-105c40c3-c6f6-488c-87ff-9a9ee36686e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df0dbb79b97f46b9854139412780c073'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:44.873955 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1115/2240] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:56:44 2022] DELETE /identity/v3/users/df0dbb79b97f46b9854139412780c073 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:44.934248 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1126/2241] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:45.445254 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c40c3-c6f6-488c-87ff-9a9ee36686e8 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:45.446905 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-105c40c3-c6f6-488c-87ff-9a9ee36686e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:45.500566 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:45.556269 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c40c3-c6f6-488c-87ff-9a9ee36686e8 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:45.562031 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c15a4-0978-45f7-9ee7-f55724cf82f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:45.562882 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c15a4-0978-45f7-9ee7-f55724cf82f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:45.563171 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c15a4-0978-45f7-9ee7-f55724cf82f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:45.563589 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c15a4-0978-45f7-9ee7-f55724cf82f5 admin admin] PATH_INFO: `/v3/projects/a7d0c97bd1b2483e90b0c990713bee60` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:45.564750 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c15a4-0978-45f7-9ee7-f55724cf82f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7d0c97bd1b2483e90b0c990713bee60)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:45.566702 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c15a4-0978-45f7-9ee7-f55724cf82f5 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:45.627036 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-119c15a4-0978-45f7-9ee7-f55724cf82f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7d0c97bd1b2483e90b0c990713bee60', 'request_id': 'req-119c15a4-0978-45f7-9ee7-f55724cf82f5'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:45.635251 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-119c15a4-0978-45f7-9ee7-f55724cf82f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7d0c97bd1b2483e90b0c990713bee60', 'request_id': 'req-119c15a4-0978-45f7-9ee7-f55724cf82f5'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:45.643425 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-119c15a4-0978-45f7-9ee7-f55724cf82f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7d0c97bd1b2483e90b0c990713bee60', 'request_id': 'req-119c15a4-0978-45f7-9ee7-f55724cf82f5'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:45.659429 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-119c15a4-0978-45f7-9ee7-f55724cf82f5 admin admin] The token cache is being invalidate because project a7d0c97bd1b2483e90b0c990713bee60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:56:45.659764 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-119c15a4-0978-45f7-9ee7-f55724cf82f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:45.660366 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-119c15a4-0978-45f7-9ee7-f55724cf82f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:45.662316 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1116/2242] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:56:45 2022] DELETE /identity/v3/projects/a7d0c97bd1b2483e90b0c990713bee60 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:45.667342 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49789d1a-be1c-4826-8b09-b2c73a91e94a None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:45.667916 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49789d1a-be1c-4826-8b09-b2c73a91e94a None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:45.667916 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49789d1a-be1c-4826-8b09-b2c73a91e94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:45.697393 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-49789d1a-be1c-4826-8b09-b2c73a91e94a None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:45.699419 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-49789d1a-be1c-4826-8b09-b2c73a91e94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:45.787028 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919de8e-834c-40f5-b8e6-2d096b4abfc4 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:45.787319 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919de8e-834c-40f5-b8e6-2d096b4abfc4 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:45.787627 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919de8e-834c-40f5-b8e6-2d096b4abfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:45.791144 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1127/2243] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:45.809729 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b919de8e-834c-40f5-b8e6-2d096b4abfc4 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:45.810984 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b919de8e-834c-40f5-b8e6-2d096b4abfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:45.819771 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1117/2244] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:45.824161 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49789d1a-be1c-4826-8b09-b2c73a91e94a None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:45.834615 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49789d1a-be1c-4826-8b09-b2c73a91e94a None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:45.840875 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfbb8d-bd80-4027-9b64-feef83203c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:45.841545 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfbb8d-bd80-4027-9b64-feef83203c39 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:45.841785 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfbb8d-bd80-4027-9b64-feef83203c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:45.842072 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfbb8d-bd80-4027-9b64-feef83203c39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:45.842873 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfbb8d-bd80-4027-9b64-feef83203c39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:56:45.843182 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfbb8d-bd80-4027-9b64-feef83203c39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:45.844867 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfbb8d-bd80-4027-9b64-feef83203c39 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:45.861327 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1128/2245] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:56:45.862716 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919de8e-834c-40f5-b8e6-2d096b4abfc4 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:45.872290 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919de8e-834c-40f5-b8e6-2d096b4abfc4 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:45.877082 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a663c5-beff-4483-811f-60b9d59825ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:45.877683 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a663c5-beff-4483-811f-60b9d59825ae admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:45.878054 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a663c5-beff-4483-811f-60b9d59825ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:45.878323 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a663c5-beff-4483-811f-60b9d59825ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:45.878948 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a663c5-beff-4483-811f-60b9d59825ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:45.880837 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a663c5-beff-4483-811f-60b9d59825ae admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:45.910717 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1118/2246] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:56:45 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:56:45.914931 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfbb8d-bd80-4027-9b64-feef83203c39 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:45.926237 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfbb8d-bd80-4027-9b64-feef83203c39 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:45.931062 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:45.989621 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dabfbee-42ae-480f-bbcc-b6d8403b575e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:45.990325 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabfbee-42ae-480f-bbcc-b6d8403b575e admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:45.990620 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabfbee-42ae-480f-bbcc-b6d8403b575e admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:45.990885 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabfbee-42ae-480f-bbcc-b6d8403b575e admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:45.991520 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dabfbee-42ae-480f-bbcc-b6d8403b575e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:45.993469 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dabfbee-42ae-480f-bbcc-b6d8403b575e admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:46.016963 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1129/2247] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:56:45 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:56:46.021057 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a663c5-beff-4483-811f-60b9d59825ae admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:46.032030 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a663c5-beff-4483-811f-60b9d59825ae admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:46.036911 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470165d6-d7fa-4e3a-ae1e-e79666a5755b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:46.037521 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470165d6-d7fa-4e3a-ae1e-e79666a5755b admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:46.037796 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470165d6-d7fa-4e3a-ae1e-e79666a5755b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:46.038112 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470165d6-d7fa-4e3a-ae1e-e79666a5755b admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:46.038737 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470165d6-d7fa-4e3a-ae1e-e79666a5755b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:46.040715 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470165d6-d7fa-4e3a-ae1e-e79666a5755b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:46.050651 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1119/2248] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:46.054662 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dabfbee-42ae-480f-bbcc-b6d8403b575e admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:46.065349 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dabfbee-42ae-480f-bbcc-b6d8403b575e admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:46.070894 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb592a-230f-42b9-9c98-79c06bdac10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:46.071496 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb592a-230f-42b9-9c98-79c06bdac10f admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:46.071778 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb592a-230f-42b9-9c98-79c06bdac10f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:46.072050 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb592a-230f-42b9-9c98-79c06bdac10f admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:46.072696 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb592a-230f-42b9-9c98-79c06bdac10f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:46.074364 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb592a-230f-42b9-9c98-79c06bdac10f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:46.115274 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1130/2249] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:46.117807 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470165d6-d7fa-4e3a-ae1e-e79666a5755b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:46.135346 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470165d6-d7fa-4e3a-ae1e-e79666a5755b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:46.143730 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18367ce3-cfe3-4ae9-bd7c-e6a110155c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:46.146479 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18367ce3-cfe3-4ae9-bd7c-e6a110155c13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:46.146904 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18367ce3-cfe3-4ae9-bd7c-e6a110155c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:46.147312 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18367ce3-cfe3-4ae9-bd7c-e6a110155c13 admin admin] PATH_INFO: `/v3/projects/93c8dce8b60247e3b5d624b1895b4a02/users/3ab895101915497b932efd329d1a6cb0/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:46.186293 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18367ce3-cfe3-4ae9-bd7c-e6a110155c13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93c8dce8b60247e3b5d624b1895b4a02, user_id=3ab895101915497b932efd329d1a6cb0, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:46.191658 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18367ce3-cfe3-4ae9-bd7c-e6a110155c13 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:46.227120 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1120/2250] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:56:46 2022] PUT /identity/v3/projects/93c8dce8b60247e3b5d624b1895b4a02/users/3ab895101915497b932efd329d1a6cb0/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:46.238352 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c18a7-d4de-44e1-b477-403c35550140 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:46.238725 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c18a7-d4de-44e1-b477-403c35550140 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:46.239071 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c18a7-d4de-44e1-b477-403c35550140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:46.314917 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-918c18a7-d4de-44e1-b477-403c35550140 None None] MFA Rules not processed for user `3ab895101915497b932efd329d1a6cb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:46.316438 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-918c18a7-d4de-44e1-b477-403c35550140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:46.404146 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1131/2251] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:46.408619 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18367ce3-cfe3-4ae9-bd7c-e6a110155c13 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:46.523979 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18367ce3-cfe3-4ae9-bd7c-e6a110155c13 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:46.539026 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e48f9a-3774-4a35-8c0a-bcaceacd6a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:46.540605 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e48f9a-3774-4a35-8c0a-bcaceacd6a68 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:46.542282 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e48f9a-3774-4a35-8c0a-bcaceacd6a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:46.544209 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e48f9a-3774-4a35-8c0a-bcaceacd6a68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:46.546153 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e48f9a-3774-4a35-8c0a-bcaceacd6a68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:46.553376 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e48f9a-3774-4a35-8c0a-bcaceacd6a68 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:46.563611 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:46.617883 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1121/2252] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:56:46 2022] POST /identity/v3/projects => generated 383 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:56:46.622887 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c18a7-d4de-44e1-b477-403c35550140 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:46.638418 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c18a7-d4de-44e1-b477-403c35550140 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:46.719110 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ead7ab-18d4-4e81-8c19-6dee883a494c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:46.719743 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ead7ab-18d4-4e81-8c19-6dee883a494c admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:46.720024 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ead7ab-18d4-4e81-8c19-6dee883a494c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:46.720428 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ead7ab-18d4-4e81-8c19-6dee883a494c admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:46.721509 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ead7ab-18d4-4e81-8c19-6dee883a494c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:46.725373 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ead7ab-18d4-4e81-8c19-6dee883a494c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:46.760291 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1132/2253] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:56:46 2022] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:56:46.764982 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e48f9a-3774-4a35-8c0a-bcaceacd6a68 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:46.776792 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e48f9a-3774-4a35-8c0a-bcaceacd6a68 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:46.783527 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c1fd9-e98c-4b25-9901-46b25c5f1420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:46.784268 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c1fd9-e98c-4b25-9901-46b25c5f1420 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:46.784641 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c1fd9-e98c-4b25-9901-46b25c5f1420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:46.785479 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c1fd9-e98c-4b25-9901-46b25c5f1420 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:46.785906 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c1fd9-e98c-4b25-9901-46b25c5f1420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:46.787654 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c1fd9-e98c-4b25-9901-46b25c5f1420 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:46.799891 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1122/2254] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:46.803983 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ead7ab-18d4-4e81-8c19-6dee883a494c admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:46.817160 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ead7ab-18d4-4e81-8c19-6dee883a494c admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:46.834633 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756c52c-cc5b-4a54-868d-3412b856d95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:46.835273 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756c52c-cc5b-4a54-868d-3412b856d95f admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:46.835555 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756c52c-cc5b-4a54-868d-3412b856d95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:46.835890 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756c52c-cc5b-4a54-868d-3412b856d95f admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:46.837758 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756c52c-cc5b-4a54-868d-3412b856d95f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:46.839535 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756c52c-cc5b-4a54-868d-3412b856d95f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:46.841767 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:46.855491 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1133/2255] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:46.859630 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c1fd9-e98c-4b25-9901-46b25c5f1420 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:46.880023 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c1fd9-e98c-4b25-9901-46b25c5f1420 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:46.895433 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad24ac7-116e-4275-a16b-9a6ade1cc74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:46.896169 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad24ac7-116e-4275-a16b-9a6ade1cc74c admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:46.896448 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad24ac7-116e-4275-a16b-9a6ade1cc74c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:46.896714 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad24ac7-116e-4275-a16b-9a6ade1cc74c admin admin] PATH_INFO: `/v3/projects/74c6191fa3864388a598655544d966ed/users/d653847609ec4e7ba4b87419efa9dcaf/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:46.917660 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad24ac7-116e-4275-a16b-9a6ade1cc74c admin admin] RBAC: Authorizing `identity:create_grant(project_id=74c6191fa3864388a598655544d966ed, user_id=d653847609ec4e7ba4b87419efa9dcaf, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:46.920501 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad24ac7-116e-4275-a16b-9a6ade1cc74c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:46.939035 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1123/2256] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:56:46 2022] PUT /identity/v3/projects/74c6191fa3864388a598655544d966ed/users/d653847609ec4e7ba4b87419efa9dcaf/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:46.950961 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791a629-45d2-4610-987f-27418f115958 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:46.951255 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791a629-45d2-4610-987f-27418f115958 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:46.951536 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791a629-45d2-4610-987f-27418f115958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:47.025497 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-b791a629-45d2-4610-987f-27418f115958 None None] MFA Rules not processed for user `d653847609ec4e7ba4b87419efa9dcaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:47.028072 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b791a629-45d2-4610-987f-27418f115958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:47.107137 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1134/2257] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:47.112510 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad24ac7-116e-4275-a16b-9a6ade1cc74c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:47.209887 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad24ac7-116e-4275-a16b-9a6ade1cc74c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:47.218065 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9ce1d-612a-413d-a12e-c03f62570cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:47.218709 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9ce1d-612a-413d-a12e-c03f62570cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:47.220525 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9ce1d-612a-413d-a12e-c03f62570cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:47.221127 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9ce1d-612a-413d-a12e-c03f62570cd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:47.222187 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9ce1d-612a-413d-a12e-c03f62570cd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:47.227185 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9ce1d-612a-413d-a12e-c03f62570cd0 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:47.266341 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1124/2258] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:56:47 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:56:47.268518 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791a629-45d2-4610-987f-27418f115958 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:47.281823 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791a629-45d2-4610-987f-27418f115958 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:47.384267 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57190e91-559a-406c-9d49-acb8c04675a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:47.385167 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57190e91-559a-406c-9d49-acb8c04675a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:47.385444 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57190e91-559a-406c-9d49-acb8c04675a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:47.385714 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57190e91-559a-406c-9d49-acb8c04675a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:47.386379 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57190e91-559a-406c-9d49-acb8c04675a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:47.388773 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57190e91-559a-406c-9d49-acb8c04675a9 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:47.422863 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1135/2259] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:56:47 2022] POST /identity/v3/users => generated 299 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:56:47.423550 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9ce1d-612a-413d-a12e-c03f62570cd0 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:47.439602 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9ce1d-612a-413d-a12e-c03f62570cd0 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:47.451263 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d158f8-3624-4ba4-8d2a-2e69401cfa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:47.451905 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d158f8-3624-4ba4-8d2a-2e69401cfa92 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:47.452193 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d158f8-3624-4ba4-8d2a-2e69401cfa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:47.452465 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d158f8-3624-4ba4-8d2a-2e69401cfa92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:47.453182 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d158f8-3624-4ba4-8d2a-2e69401cfa92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:47.454929 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d158f8-3624-4ba4-8d2a-2e69401cfa92 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:47.470443 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1125/2260] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:56:47.475496 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57190e91-559a-406c-9d49-acb8c04675a9 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:47.494199 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57190e91-559a-406c-9d49-acb8c04675a9 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:47.508579 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78a23d-6d2e-4fe7-b43c-27a3451cb37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:47.509277 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78a23d-6d2e-4fe7-b43c-27a3451cb37c admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:47.509572 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78a23d-6d2e-4fe7-b43c-27a3451cb37c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:47.509890 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78a23d-6d2e-4fe7-b43c-27a3451cb37c admin admin] PATH_INFO: `/v3/projects/cf4512763191438b98291827563bdfc6/users/18907b4148b141678514d6ee774e1e94/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:47.556641 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78a23d-6d2e-4fe7-b43c-27a3451cb37c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf4512763191438b98291827563bdfc6, user_id=18907b4148b141678514d6ee774e1e94, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:47.562718 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78a23d-6d2e-4fe7-b43c-27a3451cb37c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:47.594859 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1136/2261] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:56:47 2022] PUT /identity/v3/projects/cf4512763191438b98291827563bdfc6/users/18907b4148b141678514d6ee774e1e94/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:47.601466 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d158f8-3624-4ba4-8d2a-2e69401cfa92 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:47.635022 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d158f8-3624-4ba4-8d2a-2e69401cfa92 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:47.719136 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1278a4-dbe9-4707-9556-70c9e72c7be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:47.719818 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1278a4-dbe9-4707-9556-70c9e72c7be8 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:47.720096 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1278a4-dbe9-4707-9556-70c9e72c7be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:47.720363 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1278a4-dbe9-4707-9556-70c9e72c7be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:47.721044 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1278a4-dbe9-4707-9556-70c9e72c7be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:47.722739 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1278a4-dbe9-4707-9556-70c9e72c7be8 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:47.734933 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1126/2262] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:47.739323 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78a23d-6d2e-4fe7-b43c-27a3451cb37c admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:47.760656 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78a23d-6d2e-4fe7-b43c-27a3451cb37c admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:47.765852 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcfb843-a183-4048-b2a5-8667676d0c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:47.766693 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfb843-a183-4048-b2a5-8667676d0c51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:47.778077 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfb843-a183-4048-b2a5-8667676d0c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:47.778077 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfb843-a183-4048-b2a5-8667676d0c51 admin admin] PATH_INFO: `/v3/projects/cf4512763191438b98291827563bdfc6/users/18907b4148b141678514d6ee774e1e94/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:47.778077 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcfb843-a183-4048-b2a5-8667676d0c51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf4512763191438b98291827563bdfc6, user_id=18907b4148b141678514d6ee774e1e94, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:47.778077 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcfb843-a183-4048-b2a5-8667676d0c51 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:47.788464 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1137/2263] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:56:47 2022] PUT /identity/v3/projects/cf4512763191438b98291827563bdfc6/users/18907b4148b141678514d6ee774e1e94/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:47.800408 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e04814-6d71-4b3c-bc44-c88bf0e01dd9 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:47.800941 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e04814-6d71-4b3c-bc44-c88bf0e01dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:47.800941 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e04814-6d71-4b3c-bc44-c88bf0e01dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:47.842353 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-d6e04814-6d71-4b3c-bc44-c88bf0e01dd9 None None] MFA Rules not processed for user `18907b4148b141678514d6ee774e1e94`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:47.845185 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d6e04814-6d71-4b3c-bc44-c88bf0e01dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:47.860519 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:47.937162 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1127/2264] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:47 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:47.948350 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcfb843-a183-4048-b2a5-8667676d0c51 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:47.950199 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1dcfb843-a183-4048-b2a5-8667676d0c51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:48.006788 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:48.035684 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcfb843-a183-4048-b2a5-8667676d0c51 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:48.041419 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0378e5-f424-41b7-b532-29062c8ecf4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:48.042680 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0378e5-f424-41b7-b532-29062c8ecf4f service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:48.042962 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0378e5-f424-41b7-b532-29062c8ecf4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:48.043239 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0378e5-f424-41b7-b532-29062c8ecf4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:48.154515 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0378e5-f424-41b7-b532-29062c8ecf4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:48.155994 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0378e5-f424-41b7-b532-29062c8ecf4f service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:48.187031 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1138/2265] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:49.841079 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e04814-6d71-4b3c-bc44-c88bf0e01dd9 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:49.842821 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d6e04814-6d71-4b3c-bc44-c88bf0e01dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:49.855226 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e04814-6d71-4b3c-bc44-c88bf0e01dd9 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:49.859246 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e93bd9-715e-4b1b-a569-d7879115d811 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:49.859850 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e93bd9-715e-4b1b-a569-d7879115d811 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:49.860296 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e93bd9-715e-4b1b-a569-d7879115d811 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:49.860566 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e93bd9-715e-4b1b-a569-d7879115d811 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:49.924358 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e93bd9-715e-4b1b-a569-d7879115d811 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:49.925815 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e93bd9-715e-4b1b-a569-d7879115d811 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:49.935855 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1128/2266] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:50.503869 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0378e5-f424-41b7-b532-29062c8ecf4f service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:50.505340 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-df0378e5-f424-41b7-b532-29062c8ecf4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:50.592249 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0378e5-f424-41b7-b532-29062c8ecf4f service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:50.597626 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0af08-01f7-43bb-8a83-d8f83ca6381b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:50.598479 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0af08-01f7-43bb-8a83-d8f83ca6381b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:50.598759 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0af08-01f7-43bb-8a83-d8f83ca6381b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:50.599183 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0af08-01f7-43bb-8a83-d8f83ca6381b admin admin] PATH_INFO: `/v3/users/9d89f36272c740688310d84815fbf52c` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:50.600471 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0af08-01f7-43bb-8a83-d8f83ca6381b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d89f36272c740688310d84815fbf52c)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:50.603119 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0af08-01f7-43bb-8a83-d8f83ca6381b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:50.670604 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-aaf0af08-01f7-43bb-8a83-d8f83ca6381b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d89f36272c740688310d84815fbf52c'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:50.674744 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e93bd9-715e-4b1b-a569-d7879115d811 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:50.677581 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-aaf0af08-01f7-43bb-8a83-d8f83ca6381b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d89f36272c740688310d84815fbf52c'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:50.683199 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e93bd9-715e-4b1b-a569-d7879115d811 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:50.685504 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-aaf0af08-01f7-43bb-8a83-d8f83ca6381b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d89f36272c740688310d84815fbf52c'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:50.688501 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785974f-9b49-4294-8d43-49998d605c99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:50.689459 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785974f-9b49-4294-8d43-49998d605c99 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:50.689737 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785974f-9b49-4294-8d43-49998d605c99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:50.690055 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785974f-9b49-4294-8d43-49998d605c99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:50.699160 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-aaf0af08-01f7-43bb-8a83-d8f83ca6381b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d89f36272c740688310d84815fbf52c'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:50.699883 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-aaf0af08-01f7-43bb-8a83-d8f83ca6381b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d89f36272c740688310d84815fbf52c'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:50.700551 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6785974f-9b49-4294-8d43-49998d605c99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:50.701546 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6785974f-9b49-4294-8d43-49998d605c99 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:50.706155 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1139/2267] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:56:50 2022] DELETE /identity/v3/users/9d89f36272c740688310d84815fbf52c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:50.710569 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ae652-1767-4bda-bda0-3e793d35ce7e None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:50.711474 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ae652-1767-4bda-bda0-3e793d35ce7e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:50.711754 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ae652-1767-4bda-bda0-3e793d35ce7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:50.713960 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1129/2268] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:50 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:50.732088 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-408ae652-1767-4bda-bda0-3e793d35ce7e None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:50.733383 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-408ae652-1767-4bda-bda0-3e793d35ce7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:50.738942 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:50.797391 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1140/2269] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:56:50.807637 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785974f-9b49-4294-8d43-49998d605c99 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:50.809115 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6785974f-9b49-4294-8d43-49998d605c99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:50.881565 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785974f-9b49-4294-8d43-49998d605c99 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:50.933116 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:50.944969 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abc5d6-ea65-46e8-921b-c150e4bad882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:50.946434 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abc5d6-ea65-46e8-921b-c150e4bad882 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:50.946859 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abc5d6-ea65-46e8-921b-c150e4bad882 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:50.947186 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abc5d6-ea65-46e8-921b-c150e4bad882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:50.960087 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abc5d6-ea65-46e8-921b-c150e4bad882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:50.961735 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abc5d6-ea65-46e8-921b-c150e4bad882 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:50.975046 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1130/2270] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:51.509788 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ae652-1767-4bda-bda0-3e793d35ce7e None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:51.511364 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-408ae652-1767-4bda-bda0-3e793d35ce7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:51.535468 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ae652-1767-4bda-bda0-3e793d35ce7e None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:51.542452 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f083bbe-f0e9-4b92-ae90-dbd11a1ba183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:51.544219 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f083bbe-f0e9-4b92-ae90-dbd11a1ba183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:51.544815 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f083bbe-f0e9-4b92-ae90-dbd11a1ba183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:51.545395 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f083bbe-f0e9-4b92-ae90-dbd11a1ba183 admin admin] PATH_INFO: `/v3/projects/e81bcfb6fd2d44d2bc2641c334d0ef0f` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:51.548383 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f083bbe-f0e9-4b92-ae90-dbd11a1ba183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e81bcfb6fd2d44d2bc2641c334d0ef0f)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:51.550846 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f083bbe-f0e9-4b92-ae90-dbd11a1ba183 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:51.626953 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3f083bbe-f0e9-4b92-ae90-dbd11a1ba183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e81bcfb6fd2d44d2bc2641c334d0ef0f', 'request_id': 'req-3f083bbe-f0e9-4b92-ae90-dbd11a1ba183'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:51.646404 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3f083bbe-f0e9-4b92-ae90-dbd11a1ba183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e81bcfb6fd2d44d2bc2641c334d0ef0f', 'request_id': 'req-3f083bbe-f0e9-4b92-ae90-dbd11a1ba183'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:51.655691 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3f083bbe-f0e9-4b92-ae90-dbd11a1ba183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e81bcfb6fd2d44d2bc2641c334d0ef0f', 'request_id': 'req-3f083bbe-f0e9-4b92-ae90-dbd11a1ba183'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:51.682944 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3f083bbe-f0e9-4b92-ae90-dbd11a1ba183 admin admin] The token cache is being invalidate because project e81bcfb6fd2d44d2bc2641c334d0ef0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:56:51.683287 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3f083bbe-f0e9-4b92-ae90-dbd11a1ba183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:51.684285 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3f083bbe-f0e9-4b92-ae90-dbd11a1ba183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:51.701875 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1141/2271] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:56:51 2022] DELETE /identity/v3/projects/e81bcfb6fd2d44d2bc2641c334d0ef0f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:54.710768 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abc5d6-ea65-46e8-921b-c150e4bad882 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:54.712383 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-82abc5d6-ea65-46e8-921b-c150e4bad882 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:54.726880 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abc5d6-ea65-46e8-921b-c150e4bad882 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:54.787192 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c4888-bdcd-4344-9bd6-14581987340e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:54.787809 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c4888-bdcd-4344-9bd6-14581987340e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:54.788077 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c4888-bdcd-4344-9bd6-14581987340e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:54.788343 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c4888-bdcd-4344-9bd6-14581987340e admin admin] PATH_INFO: `/v3/users/3ab895101915497b932efd329d1a6cb0` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:54.790138 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c4888-bdcd-4344-9bd6-14581987340e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ab895101915497b932efd329d1a6cb0)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:54.791498 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c4888-bdcd-4344-9bd6-14581987340e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:54.847574 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3f8c4888-bdcd-4344-9bd6-14581987340e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ab895101915497b932efd329d1a6cb0'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:54.860046 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3f8c4888-bdcd-4344-9bd6-14581987340e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ab895101915497b932efd329d1a6cb0'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:54.866693 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3f8c4888-bdcd-4344-9bd6-14581987340e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ab895101915497b932efd329d1a6cb0'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:54.875258 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3f8c4888-bdcd-4344-9bd6-14581987340e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ab895101915497b932efd329d1a6cb0'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:54.875871 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3f8c4888-bdcd-4344-9bd6-14581987340e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ab895101915497b932efd329d1a6cb0'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:54.881926 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1131/2272] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:56:54 2022] DELETE /identity/v3/users/3ab895101915497b932efd329d1a6cb0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:54.888170 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d9e24-3cc8-4484-a4ae-bf65d6175cfa None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:54.888670 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d9e24-3cc8-4484-a4ae-bf65d6175cfa None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:54.888670 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d9e24-3cc8-4484-a4ae-bf65d6175cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:54.908273 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-506d9e24-3cc8-4484-a4ae-bf65d6175cfa None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:54.909477 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-506d9e24-3cc8-4484-a4ae-bf65d6175cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:54.976122 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1142/2273] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:54.986124 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c4888-bdcd-4344-9bd6-14581987340e admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:54.990866 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3f8c4888-bdcd-4344-9bd6-14581987340e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:55.050848 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c4888-bdcd-4344-9bd6-14581987340e admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:55.056440 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6005a-a197-4434-a486-15094439dab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:55.057049 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6005a-a197-4434-a486-15094439dab8 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:55.057325 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6005a-a197-4434-a486-15094439dab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:55.057591 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6005a-a197-4434-a486-15094439dab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:55.073565 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6005a-a197-4434-a486-15094439dab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:55.075586 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6005a-a197-4434-a486-15094439dab8 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:55.085914 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1132/2274] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:55.194567 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d9e24-3cc8-4484-a4ae-bf65d6175cfa None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:55.196324 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-506d9e24-3cc8-4484-a4ae-bf65d6175cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:55.210238 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d9e24-3cc8-4484-a4ae-bf65d6175cfa None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:55.215104 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12afa5-2b83-4f88-9798-2eb10ba4b5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:55.216522 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12afa5-2b83-4f88-9798-2eb10ba4b5e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:55.216881 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12afa5-2b83-4f88-9798-2eb10ba4b5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:55.217231 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12afa5-2b83-4f88-9798-2eb10ba4b5e8 admin admin] PATH_INFO: `/v3/users/4f9dac1b60a04e7d968fee9f935f605f` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:55.218504 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12afa5-2b83-4f88-9798-2eb10ba4b5e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f9dac1b60a04e7d968fee9f935f605f)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:55.220665 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12afa5-2b83-4f88-9798-2eb10ba4b5e8 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:55.266827 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:55.283611 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9a12afa5-2b83-4f88-9798-2eb10ba4b5e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f9dac1b60a04e7d968fee9f935f605f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:55.291270 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9a12afa5-2b83-4f88-9798-2eb10ba4b5e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f9dac1b60a04e7d968fee9f935f605f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:55.303304 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9a12afa5-2b83-4f88-9798-2eb10ba4b5e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f9dac1b60a04e7d968fee9f935f605f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:55.323560 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9a12afa5-2b83-4f88-9798-2eb10ba4b5e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f9dac1b60a04e7d968fee9f935f605f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:55.324905 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9a12afa5-2b83-4f88-9798-2eb10ba4b5e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f9dac1b60a04e7d968fee9f935f605f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:55.340665 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1143/2275] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:56:55 2022] DELETE /identity/v3/users/4f9dac1b60a04e7d968fee9f935f605f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:55.342562 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e66e0-32ec-439e-a152-57a7da1b5485 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:55.342874 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e66e0-32ec-439e-a152-57a7da1b5485 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:55.343168 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e66e0-32ec-439e-a152-57a7da1b5485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:55.365348 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-0a5e66e0-32ec-439e-a152-57a7da1b5485 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:55.367182 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0a5e66e0-32ec-439e-a152-57a7da1b5485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:55.372985 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:55.462539 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1133/2276] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:55.472613 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12afa5-2b83-4f88-9798-2eb10ba4b5e8 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:55.474127 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9a12afa5-2b83-4f88-9798-2eb10ba4b5e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:55.487063 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e66e0-32ec-439e-a152-57a7da1b5485 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:55.488532 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0a5e66e0-32ec-439e-a152-57a7da1b5485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:55.501338 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e66e0-32ec-439e-a152-57a7da1b5485 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:55.507558 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cc2f0-d41b-40ae-aa9b-dc682750ba26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:55.508308 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cc2f0-d41b-40ae-aa9b-dc682750ba26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:55.508592 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cc2f0-d41b-40ae-aa9b-dc682750ba26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:55.508866 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cc2f0-d41b-40ae-aa9b-dc682750ba26 admin admin] PATH_INFO: `/v3/projects/93c8dce8b60247e3b5d624b1895b4a02` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:55.510136 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6cc2f0-d41b-40ae-aa9b-dc682750ba26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93c8dce8b60247e3b5d624b1895b4a02)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:55.512448 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6cc2f0-d41b-40ae-aa9b-dc682750ba26 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:55.608626 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12afa5-2b83-4f88-9798-2eb10ba4b5e8 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:55.610808 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ed6cc2f0-d41b-40ae-aa9b-dc682750ba26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93c8dce8b60247e3b5d624b1895b4a02', 'request_id': 'req-ed6cc2f0-d41b-40ae-aa9b-dc682750ba26'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:55.617436 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ed6cc2f0-d41b-40ae-aa9b-dc682750ba26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93c8dce8b60247e3b5d624b1895b4a02', 'request_id': 'req-ed6cc2f0-d41b-40ae-aa9b-dc682750ba26'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:55.636542 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ed6cc2f0-d41b-40ae-aa9b-dc682750ba26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93c8dce8b60247e3b5d624b1895b4a02', 'request_id': 'req-ed6cc2f0-d41b-40ae-aa9b-dc682750ba26'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:55.660140 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ed6cc2f0-d41b-40ae-aa9b-dc682750ba26 admin admin] The token cache is being invalidate because project 93c8dce8b60247e3b5d624b1895b4a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:56:55.660655 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ed6cc2f0-d41b-40ae-aa9b-dc682750ba26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:55.661478 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ed6cc2f0-d41b-40ae-aa9b-dc682750ba26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:55.663634 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1134/2277] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:56:55 2022] DELETE /identity/v3/projects/93c8dce8b60247e3b5d624b1895b4a02 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:56:55.667234 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cc2f0-d41b-40ae-aa9b-dc682750ba26 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:55.668748 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ed6cc2f0-d41b-40ae-aa9b-dc682750ba26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:55.675069 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfe8b8-3e6a-4b8d-be4d-bc0ff13e8cd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:55.675635 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfe8b8-3e6a-4b8d-be4d-bc0ff13e8cd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:55.675910 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfe8b8-3e6a-4b8d-be4d-bc0ff13e8cd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:55.676638 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfe8b8-3e6a-4b8d-be4d-bc0ff13e8cd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:55.678112 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ddcfe8b8-3e6a-4b8d-be4d-bc0ff13e8cd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:55.736550 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cc2f0-d41b-40ae-aa9b-dc682750ba26 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:55.741888 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3290b-ad08-49f1-adda-3b050e633324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:55.742509 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3290b-ad08-49f1-adda-3b050e633324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:55.742786 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3290b-ad08-49f1-adda-3b050e633324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:55.743054 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3290b-ad08-49f1-adda-3b050e633324 admin admin] PATH_INFO: `/v3/users/d653847609ec4e7ba4b87419efa9dcaf` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:55.744180 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc3290b-ad08-49f1-adda-3b050e633324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d653847609ec4e7ba4b87419efa9dcaf)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:55.746150 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc3290b-ad08-49f1-adda-3b050e633324 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:55.748105 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcfe8b8-3e6a-4b8d-be4d-bc0ff13e8cd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:55.750562 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcfe8b8-3e6a-4b8d-be4d-bc0ff13e8cd5 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:55.760398 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1144/2278] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:55.786757 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:55.796224 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ebc3290b-ad08-49f1-adda-3b050e633324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd653847609ec4e7ba4b87419efa9dcaf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:55.809906 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ebc3290b-ad08-49f1-adda-3b050e633324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd653847609ec4e7ba4b87419efa9dcaf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:55.816740 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ebc3290b-ad08-49f1-adda-3b050e633324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd653847609ec4e7ba4b87419efa9dcaf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:55.824499 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ebc3290b-ad08-49f1-adda-3b050e633324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd653847609ec4e7ba4b87419efa9dcaf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:55.825708 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ebc3290b-ad08-49f1-adda-3b050e633324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd653847609ec4e7ba4b87419efa9dcaf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:55.832536 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1135/2279] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:56:55 2022] DELETE /identity/v3/users/d653847609ec4e7ba4b87419efa9dcaf => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:56:56.216599 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfe8b8-3e6a-4b8d-be4d-bc0ff13e8cd5 service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:56.218697 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ddcfe8b8-3e6a-4b8d-be4d-bc0ff13e8cd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:56.232874 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfe8b8-3e6a-4b8d-be4d-bc0ff13e8cd5 service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:56.242345 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:56.298057 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3290b-ad08-49f1-adda-3b050e633324 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:56.299564 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ebc3290b-ad08-49f1-adda-3b050e633324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:56.316700 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6c1d4-885d-4f6f-91ac-edb6528291c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:56.317429 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6c1d4-885d-4f6f-91ac-edb6528291c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:56.317714 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6c1d4-885d-4f6f-91ac-edb6528291c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:56.318013 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6c1d4-885d-4f6f-91ac-edb6528291c8 admin admin] PATH_INFO: `/v3/projects/714d148ee7cb45c08860efac3ff8f1a0` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:56.319149 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6c1d4-885d-4f6f-91ac-edb6528291c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=714d148ee7cb45c08860efac3ff8f1a0)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:56.321124 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6c1d4-885d-4f6f-91ac-edb6528291c8 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:56.373490 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-a7d6c1d4-885d-4f6f-91ac-edb6528291c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '714d148ee7cb45c08860efac3ff8f1a0', 'request_id': 'req-a7d6c1d4-885d-4f6f-91ac-edb6528291c8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:56.381913 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-a7d6c1d4-885d-4f6f-91ac-edb6528291c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '714d148ee7cb45c08860efac3ff8f1a0', 'request_id': 'req-a7d6c1d4-885d-4f6f-91ac-edb6528291c8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:56.383172 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3290b-ad08-49f1-adda-3b050e633324 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:56.388922 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-a7d6c1d4-885d-4f6f-91ac-edb6528291c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '714d148ee7cb45c08860efac3ff8f1a0', 'request_id': 'req-a7d6c1d4-885d-4f6f-91ac-edb6528291c8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:56.399492 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-a7d6c1d4-885d-4f6f-91ac-edb6528291c8 admin admin] The token cache is being invalidate because project 714d148ee7cb45c08860efac3ff8f1a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:56:56.399828 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-a7d6c1d4-885d-4f6f-91ac-edb6528291c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:56.400472 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-a7d6c1d4-885d-4f6f-91ac-edb6528291c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:56.402008 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1145/2280] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:56:56 2022] DELETE /identity/v3/projects/714d148ee7cb45c08860efac3ff8f1a0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:56.406927 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d0671-4a29-4804-8d54-5d9381fb90d5 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:56.407215 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d0671-4a29-4804-8d54-5d9381fb90d5 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:56.407612 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d0671-4a29-4804-8d54-5d9381fb90d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:56.426899 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-864d0671-4a29-4804-8d54-5d9381fb90d5 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:56.428131 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-864d0671-4a29-4804-8d54-5d9381fb90d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:56.442429 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6822a-a4d9-4b09-b275-e10b29468856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:56.443063 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6822a-a4d9-4b09-b275-e10b29468856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:56.443340 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6822a-a4d9-4b09-b275-e10b29468856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:56.443612 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6822a-a4d9-4b09-b275-e10b29468856 admin admin] PATH_INFO: `/v3/projects/74c6191fa3864388a598655544d966ed` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:56.444758 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6822a-a4d9-4b09-b275-e10b29468856 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74c6191fa3864388a598655544d966ed)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:56.446748 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6822a-a4d9-4b09-b275-e10b29468856 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:56.487480 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1146/2281] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:56.496152 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-22a6822a-a4d9-4b09-b275-e10b29468856 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74c6191fa3864388a598655544d966ed', 'request_id': 'req-22a6822a-a4d9-4b09-b275-e10b29468856'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:56.496344 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66106e33-a871-4303-a621-d0655d8a32c0 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:56.496469 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66106e33-a871-4303-a621-d0655d8a32c0 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:56.496883 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66106e33-a871-4303-a621-d0655d8a32c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:56.502831 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-22a6822a-a4d9-4b09-b275-e10b29468856 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74c6191fa3864388a598655544d966ed', 'request_id': 'req-22a6822a-a4d9-4b09-b275-e10b29468856'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:56.510424 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-22a6822a-a4d9-4b09-b275-e10b29468856 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74c6191fa3864388a598655544d966ed', 'request_id': 'req-22a6822a-a4d9-4b09-b275-e10b29468856'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:56.512797 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:56.518083 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-66106e33-a871-4303-a621-d0655d8a32c0 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:56.519552 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-66106e33-a871-4303-a621-d0655d8a32c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:56.526636 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-22a6822a-a4d9-4b09-b275-e10b29468856 admin admin] The token cache is being invalidate because project 74c6191fa3864388a598655544d966ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:56:56.526952 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-22a6822a-a4d9-4b09-b275-e10b29468856 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:56.527575 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-22a6822a-a4d9-4b09-b275-e10b29468856 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:56.529396 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1136/2282] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:56:56 2022] DELETE /identity/v3/projects/74c6191fa3864388a598655544d966ed => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:56:56.534900 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6822a-a4d9-4b09-b275-e10b29468856 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:56.536386 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-22a6822a-a4d9-4b09-b275-e10b29468856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:56.566362 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:56.587012 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1147/2283] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:56.591503 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66106e33-a871-4303-a621-d0655d8a32c0 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:56.601597 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66106e33-a871-4303-a621-d0655d8a32c0 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:56.601749 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6822a-a4d9-4b09-b275-e10b29468856 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:56.606390 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b2592-5e0d-43ef-add4-ff315bc9b5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:56.607358 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b2592-5e0d-43ef-add4-ff315bc9b5d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:56.607472 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee0352-d09c-4510-8e92-94e3390d1f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:56.607565 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b2592-5e0d-43ef-add4-ff315bc9b5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:56.607565 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b2592-5e0d-43ef-add4-ff315bc9b5d1 admin admin] PATH_INFO: `/v3/users/18907b4148b141678514d6ee774e1e94` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:56.607972 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee0352-d09c-4510-8e92-94e3390d1f54 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:56.608261 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee0352-d09c-4510-8e92-94e3390d1f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:56.608534 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee0352-d09c-4510-8e92-94e3390d1f54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:56.608900 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b2592-5e0d-43ef-add4-ff315bc9b5d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18907b4148b141678514d6ee774e1e94)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:56.609186 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee0352-d09c-4510-8e92-94e3390d1f54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:56:56.609492 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee0352-d09c-4510-8e92-94e3390d1f54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:56.611407 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b2592-5e0d-43ef-add4-ff315bc9b5d1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:56.611933 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee0352-d09c-4510-8e92-94e3390d1f54 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:56.629094 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1148/2284] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:56:56.630069 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee0352-d09c-4510-8e92-94e3390d1f54 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:56.642527 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee0352-d09c-4510-8e92-94e3390d1f54 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:56.649028 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c76422-a075-4cfb-8ebd-2a3f1a5c31ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:56.649953 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c76422-a075-4cfb-8ebd-2a3f1a5c31ed admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:56.650564 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c76422-a075-4cfb-8ebd-2a3f1a5c31ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:56.651139 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c76422-a075-4cfb-8ebd-2a3f1a5c31ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:56.652119 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c76422-a075-4cfb-8ebd-2a3f1a5c31ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:56.654384 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c76422-a075-4cfb-8ebd-2a3f1a5c31ed admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:56.679394 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-363b2592-5e0d-43ef-add4-ff315bc9b5d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18907b4148b141678514d6ee774e1e94'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:56.686962 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1149/2285] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:56:56 2022] POST /identity/v3/projects => generated 363 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:56:56.691478 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c76422-a075-4cfb-8ebd-2a3f1a5c31ed admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:56.695339 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-363b2592-5e0d-43ef-add4-ff315bc9b5d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18907b4148b141678514d6ee774e1e94'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:56.704414 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-363b2592-5e0d-43ef-add4-ff315bc9b5d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18907b4148b141678514d6ee774e1e94'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:56.715091 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-363b2592-5e0d-43ef-add4-ff315bc9b5d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18907b4148b141678514d6ee774e1e94'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:56.717142 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-363b2592-5e0d-43ef-add4-ff315bc9b5d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18907b4148b141678514d6ee774e1e94'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:56.726653 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1137/2286] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:56:56 2022] DELETE /identity/v3/users/18907b4148b141678514d6ee774e1e94 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:56.800480 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c76422-a075-4cfb-8ebd-2a3f1a5c31ed admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:56.875076 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b0c5f-6333-407c-9675-f6d1d8f92201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:56.875779 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b0c5f-6333-407c-9675-f6d1d8f92201 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:56.876079 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b0c5f-6333-407c-9675-f6d1d8f92201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:56.876355 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b0c5f-6333-407c-9675-f6d1d8f92201 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:56.876988 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b0c5f-6333-407c-9675-f6d1d8f92201 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:56.879046 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b0c5f-6333-407c-9675-f6d1d8f92201 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:56.905280 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1150/2287] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:56:56 2022] POST /identity/v3/users => generated 282 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:56:56.909764 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b2592-5e0d-43ef-add4-ff315bc9b5d1 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:56.911235 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-363b2592-5e0d-43ef-add4-ff315bc9b5d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:56.926517 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b2592-5e0d-43ef-add4-ff315bc9b5d1 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:56.931714 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fddc55d-a31b-4f6e-943b-29236ff2d097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:56.932321 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fddc55d-a31b-4f6e-943b-29236ff2d097 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:56.932599 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fddc55d-a31b-4f6e-943b-29236ff2d097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:56.932874 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fddc55d-a31b-4f6e-943b-29236ff2d097 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:56.933516 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fddc55d-a31b-4f6e-943b-29236ff2d097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:56.936082 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fddc55d-a31b-4f6e-943b-29236ff2d097 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:56.949202 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1138/2288] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:56.950897 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b0c5f-6333-407c-9675-f6d1d8f92201 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:56.961351 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b0c5f-6333-407c-9675-f6d1d8f92201 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:56.966188 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceaa352-be72-421e-817c-01125e17278c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:56.966914 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaa352-be72-421e-817c-01125e17278c admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:56.967197 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaa352-be72-421e-817c-01125e17278c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:56.967470 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaa352-be72-421e-817c-01125e17278c admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:56.968122 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceaa352-be72-421e-817c-01125e17278c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:56.969728 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceaa352-be72-421e-817c-01125e17278c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:56.984993 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1151/2289] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:56.987124 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fddc55d-a31b-4f6e-943b-29236ff2d097 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:56.999057 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fddc55d-a31b-4f6e-943b-29236ff2d097 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:57.004073 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d83aed-f250-4fe7-b53c-164847fd222b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:57.004750 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d83aed-f250-4fe7-b53c-164847fd222b admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:57.005142 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d83aed-f250-4fe7-b53c-164847fd222b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:57.005418 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d83aed-f250-4fe7-b53c-164847fd222b admin admin] PATH_INFO: `/v3/projects/cec14feefe27453dbca55ef63720a379/users/cebd4af658604d66861f3f7e0f13d7cc/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:57.021370 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d83aed-f250-4fe7-b53c-164847fd222b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cec14feefe27453dbca55ef63720a379, user_id=cebd4af658604d66861f3f7e0f13d7cc, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:57.024240 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d83aed-f250-4fe7-b53c-164847fd222b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:57.039241 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1139/2290] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:56:56 2022] PUT /identity/v3/projects/cec14feefe27453dbca55ef63720a379/users/cebd4af658604d66861f3f7e0f13d7cc/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:57.050863 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440bdd46-417f-4636-bc56-d59090113ad6 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:57.051187 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440bdd46-417f-4636-bc56-d59090113ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:57.051488 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440bdd46-417f-4636-bc56-d59090113ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:57.081036 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-440bdd46-417f-4636-bc56-d59090113ad6 None None] MFA Rules not processed for user `cebd4af658604d66861f3f7e0f13d7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:57.082277 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-440bdd46-417f-4636-bc56-d59090113ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:57.111562 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d83aed-f250-4fe7-b53c-164847fd222b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:57.113372 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-09d83aed-f250-4fe7-b53c-164847fd222b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:57.114193 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:57.164345 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1152/2291] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:57.170363 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:INSERT=3,keystone:DELETE=11,keystone:SELECT=86 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:57.178156 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440bdd46-417f-4636-bc56-d59090113ad6 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:57.180398 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-440bdd46-417f-4636-bc56-d59090113ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:57.199642 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d83aed-f250-4fe7-b53c-164847fd222b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:57.204596 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7cac0-6726-4316-a2e3-4490263b36cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:57.205271 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7cac0-6726-4316-a2e3-4490263b36cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:57.205648 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7cac0-6726-4316-a2e3-4490263b36cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:57.206017 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7cac0-6726-4316-a2e3-4490263b36cc admin admin] PATH_INFO: `/v3/projects/cf4512763191438b98291827563bdfc6` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:57.207196 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7cac0-6726-4316-a2e3-4490263b36cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf4512763191438b98291827563bdfc6)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:57.209175 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7cac0-6726-4316-a2e3-4490263b36cc admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:57.243281 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440bdd46-417f-4636-bc56-d59090113ad6 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:57.247515 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71555aeb-9a9e-482e-955f-90dd6b7f983b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:57.248181 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71555aeb-9a9e-482e-955f-90dd6b7f983b service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:57.248466 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71555aeb-9a9e-482e-955f-90dd6b7f983b service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:57.249108 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71555aeb-9a9e-482e-955f-90dd6b7f983b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:57.257808 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71555aeb-9a9e-482e-955f-90dd6b7f983b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:57.259279 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71555aeb-9a9e-482e-955f-90dd6b7f983b service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:57.264292 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-31f7cac0-6726-4316-a2e3-4490263b36cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf4512763191438b98291827563bdfc6', 'request_id': 'req-31f7cac0-6726-4316-a2e3-4490263b36cc'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:57.269253 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1153/2292] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:57.270914 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-31f7cac0-6726-4316-a2e3-4490263b36cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf4512763191438b98291827563bdfc6', 'request_id': 'req-31f7cac0-6726-4316-a2e3-4490263b36cc'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:57.277305 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-31f7cac0-6726-4316-a2e3-4490263b36cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf4512763191438b98291827563bdfc6', 'request_id': 'req-31f7cac0-6726-4316-a2e3-4490263b36cc'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:57.291751 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-31f7cac0-6726-4316-a2e3-4490263b36cc admin admin] The token cache is being invalidate because project cf4512763191438b98291827563bdfc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:56:57.292237 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-31f7cac0-6726-4316-a2e3-4490263b36cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:57.292941 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-31f7cac0-6726-4316-a2e3-4490263b36cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:57.294946 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1140/2293] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:56:57 2022] DELETE /identity/v3/projects/cf4512763191438b98291827563bdfc6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:56:57.299649 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301889d-2cf7-44dc-a21f-f58c6e6f353f None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:57.300037 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301889d-2cf7-44dc-a21f-f58c6e6f353f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:57.300403 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301889d-2cf7-44dc-a21f-f58c6e6f353f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:57.333621 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-a301889d-2cf7-44dc-a21f-f58c6e6f353f None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:57.335120 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a301889d-2cf7-44dc-a21f-f58c6e6f353f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:57.463196 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66938d16-4c03-4d7d-aa50-77a4e51c2553 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:57.463486 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66938d16-4c03-4d7d-aa50-77a4e51c2553 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:57.463761 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66938d16-4c03-4d7d-aa50-77a4e51c2553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:57.473960 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1154/2294] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:56:57.506575 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-66938d16-4c03-4d7d-aa50-77a4e51c2553 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:57.507779 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-66938d16-4c03-4d7d-aa50-77a4e51c2553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:57.544269 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301889d-2cf7-44dc-a21f-f58c6e6f353f None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:57.556684 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301889d-2cf7-44dc-a21f-f58c6e6f353f None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:57.557670 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1141/2295] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:57.564207 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80206698-e98d-465b-a52d-29ec06a4b14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:57.564931 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80206698-e98d-465b-a52d-29ec06a4b14e admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:57.565303 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80206698-e98d-465b-a52d-29ec06a4b14e admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:57.565550 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80206698-e98d-465b-a52d-29ec06a4b14e admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:57.566237 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80206698-e98d-465b-a52d-29ec06a4b14e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:56:57.566538 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80206698-e98d-465b-a52d-29ec06a4b14e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:57.569366 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80206698-e98d-465b-a52d-29ec06a4b14e admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:57.585965 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1155/2296] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:56:57.592604 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66938d16-4c03-4d7d-aa50-77a4e51c2553 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:57.611451 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66938d16-4c03-4d7d-aa50-77a4e51c2553 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:57.628066 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296d003-5fed-4113-8669-3bf48518d228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:57.628784 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296d003-5fed-4113-8669-3bf48518d228 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:57.629085 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296d003-5fed-4113-8669-3bf48518d228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:57.629351 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296d003-5fed-4113-8669-3bf48518d228 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:57.630023 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296d003-5fed-4113-8669-3bf48518d228 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:57.632044 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296d003-5fed-4113-8669-3bf48518d228 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:57.705907 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1142/2297] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:56:57 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:56:57.708483 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80206698-e98d-465b-a52d-29ec06a4b14e admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:57.721205 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80206698-e98d-465b-a52d-29ec06a4b14e admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:57.785442 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:57.796096 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e67a7e-6f07-4147-9d4e-a10a2d02622d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:57.797711 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e67a7e-6f07-4147-9d4e-a10a2d02622d admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:57.798227 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e67a7e-6f07-4147-9d4e-a10a2d02622d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:57.799581 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e67a7e-6f07-4147-9d4e-a10a2d02622d admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:57.800391 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e67a7e-6f07-4147-9d4e-a10a2d02622d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:57.805360 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e67a7e-6f07-4147-9d4e-a10a2d02622d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:57.840422 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1156/2298] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:56:57 2022] POST /identity/v3/users => generated 286 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:56:57.842479 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296d003-5fed-4113-8669-3bf48518d228 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:57.853793 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296d003-5fed-4113-8669-3bf48518d228 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:57.859975 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef9274-c213-441e-bea1-719eb84b7597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:57.860609 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef9274-c213-441e-bea1-719eb84b7597 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:57.860960 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef9274-c213-441e-bea1-719eb84b7597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:57.861302 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef9274-c213-441e-bea1-719eb84b7597 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:57.862077 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef9274-c213-441e-bea1-719eb84b7597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:57.863882 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef9274-c213-441e-bea1-719eb84b7597 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:57.875671 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1143/2299] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:56:57.880478 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e67a7e-6f07-4147-9d4e-a10a2d02622d admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:57.890728 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e67a7e-6f07-4147-9d4e-a10a2d02622d admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:57.895720 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e90578-2c36-40b6-985b-11c9557171fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:57.896321 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e90578-2c36-40b6-985b-11c9557171fe admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:57.896595 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e90578-2c36-40b6-985b-11c9557171fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:57.896849 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e90578-2c36-40b6-985b-11c9557171fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:57.897486 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e90578-2c36-40b6-985b-11c9557171fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:57.899118 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e90578-2c36-40b6-985b-11c9557171fe admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:57.910578 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1157/2300] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:56:57.914705 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef9274-c213-441e-bea1-719eb84b7597 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:57.926024 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef9274-c213-441e-bea1-719eb84b7597 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:57.931121 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a49c10-800b-4874-a2b6-a2849383fc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:57.931787 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a49c10-800b-4874-a2b6-a2849383fc2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:57.932079 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a49c10-800b-4874-a2b6-a2849383fc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:57.932328 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a49c10-800b-4874-a2b6-a2849383fc2d admin admin] PATH_INFO: `/v3/projects/8ab338ac27f04ccf81e6654f4f4f38a6/users/dc2cda9d8ec04b09af03f4207b0ce094/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:57.951263 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a49c10-800b-4874-a2b6-a2849383fc2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ab338ac27f04ccf81e6654f4f4f38a6, user_id=dc2cda9d8ec04b09af03f4207b0ce094, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:57.954680 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a49c10-800b-4874-a2b6-a2849383fc2d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:57.976970 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1144/2301] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:56:57 2022] PUT /identity/v3/projects/8ab338ac27f04ccf81e6654f4f4f38a6/users/dc2cda9d8ec04b09af03f4207b0ce094/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:57.982186 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b4d6d-1f94-4354-ac70-e468ba5e5f2b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:57.982467 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b4d6d-1f94-4354-ac70-e468ba5e5f2b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:57.982850 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b4d6d-1f94-4354-ac70-e468ba5e5f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:58.025465 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-500b4d6d-1f94-4354-ac70-e468ba5e5f2b None None] MFA Rules not processed for user `dc2cda9d8ec04b09af03f4207b0ce094`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:58.026830 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-500b4d6d-1f94-4354-ac70-e468ba5e5f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:58.093621 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1158/2302] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:58.110344 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a49c10-800b-4874-a2b6-a2849383fc2d admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:58.112345 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-78a49c10-800b-4874-a2b6-a2849383fc2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:58.180138 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a49c10-800b-4874-a2b6-a2849383fc2d admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:58.187366 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3baab4d-70bf-4fc3-b2fa-49ec948a7e7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:58.188332 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3baab4d-70bf-4fc3-b2fa-49ec948a7e7a service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:58.188775 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3baab4d-70bf-4fc3-b2fa-49ec948a7e7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:58.189361 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3baab4d-70bf-4fc3-b2fa-49ec948a7e7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:58.203779 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3baab4d-70bf-4fc3-b2fa-49ec948a7e7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:58.205213 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3baab4d-70bf-4fc3-b2fa-49ec948a7e7a service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:58.216236 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1145/2303] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:58.247239 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b4d6d-1f94-4354-ac70-e468ba5e5f2b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:58.331251 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b4d6d-1f94-4354-ac70-e468ba5e5f2b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:58.345457 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fca0c-8ecc-4c28-98f3-236e723f91dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:58.345457 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fca0c-8ecc-4c28-98f3-236e723f91dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:58.345457 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fca0c-8ecc-4c28-98f3-236e723f91dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:58.345457 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fca0c-8ecc-4c28-98f3-236e723f91dd admin admin] PATH_INFO: `/v3/users/dc2cda9d8ec04b09af03f4207b0ce094` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:58.345885 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2fca0c-8ecc-4c28-98f3-236e723f91dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc2cda9d8ec04b09af03f4207b0ce094)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:58.347151 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2fca0c-8ecc-4c28-98f3-236e723f91dd admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:58.412339 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6c2fca0c-8ecc-4c28-98f3-236e723f91dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc2cda9d8ec04b09af03f4207b0ce094'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:58.423226 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6c2fca0c-8ecc-4c28-98f3-236e723f91dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc2cda9d8ec04b09af03f4207b0ce094'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:58.433394 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6c2fca0c-8ecc-4c28-98f3-236e723f91dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc2cda9d8ec04b09af03f4207b0ce094'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:58.435706 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:58.449522 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6c2fca0c-8ecc-4c28-98f3-236e723f91dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc2cda9d8ec04b09af03f4207b0ce094'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:58.450590 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6c2fca0c-8ecc-4c28-98f3-236e723f91dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc2cda9d8ec04b09af03f4207b0ce094'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:58.457668 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1159/2304] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:56:58 2022] DELETE /identity/v3/users/dc2cda9d8ec04b09af03f4207b0ce094 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:56:58.464457 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ea85b-6a13-47b1-aa42-7df8534afdd4 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:58.464779 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ea85b-6a13-47b1-aa42-7df8534afdd4 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:58.465133 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ea85b-6a13-47b1-aa42-7df8534afdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:58.473968 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:58.488424 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-bf0ea85b-6a13-47b1-aa42-7df8534afdd4 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:58.490284 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bf0ea85b-6a13-47b1-aa42-7df8534afdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:58.567913 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1146/2305] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:58.580148 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fca0c-8ecc-4c28-98f3-236e723f91dd admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:58.581684 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6c2fca0c-8ecc-4c28-98f3-236e723f91dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:58.658742 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fca0c-8ecc-4c28-98f3-236e723f91dd admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:58.662963 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c583e-9453-4b7a-ae61-4972b0849336 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:58.663645 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c583e-9453-4b7a-ae61-4972b0849336 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:58.664042 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c583e-9453-4b7a-ae61-4972b0849336 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:58.664255 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c583e-9453-4b7a-ae61-4972b0849336 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:58.674927 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c583e-9453-4b7a-ae61-4972b0849336 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:58.676374 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c583e-9453-4b7a-ae61-4972b0849336 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:58.687421 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1160/2306] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:59.034971 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ea85b-6a13-47b1-aa42-7df8534afdd4 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:59.036907 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bf0ea85b-6a13-47b1-aa42-7df8534afdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:59.079713 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ea85b-6a13-47b1-aa42-7df8534afdd4 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:59.088433 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c464b-80b4-4aa4-8de1-cef27609e1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:59.089119 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c464b-80b4-4aa4-8de1-cef27609e1a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:59.089606 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c464b-80b4-4aa4-8de1-cef27609e1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:59.090150 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c464b-80b4-4aa4-8de1-cef27609e1a7 admin admin] PATH_INFO: `/v3/projects/8ab338ac27f04ccf81e6654f4f4f38a6` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:59.092116 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c464b-80b4-4aa4-8de1-cef27609e1a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ab338ac27f04ccf81e6654f4f4f38a6)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:59.095074 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c464b-80b4-4aa4-8de1-cef27609e1a7 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:59.191460 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-113c464b-80b4-4aa4-8de1-cef27609e1a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ab338ac27f04ccf81e6654f4f4f38a6', 'request_id': 'req-113c464b-80b4-4aa4-8de1-cef27609e1a7'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:59.198731 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-113c464b-80b4-4aa4-8de1-cef27609e1a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ab338ac27f04ccf81e6654f4f4f38a6', 'request_id': 'req-113c464b-80b4-4aa4-8de1-cef27609e1a7'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:59.207433 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-113c464b-80b4-4aa4-8de1-cef27609e1a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ab338ac27f04ccf81e6654f4f4f38a6', 'request_id': 'req-113c464b-80b4-4aa4-8de1-cef27609e1a7'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:59.225496 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-113c464b-80b4-4aa4-8de1-cef27609e1a7 admin admin] The token cache is being invalidate because project 8ab338ac27f04ccf81e6654f4f4f38a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:56:59.225788 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-113c464b-80b4-4aa4-8de1-cef27609e1a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:59.226828 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-113c464b-80b4-4aa4-8de1-cef27609e1a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:56:59.241890 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1147/2307] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:56:59 2022] DELETE /identity/v3/projects/8ab338ac27f04ccf81e6654f4f4f38a6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:08.682124 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=32,keystone:DELETE=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:09.222948 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:09.327064 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be88b8-485b-4df4-981e-5029aa91bd33 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:09.327570 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be88b8-485b-4df4-981e-5029aa91bd33 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:09.327956 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be88b8-485b-4df4-981e-5029aa91bd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:09.348590 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-25be88b8-485b-4df4-981e-5029aa91bd33 None None] MFA Rules not processed for user `3302fdf33b5b4583a10e7c760c577cda`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:09.349815 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-25be88b8-485b-4df4-981e-5029aa91bd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:09.407009 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1161/2308] 10.222.0.52 () {58 vars in 1009 bytes} [Sun Aug 28 00:57:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:09.455686 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c464b-80b4-4aa4-8de1-cef27609e1a7 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:09.457193 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-113c464b-80b4-4aa4-8de1-cef27609e1a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:09.528493 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c464b-80b4-4aa4-8de1-cef27609e1a7 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:09.534185 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cd591-2207-464b-ade2-088bceab7f23 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80a6019cf424c16a1d461a632cf8568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:09.534810 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cd591-2207-464b-ade2-088bceab7f23 service swift] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:09.535091 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cd591-2207-464b-ade2-088bceab7f23 service swift] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:09.535549 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cd591-2207-464b-ade2-088bceab7f23 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:09.544602 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746cd591-2207-464b-ade2-088bceab7f23 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:09.546342 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746cd591-2207-464b-ade2-088bceab7f23 service swift] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:09.554861 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1148/2309] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Aug 28 00:57:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 00:57:19.399747 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=25 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:19.551407 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=32 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:23.527189 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba1264-ace0-4a33-b7c3-40ec2b73354e None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:23.527785 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba1264-ace0-4a33-b7c3-40ec2b73354e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:23.528056 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba1264-ace0-4a33-b7c3-40ec2b73354e None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:23.538527 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8174f0-c4c6-4c45-a440-0d405317cbde None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:23.538527 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8174f0-c4c6-4c45-a440-0d405317cbde None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:23.538527 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8174f0-c4c6-4c45-a440-0d405317cbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:23.539180 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1162/2310] 10.222.0.52 () {54 vars in 921 bytes} [Sun Aug 28 00:57:23 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:57:23.557973 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-ed8174f0-c4c6-4c45-a440-0d405317cbde None None] MFA Rules not processed for user `f890ff4e7807477db7f17c2f6434dce8`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:23.559584 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ed8174f0-c4c6-4c45-a440-0d405317cbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:23.630392 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1149/2311] 10.222.0.52 () {58 vars in 1018 bytes} [Sun Aug 28 00:57:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:57:23.641866 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba1264-ace0-4a33-b7c3-40ec2b73354e None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:23.643661 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-91ba1264-ace0-4a33-b7c3-40ec2b73354e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:23.703154 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba1264-ace0-4a33-b7c3-40ec2b73354e None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:23.707644 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b129a1-e049-4786-bb43-66a02a2aba09 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34fd9f7932e14a409d7668d40ff6680e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:23.708252 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b129a1-e049-4786-bb43-66a02a2aba09 service glance] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:23.708530 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b129a1-e049-4786-bb43-66a02a2aba09 service glance] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:23.708801 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b129a1-e049-4786-bb43-66a02a2aba09 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:23.719997 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b129a1-e049-4786-bb43-66a02a2aba09 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:23.721382 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b129a1-e049-4786-bb43-66a02a2aba09 service glance] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:23.732830 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1163/2312] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:23.809269 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e1eac-393c-4324-8636-25340f70911f None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:23.809584 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e1eac-393c-4324-8636-25340f70911f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:23.809871 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e1eac-393c-4324-8636-25340f70911f None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:23.811225 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1150/2313] 10.222.0.52 () {54 vars in 921 bytes} [Sun Aug 28 00:57:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:57:23.816086 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee9955-e751-4c1b-8690-3e364a32c4c9 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:23.816392 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee9955-e751-4c1b-8690-3e364a32c4c9 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:23.816687 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee9955-e751-4c1b-8690-3e364a32c4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:23.837644 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-a4ee9955-e751-4c1b-8690-3e364a32c4c9 None None] MFA Rules not processed for user `0ca94d8693c64e388bd0d15db07f5fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:23.838845 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a4ee9955-e751-4c1b-8690-3e364a32c4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:23.889440 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1164/2314] 10.222.0.52 () {58 vars in 1018 bytes} [Sun Aug 28 00:57:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:57:23.901407 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e1eac-393c-4324-8636-25340f70911f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:23.903388 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4b1e1eac-393c-4324-8636-25340f70911f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:23.917444 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e1eac-393c-4324-8636-25340f70911f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:23.921722 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bc694-e472-4d61-ad36-7d07ff43e195 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:23.922355 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bc694-e472-4d61-ad36-7d07ff43e195 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:23.922634 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bc694-e472-4d61-ad36-7d07ff43e195 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:23.922901 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bc694-e472-4d61-ad36-7d07ff43e195 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:23.930410 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bc694-e472-4d61-ad36-7d07ff43e195 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:23.931902 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bc694-e472-4d61-ad36-7d07ff43e195 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:23.940573 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1151/2315] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:24.024963 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4527174-073f-49b3-9be3-50db41bc8a34 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:24.025347 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4527174-073f-49b3-9be3-50db41bc8a34 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:24.025626 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4527174-073f-49b3-9be3-50db41bc8a34 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:24.027081 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1165/2316] 10.222.0.52 () {54 vars in 921 bytes} [Sun Aug 28 00:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:57:24.033559 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb2958-d77d-4c76-acd4-cbb0c25d3ea9 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:24.033938 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb2958-d77d-4c76-acd4-cbb0c25d3ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:24.034393 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb2958-d77d-4c76-acd4-cbb0c25d3ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:24.064042 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e3bb2958-d77d-4c76-acd4-cbb0c25d3ea9 None None] MFA Rules not processed for user `f890ff4e7807477db7f17c2f6434dce8`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:24.065276 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e3bb2958-d77d-4c76-acd4-cbb0c25d3ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:24.076538 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1152/2317] 10.222.0.52 () {58 vars in 1018 bytes} [Sun Aug 28 00:57:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:24.087790 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4527174-073f-49b3-9be3-50db41bc8a34 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:24.090023 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f4527174-073f-49b3-9be3-50db41bc8a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:24.105036 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4527174-073f-49b3-9be3-50db41bc8a34 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:24.109778 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1798d-51cb-4dff-ae35-1ae771cca862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:24.110436 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1798d-51cb-4dff-ae35-1ae771cca862 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:24.110713 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1798d-51cb-4dff-ae35-1ae771cca862 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:24.110983 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1798d-51cb-4dff-ae35-1ae771cca862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:24.122505 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1798d-51cb-4dff-ae35-1ae771cca862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:24.123952 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1798d-51cb-4dff-ae35-1ae771cca862 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:24.135473 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1166/2318] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:26.734285 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1d3f4-8223-43e7-b607-9604336eee53 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:26.734751 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1d3f4-8223-43e7-b607-9604336eee53 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:26.734871 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1d3f4-8223-43e7-b607-9604336eee53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:26.755711 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-cda1d3f4-8223-43e7-b607-9604336eee53 None None] MFA Rules not processed for user `3302fdf33b5b4583a10e7c760c577cda`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:26.757075 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-cda1d3f4-8223-43e7-b607-9604336eee53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:26.766890 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1153/2319] 10.222.0.52 () {58 vars in 1009 bytes} [Sun Aug 28 00:57:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:26.779761 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1798d-51cb-4dff-ae35-1ae771cca862 service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:26.791778 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1798d-51cb-4dff-ae35-1ae771cca862 service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:26.797830 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717375f1-4b0d-4a8e-bd79-57898b26a76a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80a6019cf424c16a1d461a632cf8568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:26.798449 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717375f1-4b0d-4a8e-bd79-57898b26a76a service swift] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:26.798727 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717375f1-4b0d-4a8e-bd79-57898b26a76a service swift] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:26.798993 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717375f1-4b0d-4a8e-bd79-57898b26a76a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:26.807051 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717375f1-4b0d-4a8e-bd79-57898b26a76a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:26.808630 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717375f1-4b0d-4a8e-bd79-57898b26a76a service swift] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:26.817495 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1167/2320] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Aug 28 00:57:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 00:57:30.090880 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1d3f4-8223-43e7-b607-9604336eee53 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:30.092318 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-cda1d3f4-8223-43e7-b607-9604336eee53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:30.166922 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1d3f4-8223-43e7-b607-9604336eee53 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:30.172447 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86474e0c-8dda-452d-be59-963e3ff3404c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:30.173309 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86474e0c-8dda-452d-be59-963e3ff3404c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:30.173592 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86474e0c-8dda-452d-be59-963e3ff3404c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:30.173889 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86474e0c-8dda-452d-be59-963e3ff3404c admin admin] PATH_INFO: `/v3/users/cebd4af658604d66861f3f7e0f13d7cc` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:30.175317 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86474e0c-8dda-452d-be59-963e3ff3404c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cebd4af658604d66861f3f7e0f13d7cc)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:30.177424 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86474e0c-8dda-452d-be59-963e3ff3404c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:30.243131 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-86474e0c-8dda-452d-be59-963e3ff3404c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cebd4af658604d66861f3f7e0f13d7cc'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:30.256600 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-86474e0c-8dda-452d-be59-963e3ff3404c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cebd4af658604d66861f3f7e0f13d7cc'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:30.259385 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:30.267390 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-86474e0c-8dda-452d-be59-963e3ff3404c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cebd4af658604d66861f3f7e0f13d7cc'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:30.276370 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-86474e0c-8dda-452d-be59-963e3ff3404c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cebd4af658604d66861f3f7e0f13d7cc'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:30.277009 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-86474e0c-8dda-452d-be59-963e3ff3404c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cebd4af658604d66861f3f7e0f13d7cc'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:30.283789 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1154/2321] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:57:30 2022] DELETE /identity/v3/users/cebd4af658604d66861f3f7e0f13d7cc => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:30.288292 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfd816-b34d-403c-91fd-9e05dc98a12b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:30.288792 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfd816-b34d-403c-91fd-9e05dc98a12b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:30.288934 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfd816-b34d-403c-91fd-9e05dc98a12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:30.309454 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-36dfd816-b34d-403c-91fd-9e05dc98a12b None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:30.310788 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-36dfd816-b34d-403c-91fd-9e05dc98a12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:30.377257 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1168/2322] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:57:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:57:30.388954 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86474e0c-8dda-452d-be59-963e3ff3404c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:30.390499 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-86474e0c-8dda-452d-be59-963e3ff3404c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:30.451448 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86474e0c-8dda-452d-be59-963e3ff3404c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:30.455303 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c8282-6c75-4bcf-8df9-cf1949024867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:30.455951 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c8282-6c75-4bcf-8df9-cf1949024867 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:30.456230 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c8282-6c75-4bcf-8df9-cf1949024867 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:30.456499 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c8282-6c75-4bcf-8df9-cf1949024867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:30.465895 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c8282-6c75-4bcf-8df9-cf1949024867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:30.467418 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c8282-6c75-4bcf-8df9-cf1949024867 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:30.478197 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1155/2323] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:30.846216 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfd816-b34d-403c-91fd-9e05dc98a12b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:30.847824 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-36dfd816-b34d-403c-91fd-9e05dc98a12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:30.881898 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfd816-b34d-403c-91fd-9e05dc98a12b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:30.891854 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ef52a-2ae0-4b26-9702-166ebd85a257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:30.892915 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ef52a-2ae0-4b26-9702-166ebd85a257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:30.893407 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ef52a-2ae0-4b26-9702-166ebd85a257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:30.893920 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ef52a-2ae0-4b26-9702-166ebd85a257 admin admin] PATH_INFO: `/v3/projects/cec14feefe27453dbca55ef63720a379` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:30.895662 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ef52a-2ae0-4b26-9702-166ebd85a257 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cec14feefe27453dbca55ef63720a379)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:30.898098 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ef52a-2ae0-4b26-9702-166ebd85a257 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:30.929383 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:30.972673 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9d2ef52a-2ae0-4b26-9702-166ebd85a257 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cec14feefe27453dbca55ef63720a379', 'request_id': 'req-9d2ef52a-2ae0-4b26-9702-166ebd85a257'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:30.982818 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9d2ef52a-2ae0-4b26-9702-166ebd85a257 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cec14feefe27453dbca55ef63720a379', 'request_id': 'req-9d2ef52a-2ae0-4b26-9702-166ebd85a257'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:30.990718 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9d2ef52a-2ae0-4b26-9702-166ebd85a257 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cec14feefe27453dbca55ef63720a379', 'request_id': 'req-9d2ef52a-2ae0-4b26-9702-166ebd85a257'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:31.004426 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9d2ef52a-2ae0-4b26-9702-166ebd85a257 admin admin] The token cache is being invalidate because project cec14feefe27453dbca55ef63720a379 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:57:31.005087 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9d2ef52a-2ae0-4b26-9702-166ebd85a257 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:31.006060 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9d2ef52a-2ae0-4b26-9702-166ebd85a257 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:31.007835 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1169/2324] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:57:30 2022] DELETE /identity/v3/projects/cec14feefe27453dbca55ef63720a379 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:40.473042 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=31,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:40.999796 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:DELETE=7,keystone:SELECT=15,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:44.916050 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fbcd4-0bcf-4fc1-b4e5-8a8497f7a127 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:44.916577 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fbcd4-0bcf-4fc1-b4e5-8a8497f7a127 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:44.916577 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fbcd4-0bcf-4fc1-b4e5-8a8497f7a127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:44.936911 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b13fbcd4-0bcf-4fc1-b4e5-8a8497f7a127 None None] MFA Rules not processed for user `3302fdf33b5b4583a10e7c760c577cda`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:44.938166 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b13fbcd4-0bcf-4fc1-b4e5-8a8497f7a127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:45.014720 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1156/2325] 10.222.0.52 () {58 vars in 967 bytes} [Sun Aug 28 00:57:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:45.031247 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ef52a-2ae0-4b26-9702-166ebd85a257 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:45.032820 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9d2ef52a-2ae0-4b26-9702-166ebd85a257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:45.106634 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ef52a-2ae0-4b26-9702-166ebd85a257 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:45.111860 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875becb-b0e0-4107-9525-49e72ffd136e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80a6019cf424c16a1d461a632cf8568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:45.112418 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875becb-b0e0-4107-9525-49e72ffd136e service swift] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:45.112696 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875becb-b0e0-4107-9525-49e72ffd136e service swift] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:45.112966 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875becb-b0e0-4107-9525-49e72ffd136e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:45.121350 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875becb-b0e0-4107-9525-49e72ffd136e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:45.123008 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875becb-b0e0-4107-9525-49e72ffd136e service swift] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:45.131299 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1170/2326] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Aug 28 00:57:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 00:57:55.007547 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=25 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:55.128501 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=32 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:59.747393 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13fbcd4-0bcf-4fc1-b4e5-8a8497f7a127 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:59.750292 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b13fbcd4-0bcf-4fc1-b4e5-8a8497f7a127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:59.852792 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13fbcd4-0bcf-4fc1-b4e5-8a8497f7a127 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:59.859385 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75e7d6-bb11-412f-a003-ecedfe9fa734 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae87149f6ab04a9997263598737ae27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:59.860132 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75e7d6-bb11-412f-a003-ecedfe9fa734 service placement] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:59.860464 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75e7d6-bb11-412f-a003-ecedfe9fa734 service placement] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:59.860800 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75e7d6-bb11-412f-a003-ecedfe9fa734 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:59.863384 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1f75e7d6-bb11-412f-a003-ecedfe9fa734 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:59.876172 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75e7d6-bb11-412f-a003-ecedfe9fa734 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:59.877980 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75e7d6-bb11-412f-a003-ecedfe9fa734 service placement] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:59.902142 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1157/2327] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:58:04.226679 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099f12c-38d5-457d-93d5-f0ce01504311 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:04.227206 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099f12c-38d5-457d-93d5-f0ce01504311 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:04.227206 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099f12c-38d5-457d-93d5-f0ce01504311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:04.248745 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-f099f12c-38d5-457d-93d5-f0ce01504311 None None] MFA Rules not processed for user `687249b94db247b4b608e416559d0556`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:04.249981 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f099f12c-38d5-457d-93d5-f0ce01504311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:04.319630 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1171/2328] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:58:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:07.268909 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7b746-548c-44be-8a8c-f74c0204f1af None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:07.269401 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7b746-548c-44be-8a8c-f74c0204f1af None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:07.269499 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7b746-548c-44be-8a8c-f74c0204f1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:07.292820 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-86e7b746-548c-44be-8a8c-f74c0204f1af None None] MFA Rules not processed for user `5f227aa72915442384469ddc844198dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:07.294115 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-86e7b746-548c-44be-8a8c-f74c0204f1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:07.349746 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1158/2329] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:58:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:14.312391 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=25 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:17.342675 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=57 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:27.911631 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f42ac-7d7f-401f-8fab-b113b9cbdef6 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:27.912127 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f42ac-7d7f-401f-8fab-b113b9cbdef6 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:27.912242 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f42ac-7d7f-401f-8fab-b113b9cbdef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:27.931994 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-f30f42ac-7d7f-401f-8fab-b113b9cbdef6 None None] MFA Rules not processed for user `cc8eaa6c0af74ff3aa6e41189388dc8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:27.933184 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f30f42ac-7d7f-401f-8fab-b113b9cbdef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:27.993696 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1172/2330] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:58:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:37.986546 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=25 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:08.198795 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ce827-550a-442f-ab6b-a59962eb9bbe None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:08.199441 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ce827-550a-442f-ab6b-a59962eb9bbe None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:08.200162 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ce827-550a-442f-ab6b-a59962eb9bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:08.220072 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-cd4ce827-550a-442f-ab6b-a59962eb9bbe None None] MFA Rules not processed for user `1810e64573d145d48b13c774b7a07e60`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:08.221292 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-cd4ce827-550a-442f-ab6b-a59962eb9bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:08.278740 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1159/2331] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:59:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:12.032241 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f42ac-7d7f-401f-8fab-b113b9cbdef6 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:12.034087 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f30f42ac-7d7f-401f-8fab-b113b9cbdef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:12.120982 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f42ac-7d7f-401f-8fab-b113b9cbdef6 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:12.125495 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9e089-3872-421d-8c78-f11f6ff6f51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:12.126167 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9e089-3872-421d-8c78-f11f6ff6f51e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:12.126442 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9e089-3872-421d-8c78-f11f6ff6f51e admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:12.126710 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9e089-3872-421d-8c78-f11f6ff6f51e admin admin] PATH_INFO: `/v3/users/687249b94db247b4b608e416559d0556` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:12.127942 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9e089-3872-421d-8c78-f11f6ff6f51e admin admin] RBAC: Authorizing `identity:delete_user(user_id=687249b94db247b4b608e416559d0556)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:12.130110 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9e089-3872-421d-8c78-f11f6ff6f51e admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:12.178244 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-48f9e089-3872-421d-8c78-f11f6ff6f51e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '687249b94db247b4b608e416559d0556'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:12.186046 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-48f9e089-3872-421d-8c78-f11f6ff6f51e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '687249b94db247b4b608e416559d0556'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:12.193818 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-48f9e089-3872-421d-8c78-f11f6ff6f51e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '687249b94db247b4b608e416559d0556'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:12.206305 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-48f9e089-3872-421d-8c78-f11f6ff6f51e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '687249b94db247b4b608e416559d0556'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:12.206942 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-48f9e089-3872-421d-8c78-f11f6ff6f51e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '687249b94db247b4b608e416559d0556'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:12.213070 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1173/2332] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:59:12 2022] DELETE /identity/v3/users/687249b94db247b4b608e416559d0556 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:12.413739 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ce827-550a-442f-ab6b-a59962eb9bbe None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:12.438400 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ce827-550a-442f-ab6b-a59962eb9bbe None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:12.501017 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320f9b6-09d3-4e04-b060-db7f762739a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:12.501979 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320f9b6-09d3-4e04-b060-db7f762739a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:12.502422 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320f9b6-09d3-4e04-b060-db7f762739a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:12.502696 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320f9b6-09d3-4e04-b060-db7f762739a7 admin admin] PATH_INFO: `/v3/projects/43c85d5220304cce8699c7eb041e35a1` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:12.503836 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320f9b6-09d3-4e04-b060-db7f762739a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43c85d5220304cce8699c7eb041e35a1)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:12.505796 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320f9b6-09d3-4e04-b060-db7f762739a7 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:12.563056 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6320f9b6-09d3-4e04-b060-db7f762739a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43c85d5220304cce8699c7eb041e35a1', 'request_id': 'req-6320f9b6-09d3-4e04-b060-db7f762739a7'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:12.568950 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6320f9b6-09d3-4e04-b060-db7f762739a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43c85d5220304cce8699c7eb041e35a1', 'request_id': 'req-6320f9b6-09d3-4e04-b060-db7f762739a7'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:12.575212 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6320f9b6-09d3-4e04-b060-db7f762739a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43c85d5220304cce8699c7eb041e35a1', 'request_id': 'req-6320f9b6-09d3-4e04-b060-db7f762739a7'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:12.587894 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6320f9b6-09d3-4e04-b060-db7f762739a7 admin admin] The token cache is being invalidate because project 43c85d5220304cce8699c7eb041e35a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:59:12.588249 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6320f9b6-09d3-4e04-b060-db7f762739a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:12.588876 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6320f9b6-09d3-4e04-b060-db7f762739a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:12.590675 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1160/2333] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:59:12 2022] DELETE /identity/v3/projects/43c85d5220304cce8699c7eb041e35a1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:12.595666 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e23597-8498-4d47-ab2a-b2854fe998ff None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:12.595954 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e23597-8498-4d47-ab2a-b2854fe998ff None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:12.596244 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e23597-8498-4d47-ab2a-b2854fe998ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:12.619126 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-c6e23597-8498-4d47-ab2a-b2854fe998ff None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:12.620402 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c6e23597-8498-4d47-ab2a-b2854fe998ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:12.685356 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1174/2334] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:59:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:12.693282 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb44b01-9ae1-45fe-b473-8fb999ea08d3 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:12.693564 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb44b01-9ae1-45fe-b473-8fb999ea08d3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:12.693854 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb44b01-9ae1-45fe-b473-8fb999ea08d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:12.715150 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-deb44b01-9ae1-45fe-b473-8fb999ea08d3 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:12.716326 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-deb44b01-9ae1-45fe-b473-8fb999ea08d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:12.724467 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1161/2335] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:59:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:12.729308 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e23597-8498-4d47-ab2a-b2854fe998ff None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:12.739771 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e23597-8498-4d47-ab2a-b2854fe998ff None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:12.744364 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89ccf8-9273-4b14-aaa3-67853cbdf4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:12.744955 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89ccf8-9273-4b14-aaa3-67853cbdf4f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:12.745229 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89ccf8-9273-4b14-aaa3-67853cbdf4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:12.745495 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89ccf8-9273-4b14-aaa3-67853cbdf4f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:12.746287 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89ccf8-9273-4b14-aaa3-67853cbdf4f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:59:12.746597 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89ccf8-9273-4b14-aaa3-67853cbdf4f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:12.748186 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89ccf8-9273-4b14-aaa3-67853cbdf4f8 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:12.760239 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1175/2336] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:59:12.764800 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb44b01-9ae1-45fe-b473-8fb999ea08d3 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:12.774055 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb44b01-9ae1-45fe-b473-8fb999ea08d3 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:12.779264 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44246b-3100-4964-b9f6-581fd6f59e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:12.780107 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44246b-3100-4964-b9f6-581fd6f59e90 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:12.780107 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44246b-3100-4964-b9f6-581fd6f59e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:12.780107 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44246b-3100-4964-b9f6-581fd6f59e90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:12.780107 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c44246b-3100-4964-b9f6-581fd6f59e90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:12.783280 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c44246b-3100-4964-b9f6-581fd6f59e90 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:12.812292 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1162/2337] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:59:12 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:59:12.816700 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89ccf8-9273-4b14-aaa3-67853cbdf4f8 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:12.827164 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89ccf8-9273-4b14-aaa3-67853cbdf4f8 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:12.830960 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:12.892145 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400dcb04-f56c-472a-a7e6-22ede418c1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:12.892845 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dcb04-f56c-472a-a7e6-22ede418c1dd admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:12.893155 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dcb04-f56c-472a-a7e6-22ede418c1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:12.893460 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dcb04-f56c-472a-a7e6-22ede418c1dd admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:12.894130 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400dcb04-f56c-472a-a7e6-22ede418c1dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:12.896156 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400dcb04-f56c-472a-a7e6-22ede418c1dd admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:12.919279 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1176/2338] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:59:12 2022] POST /identity/v3/users => generated 303 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:59:12.923644 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44246b-3100-4964-b9f6-581fd6f59e90 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:12.934741 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44246b-3100-4964-b9f6-581fd6f59e90 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:12.941746 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48488d-eaea-4978-9513-238f153c3c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:12.942670 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48488d-eaea-4978-9513-238f153c3c54 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:12.942994 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48488d-eaea-4978-9513-238f153c3c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:12.943261 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48488d-eaea-4978-9513-238f153c3c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:12.944053 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48488d-eaea-4978-9513-238f153c3c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:12.945967 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48488d-eaea-4978-9513-238f153c3c54 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:12.947486 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:12.959614 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1163/2339] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:59:12.963386 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400dcb04-f56c-472a-a7e6-22ede418c1dd admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:12.975042 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400dcb04-f56c-472a-a7e6-22ede418c1dd admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:12.980179 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80418fd5-e87b-40b6-acd3-4be84083a3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:12.980843 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80418fd5-e87b-40b6-acd3-4be84083a3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:12.981120 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80418fd5-e87b-40b6-acd3-4be84083a3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:12.981393 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80418fd5-e87b-40b6-acd3-4be84083a3c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:12.982071 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80418fd5-e87b-40b6-acd3-4be84083a3c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:12.983670 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80418fd5-e87b-40b6-acd3-4be84083a3c4 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:12.994532 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1177/2340] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:59:12.998946 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48488d-eaea-4978-9513-238f153c3c54 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:13.009128 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48488d-eaea-4978-9513-238f153c3c54 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:13.013905 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3f357-7c7b-4af6-b89c-14c0d98420c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:13.014565 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3f357-7c7b-4af6-b89c-14c0d98420c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:13.014841 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3f357-7c7b-4af6-b89c-14c0d98420c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:13.015106 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3f357-7c7b-4af6-b89c-14c0d98420c1 admin admin] PATH_INFO: `/v3/projects/9dae3dfeb1e04caeac226366c3eab216/users/d43e41b1dc9b495dbf775ef4f4d26f94/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:13.030517 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3f357-7c7b-4af6-b89c-14c0d98420c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dae3dfeb1e04caeac226366c3eab216, user_id=d43e41b1dc9b495dbf775ef4f4d26f94, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:13.033131 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3f357-7c7b-4af6-b89c-14c0d98420c1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:13.048300 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1164/2341] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:59:12 2022] PUT /identity/v3/projects/9dae3dfeb1e04caeac226366c3eab216/users/d43e41b1dc9b495dbf775ef4f4d26f94/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:59:13.058828 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3173953-da1b-447f-9696-3c2c14006209 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:13.059357 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3173953-da1b-447f-9696-3c2c14006209 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:13.059689 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3173953-da1b-447f-9696-3c2c14006209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:13.089470 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-a3173953-da1b-447f-9696-3c2c14006209 None None] MFA Rules not processed for user `d43e41b1dc9b495dbf775ef4f4d26f94`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:13.090752 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a3173953-da1b-447f-9696-3c2c14006209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:13.179702 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1178/2342] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:59:13 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:59:13.184145 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3f357-7c7b-4af6-b89c-14c0d98420c1 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:13.255136 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3f357-7c7b-4af6-b89c-14c0d98420c1 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:13.259851 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12e0d7-44a5-4f99-a172-9000921f4436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:13.260528 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12e0d7-44a5-4f99-a172-9000921f4436 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:13.260868 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12e0d7-44a5-4f99-a172-9000921f4436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:13.261200 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12e0d7-44a5-4f99-a172-9000921f4436 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:13.262068 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12e0d7-44a5-4f99-a172-9000921f4436 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:13.264197 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12e0d7-44a5-4f99-a172-9000921f4436 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:13.296438 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1165/2343] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:59:13 2022] POST /identity/v3/projects => generated 403 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:59:13.297500 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3173953-da1b-447f-9696-3c2c14006209 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:13.308960 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3173953-da1b-447f-9696-3c2c14006209 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:13.380954 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f032f-6892-49b0-b833-fcc5ee5007e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:13.380954 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f032f-6892-49b0-b833-fcc5ee5007e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:13.381248 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f032f-6892-49b0-b833-fcc5ee5007e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:13.381984 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f032f-6892-49b0-b833-fcc5ee5007e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:13.382372 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f032f-6892-49b0-b833-fcc5ee5007e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:13.384436 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f032f-6892-49b0-b833-fcc5ee5007e7 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:13.410085 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1179/2344] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:59:13 2022] POST /identity/v3/users => generated 308 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:59:13.411380 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12e0d7-44a5-4f99-a172-9000921f4436 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:13.422428 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12e0d7-44a5-4f99-a172-9000921f4436 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:13.427838 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0ccb0-c78d-4ad5-9aa1-f92f8b5d448c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:13.428450 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0ccb0-c78d-4ad5-9aa1-f92f8b5d448c admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:13.428721 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0ccb0-c78d-4ad5-9aa1-f92f8b5d448c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:13.428996 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0ccb0-c78d-4ad5-9aa1-f92f8b5d448c admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:13.429640 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0ccb0-c78d-4ad5-9aa1-f92f8b5d448c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:13.431289 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0ccb0-c78d-4ad5-9aa1-f92f8b5d448c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:13.442383 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1166/2345] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:59:13.446678 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f032f-6892-49b0-b833-fcc5ee5007e7 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:13.453011 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:13.458727 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f032f-6892-49b0-b833-fcc5ee5007e7 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:13.464616 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b284d-322d-4037-9863-6a751af0335b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:13.466010 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b284d-322d-4037-9863-6a751af0335b admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:13.468235 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b284d-322d-4037-9863-6a751af0335b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:13.468503 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b284d-322d-4037-9863-6a751af0335b admin admin] PATH_INFO: `/v3/projects/4868804e1f7246e3ba02c96859dc747e/users/68be54fd810944dea4efe914b15f6ab4/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:13.484641 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b284d-322d-4037-9863-6a751af0335b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4868804e1f7246e3ba02c96859dc747e, user_id=68be54fd810944dea4efe914b15f6ab4, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:13.487316 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b284d-322d-4037-9863-6a751af0335b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:13.502408 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1180/2346] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:59:13 2022] PUT /identity/v3/projects/4868804e1f7246e3ba02c96859dc747e/users/68be54fd810944dea4efe914b15f6ab4/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:59:13.506386 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0ccb0-c78d-4ad5-9aa1-f92f8b5d448c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:13.516867 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0ccb0-c78d-4ad5-9aa1-f92f8b5d448c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:13.580979 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb8870-b0f6-4876-a7de-d836542564f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:13.581603 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb8870-b0f6-4876-a7de-d836542564f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:13.581939 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb8870-b0f6-4876-a7de-d836542564f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:13.582183 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb8870-b0f6-4876-a7de-d836542564f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:13.582832 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb8870-b0f6-4876-a7de-d836542564f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:13.584456 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb8870-b0f6-4876-a7de-d836542564f8 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:13.594654 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1167/2347] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:59:13.598960 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b284d-322d-4037-9863-6a751af0335b admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:13.610513 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b284d-322d-4037-9863-6a751af0335b admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:13.615422 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68581bea-4459-4fe7-ade9-5e9fa9d4dbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:13.616085 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68581bea-4459-4fe7-ade9-5e9fa9d4dbc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:13.616365 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68581bea-4459-4fe7-ade9-5e9fa9d4dbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:13.616639 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68581bea-4459-4fe7-ade9-5e9fa9d4dbc5 admin admin] PATH_INFO: `/v3/projects/4868804e1f7246e3ba02c96859dc747e/users/68be54fd810944dea4efe914b15f6ab4/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:13.618674 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68581bea-4459-4fe7-ade9-5e9fa9d4dbc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4868804e1f7246e3ba02c96859dc747e, user_id=68be54fd810944dea4efe914b15f6ab4, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:13.621507 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68581bea-4459-4fe7-ade9-5e9fa9d4dbc5 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:13.633038 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1181/2348] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:59:13 2022] PUT /identity/v3/projects/4868804e1f7246e3ba02c96859dc747e/users/68be54fd810944dea4efe914b15f6ab4/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:13.645016 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3964ae-c7da-4d6b-9c14-2c5829a22f6d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:13.645254 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3964ae-c7da-4d6b-9c14-2c5829a22f6d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:13.645989 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3964ae-c7da-4d6b-9c14-2c5829a22f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:13.676705 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-4d3964ae-c7da-4d6b-9c14-2c5829a22f6d None None] MFA Rules not processed for user `68be54fd810944dea4efe914b15f6ab4`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:13.678005 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4d3964ae-c7da-4d6b-9c14-2c5829a22f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:13.717151 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:13.766441 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1168/2349] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:59:13 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:13.777545 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68581bea-4459-4fe7-ade9-5e9fa9d4dbc5 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:13.779805 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-68581bea-4459-4fe7-ade9-5e9fa9d4dbc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:13.842969 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68581bea-4459-4fe7-ade9-5e9fa9d4dbc5 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:13.847266 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd481dd3-8d27-4228-9bab-30a586fa5d4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:13.847884 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd481dd3-8d27-4228-9bab-30a586fa5d4b service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:13.848174 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd481dd3-8d27-4228-9bab-30a586fa5d4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:13.848437 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd481dd3-8d27-4228-9bab-30a586fa5d4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:13.859041 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd481dd3-8d27-4228-9bab-30a586fa5d4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:13.860519 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd481dd3-8d27-4228-9bab-30a586fa5d4b service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:13.870727 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1182/2350] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:13 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:14.049315 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3964ae-c7da-4d6b-9c14-2c5829a22f6d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:14.116784 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3964ae-c7da-4d6b-9c14-2c5829a22f6d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:14.122801 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72ea51-2047-4001-9682-52f799c36397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:14.122801 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72ea51-2047-4001-9682-52f799c36397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:14.123094 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72ea51-2047-4001-9682-52f799c36397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:14.123324 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72ea51-2047-4001-9682-52f799c36397 admin admin] PATH_INFO: `/v3/users/d43e41b1dc9b495dbf775ef4f4d26f94` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:14.124657 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72ea51-2047-4001-9682-52f799c36397 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d43e41b1dc9b495dbf775ef4f4d26f94)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:14.126694 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72ea51-2047-4001-9682-52f799c36397 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:14.176494 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-da72ea51-2047-4001-9682-52f799c36397 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd43e41b1dc9b495dbf775ef4f4d26f94'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:14.191190 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-da72ea51-2047-4001-9682-52f799c36397 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd43e41b1dc9b495dbf775ef4f4d26f94'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:14.200062 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-da72ea51-2047-4001-9682-52f799c36397 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd43e41b1dc9b495dbf775ef4f4d26f94'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:14.208220 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-da72ea51-2047-4001-9682-52f799c36397 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd43e41b1dc9b495dbf775ef4f4d26f94'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:14.209056 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-da72ea51-2047-4001-9682-52f799c36397 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd43e41b1dc9b495dbf775ef4f4d26f94'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:14.216106 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1169/2351] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:59:14 2022] DELETE /identity/v3/users/d43e41b1dc9b495dbf775ef4f4d26f94 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:14.220423 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017bf3f-41f0-431d-8d1a-1f90d760f7e0 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:14.220896 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017bf3f-41f0-431d-8d1a-1f90d760f7e0 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:14.221014 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017bf3f-41f0-431d-8d1a-1f90d760f7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:14.240147 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-1017bf3f-41f0-431d-8d1a-1f90d760f7e0 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:14.241375 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1017bf3f-41f0-431d-8d1a-1f90d760f7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:14.307513 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1183/2352] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:59:14.325033 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72ea51-2047-4001-9682-52f799c36397 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:14.326693 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-da72ea51-2047-4001-9682-52f799c36397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:14.394743 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:14.404461 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72ea51-2047-4001-9682-52f799c36397 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:14.410102 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590ecf8-5bf6-4097-9878-3422ae35fb35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:14.410797 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590ecf8-5bf6-4097-9878-3422ae35fb35 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:14.411140 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590ecf8-5bf6-4097-9878-3422ae35fb35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:14.411475 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590ecf8-5bf6-4097-9878-3422ae35fb35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:14.422231 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0590ecf8-5bf6-4097-9878-3422ae35fb35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:14.423807 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0590ecf8-5bf6-4097-9878-3422ae35fb35 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:14.435764 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1170/2353] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:14.922029 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017bf3f-41f0-431d-8d1a-1f90d760f7e0 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:14.923756 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1017bf3f-41f0-431d-8d1a-1f90d760f7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:14.941822 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017bf3f-41f0-431d-8d1a-1f90d760f7e0 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:14.946957 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f15bba-7f46-4049-b60e-2107aef58195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:14.947592 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f15bba-7f46-4049-b60e-2107aef58195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:14.947867 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f15bba-7f46-4049-b60e-2107aef58195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:14.948131 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f15bba-7f46-4049-b60e-2107aef58195 admin admin] PATH_INFO: `/v3/projects/9dae3dfeb1e04caeac226366c3eab216` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:14.949424 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f15bba-7f46-4049-b60e-2107aef58195 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dae3dfeb1e04caeac226366c3eab216)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:14.951388 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f15bba-7f46-4049-b60e-2107aef58195 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:15.001395 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-84f15bba-7f46-4049-b60e-2107aef58195 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dae3dfeb1e04caeac226366c3eab216', 'request_id': 'req-84f15bba-7f46-4049-b60e-2107aef58195'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:15.009664 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-84f15bba-7f46-4049-b60e-2107aef58195 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dae3dfeb1e04caeac226366c3eab216', 'request_id': 'req-84f15bba-7f46-4049-b60e-2107aef58195'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:15.016982 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-84f15bba-7f46-4049-b60e-2107aef58195 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dae3dfeb1e04caeac226366c3eab216', 'request_id': 'req-84f15bba-7f46-4049-b60e-2107aef58195'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:15.020988 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:15.029267 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-84f15bba-7f46-4049-b60e-2107aef58195 admin admin] The token cache is being invalidate because project 9dae3dfeb1e04caeac226366c3eab216 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:59:15.029561 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-84f15bba-7f46-4049-b60e-2107aef58195 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:15.030673 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-84f15bba-7f46-4049-b60e-2107aef58195 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:15.035252 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1184/2354] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:59:14 2022] DELETE /identity/v3/projects/9dae3dfeb1e04caeac226366c3eab216 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:15.036607 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590ecf8-5bf6-4097-9878-3422ae35fb35 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:15.047167 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590ecf8-5bf6-4097-9878-3422ae35fb35 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:15.113596 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806ae1c-db41-40d0-8f05-65682d282f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:15.114261 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806ae1c-db41-40d0-8f05-65682d282f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:15.114541 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806ae1c-db41-40d0-8f05-65682d282f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:15.114812 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806ae1c-db41-40d0-8f05-65682d282f6f admin admin] PATH_INFO: `/v3/users/68be54fd810944dea4efe914b15f6ab4` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:15.115959 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806ae1c-db41-40d0-8f05-65682d282f6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=68be54fd810944dea4efe914b15f6ab4)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:15.117965 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806ae1c-db41-40d0-8f05-65682d282f6f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:15.174740 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1806ae1c-db41-40d0-8f05-65682d282f6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68be54fd810944dea4efe914b15f6ab4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:15.187099 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1806ae1c-db41-40d0-8f05-65682d282f6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68be54fd810944dea4efe914b15f6ab4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:15.193905 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1806ae1c-db41-40d0-8f05-65682d282f6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68be54fd810944dea4efe914b15f6ab4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:15.202379 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1806ae1c-db41-40d0-8f05-65682d282f6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68be54fd810944dea4efe914b15f6ab4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:15.202985 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1806ae1c-db41-40d0-8f05-65682d282f6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68be54fd810944dea4efe914b15f6ab4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:15.209374 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1171/2355] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:59:15 2022] DELETE /identity/v3/users/68be54fd810944dea4efe914b15f6ab4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:15.521748 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f15bba-7f46-4049-b60e-2107aef58195 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:15.523382 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-84f15bba-7f46-4049-b60e-2107aef58195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:15.538348 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f15bba-7f46-4049-b60e-2107aef58195 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:15.604975 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6cebf-a9f6-4a7a-8755-35a2f7dbd09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:15.606269 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6cebf-a9f6-4a7a-8755-35a2f7dbd09e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:15.606756 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6cebf-a9f6-4a7a-8755-35a2f7dbd09e admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:15.607256 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6cebf-a9f6-4a7a-8755-35a2f7dbd09e admin admin] PATH_INFO: `/v3/projects/4868804e1f7246e3ba02c96859dc747e` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:15.608675 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6cebf-a9f6-4a7a-8755-35a2f7dbd09e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4868804e1f7246e3ba02c96859dc747e)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:15.610878 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6cebf-a9f6-4a7a-8755-35a2f7dbd09e admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:15.694922 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-55a6cebf-a9f6-4a7a-8755-35a2f7dbd09e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4868804e1f7246e3ba02c96859dc747e', 'request_id': 'req-55a6cebf-a9f6-4a7a-8755-35a2f7dbd09e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:15.707638 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-55a6cebf-a9f6-4a7a-8755-35a2f7dbd09e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4868804e1f7246e3ba02c96859dc747e', 'request_id': 'req-55a6cebf-a9f6-4a7a-8755-35a2f7dbd09e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:15.724754 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-55a6cebf-a9f6-4a7a-8755-35a2f7dbd09e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4868804e1f7246e3ba02c96859dc747e', 'request_id': 'req-55a6cebf-a9f6-4a7a-8755-35a2f7dbd09e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:15.749425 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-55a6cebf-a9f6-4a7a-8755-35a2f7dbd09e admin admin] The token cache is being invalidate because project 4868804e1f7246e3ba02c96859dc747e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:59:15.749764 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-55a6cebf-a9f6-4a7a-8755-35a2f7dbd09e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:15.751205 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-55a6cebf-a9f6-4a7a-8755-35a2f7dbd09e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:15.753617 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1185/2356] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:59:15 2022] DELETE /identity/v3/projects/4868804e1f7246e3ba02c96859dc747e => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:15.760107 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab8cc7-73de-4832-b3b9-a5903f0daed0 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:15.760624 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab8cc7-73de-4832-b3b9-a5903f0daed0 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:15.761362 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab8cc7-73de-4832-b3b9-a5903f0daed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:15.790857 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-69ab8cc7-73de-4832-b3b9-a5903f0daed0 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:15.792253 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-69ab8cc7-73de-4832-b3b9-a5903f0daed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:15.884541 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1172/2357] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:59:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:15.887290 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472c56a-d85f-4915-b647-c70db56df937 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:15.887525 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472c56a-d85f-4915-b647-c70db56df937 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:15.888349 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472c56a-d85f-4915-b647-c70db56df937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:15.912078 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-8472c56a-d85f-4915-b647-c70db56df937 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:15.913958 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8472c56a-d85f-4915-b647-c70db56df937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:15.923151 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1186/2358] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:59:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:15.927974 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab8cc7-73de-4832-b3b9-a5903f0daed0 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:15.939283 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab8cc7-73de-4832-b3b9-a5903f0daed0 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:15.944134 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba0041-2bd1-4490-ad5c-f95405050aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:15.946287 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba0041-2bd1-4490-ad5c-f95405050aae admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:15.946627 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba0041-2bd1-4490-ad5c-f95405050aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:15.947118 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba0041-2bd1-4490-ad5c-f95405050aae admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:15.947859 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba0041-2bd1-4490-ad5c-f95405050aae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:59:15.948248 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba0041-2bd1-4490-ad5c-f95405050aae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:15.950191 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba0041-2bd1-4490-ad5c-f95405050aae admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:15.953817 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:15.969112 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1173/2359] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:59:15.971421 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472c56a-d85f-4915-b647-c70db56df937 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:15.984310 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472c56a-d85f-4915-b647-c70db56df937 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:15.989913 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c964b6e-fefc-45c9-8531-5c262f619eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:15.990935 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c964b6e-fefc-45c9-8531-5c262f619eec admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:15.991303 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c964b6e-fefc-45c9-8531-5c262f619eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:15.991666 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c964b6e-fefc-45c9-8531-5c262f619eec admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:15.992627 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c964b6e-fefc-45c9-8531-5c262f619eec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:15.994841 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c964b6e-fefc-45c9-8531-5c262f619eec admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:16.032238 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1187/2360] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:59:15 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:59:16.033661 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba0041-2bd1-4490-ad5c-f95405050aae admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:16.045382 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba0041-2bd1-4490-ad5c-f95405050aae admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:16.118788 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c3fb2-2550-4160-9915-78421c9952bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:16.119675 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c3fb2-2550-4160-9915-78421c9952bc admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:16.120203 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c3fb2-2550-4160-9915-78421c9952bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:16.120514 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c3fb2-2550-4160-9915-78421c9952bc admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:16.121967 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c3fb2-2550-4160-9915-78421c9952bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:16.124781 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c3fb2-2550-4160-9915-78421c9952bc admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:16.154255 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1174/2361] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:59:16 2022] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:59:16.155445 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c964b6e-fefc-45c9-8531-5c262f619eec admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:16.166276 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c964b6e-fefc-45c9-8531-5c262f619eec admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:16.171228 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a024655-055b-4e92-aa57-5987cb673b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:16.171831 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a024655-055b-4e92-aa57-5987cb673b27 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:16.172109 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a024655-055b-4e92-aa57-5987cb673b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:16.172379 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a024655-055b-4e92-aa57-5987cb673b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:16.173144 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a024655-055b-4e92-aa57-5987cb673b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:16.174735 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a024655-055b-4e92-aa57-5987cb673b27 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:16.186017 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1188/2362] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:59:16.190196 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c3fb2-2550-4160-9915-78421c9952bc admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:16.201315 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c3fb2-2550-4160-9915-78421c9952bc admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:16.205956 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2598b-a6aa-45cf-b1ba-3c960724fc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:16.206613 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2598b-a6aa-45cf-b1ba-3c960724fc98 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:16.206931 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2598b-a6aa-45cf-b1ba-3c960724fc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:16.207205 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2598b-a6aa-45cf-b1ba-3c960724fc98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:16.208078 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2598b-a6aa-45cf-b1ba-3c960724fc98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:16.210561 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2598b-a6aa-45cf-b1ba-3c960724fc98 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:16.223859 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1175/2363] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:59:16.228192 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a024655-055b-4e92-aa57-5987cb673b27 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:16.239972 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a024655-055b-4e92-aa57-5987cb673b27 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:16.247453 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306928bd-c213-4a88-9fdc-ff99ce066f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:16.248390 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306928bd-c213-4a88-9fdc-ff99ce066f93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:16.248646 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306928bd-c213-4a88-9fdc-ff99ce066f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:16.248918 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306928bd-c213-4a88-9fdc-ff99ce066f93 admin admin] PATH_INFO: `/v3/projects/5f34ad54792c4f3c8868fac283dddb34/users/0bbbfb54fd13414f960b08176f3bab76/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:16.279771 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306928bd-c213-4a88-9fdc-ff99ce066f93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f34ad54792c4f3c8868fac283dddb34, user_id=0bbbfb54fd13414f960b08176f3bab76, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:16.282681 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306928bd-c213-4a88-9fdc-ff99ce066f93 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:16.299975 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1189/2364] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:59:16 2022] PUT /identity/v3/projects/5f34ad54792c4f3c8868fac283dddb34/users/0bbbfb54fd13414f960b08176f3bab76/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:16.311531 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbbee8-95a2-4b7a-937d-d8e34fa620e1 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:16.312160 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbbee8-95a2-4b7a-937d-d8e34fa620e1 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:16.312773 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbbee8-95a2-4b7a-937d-d8e34fa620e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:16.382725 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-07bbbee8-95a2-4b7a-937d-d8e34fa620e1 None None] MFA Rules not processed for user `0bbbfb54fd13414f960b08176f3bab76`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:16.384424 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-07bbbee8-95a2-4b7a-937d-d8e34fa620e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:16.474086 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1176/2365] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:59:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:16.479093 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306928bd-c213-4a88-9fdc-ff99ce066f93 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:16.500978 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:16.555427 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306928bd-c213-4a88-9fdc-ff99ce066f93 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:16.561362 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe2f4a-5604-4fdb-bae6-2a7154dd539f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:16.562016 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe2f4a-5604-4fdb-bae6-2a7154dd539f admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:16.562292 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe2f4a-5604-4fdb-bae6-2a7154dd539f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:16.562558 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe2f4a-5604-4fdb-bae6-2a7154dd539f admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:16.563190 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe2f4a-5604-4fdb-bae6-2a7154dd539f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:16.565095 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe2f4a-5604-4fdb-bae6-2a7154dd539f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:16.593431 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1190/2366] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:59:16 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:59:16.597545 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbbee8-95a2-4b7a-937d-d8e34fa620e1 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:16.609660 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbbee8-95a2-4b7a-937d-d8e34fa620e1 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:16.668442 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f99951-2af5-47e6-87bd-5ad5891ca7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:16.669068 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f99951-2af5-47e6-87bd-5ad5891ca7e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:16.669350 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f99951-2af5-47e6-87bd-5ad5891ca7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:16.669645 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f99951-2af5-47e6-87bd-5ad5891ca7e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:16.670303 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f99951-2af5-47e6-87bd-5ad5891ca7e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:16.672275 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f99951-2af5-47e6-87bd-5ad5891ca7e6 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:16.682667 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:16.698480 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1177/2367] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:59:16 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:59:16.700119 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe2f4a-5604-4fdb-bae6-2a7154dd539f admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:16.711254 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe2f4a-5604-4fdb-bae6-2a7154dd539f admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:16.717611 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502872b-6edd-45c5-b1a7-0f18f277beb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:16.718273 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502872b-6edd-45c5-b1a7-0f18f277beb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:16.718556 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502872b-6edd-45c5-b1a7-0f18f277beb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:16.718826 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502872b-6edd-45c5-b1a7-0f18f277beb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:16.719445 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502872b-6edd-45c5-b1a7-0f18f277beb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:16.724259 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502872b-6edd-45c5-b1a7-0f18f277beb7 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:16.738463 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1191/2368] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:59:16.743320 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f99951-2af5-47e6-87bd-5ad5891ca7e6 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:16.754081 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f99951-2af5-47e6-87bd-5ad5891ca7e6 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:16.758903 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15154e73-59d4-4203-9a2c-f184251ff0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:16.759619 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15154e73-59d4-4203-9a2c-f184251ff0dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:16.759899 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15154e73-59d4-4203-9a2c-f184251ff0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:16.760166 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15154e73-59d4-4203-9a2c-f184251ff0dc admin admin] PATH_INFO: `/v3/projects/832a42f8300447229bf1ead89b7fc1ef/users/fbd7bf67a55c415f81c2265bdc179823/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:16.776179 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15154e73-59d4-4203-9a2c-f184251ff0dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=832a42f8300447229bf1ead89b7fc1ef, user_id=fbd7bf67a55c415f81c2265bdc179823, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:16.779413 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15154e73-59d4-4203-9a2c-f184251ff0dc admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:16.793365 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1178/2369] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:59:16 2022] PUT /identity/v3/projects/832a42f8300447229bf1ead89b7fc1ef/users/fbd7bf67a55c415f81c2265bdc179823/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:16.797434 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502872b-6edd-45c5-b1a7-0f18f277beb7 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:16.807700 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502872b-6edd-45c5-b1a7-0f18f277beb7 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:16.869632 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459822c-27a0-4bf1-897e-0149ae8ace3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:16.870270 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459822c-27a0-4bf1-897e-0149ae8ace3f admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:16.870546 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459822c-27a0-4bf1-897e-0149ae8ace3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:16.870817 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459822c-27a0-4bf1-897e-0149ae8ace3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:16.871503 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459822c-27a0-4bf1-897e-0149ae8ace3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:16.873106 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459822c-27a0-4bf1-897e-0149ae8ace3f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:16.889161 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1192/2370] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:59:16.894015 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15154e73-59d4-4203-9a2c-f184251ff0dc admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:16.906333 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15154e73-59d4-4203-9a2c-f184251ff0dc admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:16.911955 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194049b-5318-407a-82e6-4f56d4075196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:16.912803 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194049b-5318-407a-82e6-4f56d4075196 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:16.913235 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194049b-5318-407a-82e6-4f56d4075196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:16.913656 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194049b-5318-407a-82e6-4f56d4075196 admin admin] PATH_INFO: `/v3/projects/832a42f8300447229bf1ead89b7fc1ef/users/fbd7bf67a55c415f81c2265bdc179823/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:16.916112 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194049b-5318-407a-82e6-4f56d4075196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=832a42f8300447229bf1ead89b7fc1ef, user_id=fbd7bf67a55c415f81c2265bdc179823, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:16.919316 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194049b-5318-407a-82e6-4f56d4075196 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:16.932841 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1179/2371] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:59:16 2022] PUT /identity/v3/projects/832a42f8300447229bf1ead89b7fc1ef/users/fbd7bf67a55c415f81c2265bdc179823/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:16.944149 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfd0f7-2f30-497d-b653-6e674006cebe None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:16.944431 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfd0f7-2f30-497d-b653-6e674006cebe None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:16.944703 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfd0f7-2f30-497d-b653-6e674006cebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:16.975196 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-1fdfd0f7-2f30-497d-b653-6e674006cebe None None] MFA Rules not processed for user `fbd7bf67a55c415f81c2265bdc179823`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:16.976414 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1fdfd0f7-2f30-497d-b653-6e674006cebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:17.060791 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1193/2372] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:59:16 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:17.072887 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194049b-5318-407a-82e6-4f56d4075196 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:17.074807 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f194049b-5318-407a-82e6-4f56d4075196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:17.134220 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194049b-5318-407a-82e6-4f56d4075196 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:17.139752 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025409b8-535b-408d-9b21-8da60f9ce47c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:17.140404 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025409b8-535b-408d-9b21-8da60f9ce47c service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:17.140845 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025409b8-535b-408d-9b21-8da60f9ce47c service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:17.141170 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025409b8-535b-408d-9b21-8da60f9ce47c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:17.151333 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025409b8-535b-408d-9b21-8da60f9ce47c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:17.153114 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025409b8-535b-408d-9b21-8da60f9ce47c service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:17.163190 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1180/2373] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:17.241451 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfd0f7-2f30-497d-b653-6e674006cebe None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:17.251569 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfd0f7-2f30-497d-b653-6e674006cebe None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:17.255233 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697b4e9-a515-4ce6-8329-b42a5d6c7a58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:17.255837 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697b4e9-a515-4ce6-8329-b42a5d6c7a58 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:17.256115 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697b4e9-a515-4ce6-8329-b42a5d6c7a58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:17.256393 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697b4e9-a515-4ce6-8329-b42a5d6c7a58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:17.270961 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:17.321705 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697b4e9-a515-4ce6-8329-b42a5d6c7a58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:17.323202 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697b4e9-a515-4ce6-8329-b42a5d6c7a58 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:17.333619 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1194/2374] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:18.571017 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdefecd-b3af-468a-a134-3ca5508f98cf None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:18.571946 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdefecd-b3af-468a-a134-3ca5508f98cf None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:18.572232 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdefecd-b3af-468a-a134-3ca5508f98cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:18.598511 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-8cdefecd-b3af-468a-a134-3ca5508f98cf None None] MFA Rules not processed for user `5f227aa72915442384469ddc844198dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:18.599837 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8cdefecd-b3af-468a-a134-3ca5508f98cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:18.671667 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1181/2375] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:59:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:24.540502 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697b4e9-a515-4ce6-8329-b42a5d6c7a58 service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:24.606174 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697b4e9-a515-4ce6-8329-b42a5d6c7a58 service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:24.610788 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e8488-fd67-4171-a7ac-d05290d1cc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:24.611411 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e8488-fd67-4171-a7ac-d05290d1cc0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:24.611685 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e8488-fd67-4171-a7ac-d05290d1cc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:24.611951 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e8488-fd67-4171-a7ac-d05290d1cc0a admin admin] PATH_INFO: `/v3/users/0bbbfb54fd13414f960b08176f3bab76` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:24.613049 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e8488-fd67-4171-a7ac-d05290d1cc0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bbbfb54fd13414f960b08176f3bab76)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:24.615069 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e8488-fd67-4171-a7ac-d05290d1cc0a admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:24.664484 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-783e8488-fd67-4171-a7ac-d05290d1cc0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bbbfb54fd13414f960b08176f3bab76'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:24.672288 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-783e8488-fd67-4171-a7ac-d05290d1cc0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bbbfb54fd13414f960b08176f3bab76'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:24.680173 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-783e8488-fd67-4171-a7ac-d05290d1cc0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bbbfb54fd13414f960b08176f3bab76'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:24.693108 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-783e8488-fd67-4171-a7ac-d05290d1cc0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bbbfb54fd13414f960b08176f3bab76'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:24.693790 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-783e8488-fd67-4171-a7ac-d05290d1cc0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bbbfb54fd13414f960b08176f3bab76'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:24.699677 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1195/2376] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:59:24 2022] DELETE /identity/v3/users/0bbbfb54fd13414f960b08176f3bab76 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:24.704157 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d422dd3-bbfd-4d9a-a0ba-08c62ea0bb77 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:24.704647 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d422dd3-bbfd-4d9a-a0ba-08c62ea0bb77 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:24.704765 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d422dd3-bbfd-4d9a-a0ba-08c62ea0bb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:24.724270 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-9d422dd3-bbfd-4d9a-a0ba-08c62ea0bb77 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:24.725482 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9d422dd3-bbfd-4d9a-a0ba-08c62ea0bb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:24.788280 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1182/2377] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:24.798596 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e8488-fd67-4171-a7ac-d05290d1cc0a admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:24.800244 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-783e8488-fd67-4171-a7ac-d05290d1cc0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:24.841185 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:24.866289 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e8488-fd67-4171-a7ac-d05290d1cc0a admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:24.870170 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de76cd9-f62a-410e-959c-8dc84a1532ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:24.870777 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de76cd9-f62a-410e-959c-8dc84a1532ad service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:24.871120 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de76cd9-f62a-410e-959c-8dc84a1532ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:24.871458 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de76cd9-f62a-410e-959c-8dc84a1532ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:24.880771 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de76cd9-f62a-410e-959c-8dc84a1532ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:24.882236 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de76cd9-f62a-410e-959c-8dc84a1532ad service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:24.892176 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1196/2378] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:25.294958 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d422dd3-bbfd-4d9a-a0ba-08c62ea0bb77 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:25.296369 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9d422dd3-bbfd-4d9a-a0ba-08c62ea0bb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:25.305342 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:25.313574 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d422dd3-bbfd-4d9a-a0ba-08c62ea0bb77 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:25.320666 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d892c9e-7936-45ed-a0a7-248514716de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:25.321318 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d892c9e-7936-45ed-a0a7-248514716de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:25.321593 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d892c9e-7936-45ed-a0a7-248514716de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:25.321885 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d892c9e-7936-45ed-a0a7-248514716de6 admin admin] PATH_INFO: `/v3/projects/5f34ad54792c4f3c8868fac283dddb34` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:25.323046 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d892c9e-7936-45ed-a0a7-248514716de6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f34ad54792c4f3c8868fac283dddb34)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:25.325224 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d892c9e-7936-45ed-a0a7-248514716de6 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:25.395253 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4d892c9e-7936-45ed-a0a7-248514716de6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f34ad54792c4f3c8868fac283dddb34', 'request_id': 'req-4d892c9e-7936-45ed-a0a7-248514716de6'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:25.405134 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4d892c9e-7936-45ed-a0a7-248514716de6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f34ad54792c4f3c8868fac283dddb34', 'request_id': 'req-4d892c9e-7936-45ed-a0a7-248514716de6'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:25.412246 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4d892c9e-7936-45ed-a0a7-248514716de6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f34ad54792c4f3c8868fac283dddb34', 'request_id': 'req-4d892c9e-7936-45ed-a0a7-248514716de6'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:25.435829 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4d892c9e-7936-45ed-a0a7-248514716de6 admin admin] The token cache is being invalidate because project 5f34ad54792c4f3c8868fac283dddb34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:59:25.436127 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4d892c9e-7936-45ed-a0a7-248514716de6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:25.437296 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4d892c9e-7936-45ed-a0a7-248514716de6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:25.446383 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1183/2379] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:59:25 2022] DELETE /identity/v3/projects/5f34ad54792c4f3c8868fac283dddb34 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:25.450402 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de76cd9-f62a-410e-959c-8dc84a1532ad service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:25.461325 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de76cd9-f62a-410e-959c-8dc84a1532ad service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:25.551573 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ab87f-9f51-4402-b2d0-56e5e73e7bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:25.552257 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ab87f-9f51-4402-b2d0-56e5e73e7bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:25.552486 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ab87f-9f51-4402-b2d0-56e5e73e7bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:25.552762 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ab87f-9f51-4402-b2d0-56e5e73e7bc0 admin admin] PATH_INFO: `/v3/users/fbd7bf67a55c415f81c2265bdc179823` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:25.554417 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ab87f-9f51-4402-b2d0-56e5e73e7bc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbd7bf67a55c415f81c2265bdc179823)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:25.555977 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ab87f-9f51-4402-b2d0-56e5e73e7bc0 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:25.608266 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f20ab87f-9f51-4402-b2d0-56e5e73e7bc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbd7bf67a55c415f81c2265bdc179823'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:25.623846 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f20ab87f-9f51-4402-b2d0-56e5e73e7bc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbd7bf67a55c415f81c2265bdc179823'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:25.639554 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f20ab87f-9f51-4402-b2d0-56e5e73e7bc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbd7bf67a55c415f81c2265bdc179823'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:25.654441 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f20ab87f-9f51-4402-b2d0-56e5e73e7bc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbd7bf67a55c415f81c2265bdc179823'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:25.655280 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f20ab87f-9f51-4402-b2d0-56e5e73e7bc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbd7bf67a55c415f81c2265bdc179823'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:25.664694 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1197/2380] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:59:25 2022] DELETE /identity/v3/users/fbd7bf67a55c415f81c2265bdc179823 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:59:25.961352 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d892c9e-7936-45ed-a0a7-248514716de6 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:25.964240 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4d892c9e-7936-45ed-a0a7-248514716de6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:25.988700 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d892c9e-7936-45ed-a0a7-248514716de6 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:26.067629 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b27b20-c4b5-4e24-858e-7ce3ad75537e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:26.068355 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b27b20-c4b5-4e24-858e-7ce3ad75537e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:26.068632 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b27b20-c4b5-4e24-858e-7ce3ad75537e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:26.069053 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b27b20-c4b5-4e24-858e-7ce3ad75537e admin admin] PATH_INFO: `/v3/projects/832a42f8300447229bf1ead89b7fc1ef` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:26.070306 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b27b20-c4b5-4e24-858e-7ce3ad75537e admin admin] RBAC: Authorizing `identity:delete_project(project_id=832a42f8300447229bf1ead89b7fc1ef)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:26.072279 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b27b20-c4b5-4e24-858e-7ce3ad75537e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:26.126872 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a4b27b20-c4b5-4e24-858e-7ce3ad75537e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '832a42f8300447229bf1ead89b7fc1ef', 'request_id': 'req-a4b27b20-c4b5-4e24-858e-7ce3ad75537e'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:26.132492 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a4b27b20-c4b5-4e24-858e-7ce3ad75537e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '832a42f8300447229bf1ead89b7fc1ef', 'request_id': 'req-a4b27b20-c4b5-4e24-858e-7ce3ad75537e'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:26.139768 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a4b27b20-c4b5-4e24-858e-7ce3ad75537e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '832a42f8300447229bf1ead89b7fc1ef', 'request_id': 'req-a4b27b20-c4b5-4e24-858e-7ce3ad75537e'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:26.153574 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a4b27b20-c4b5-4e24-858e-7ce3ad75537e admin admin] The token cache is being invalidate because project 832a42f8300447229bf1ead89b7fc1ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:59:26.153884 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a4b27b20-c4b5-4e24-858e-7ce3ad75537e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:26.154593 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a4b27b20-c4b5-4e24-858e-7ce3ad75537e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:26.156182 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1184/2381] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:59:25 2022] DELETE /identity/v3/projects/832a42f8300447229bf1ead89b7fc1ef => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:26.161891 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698de520-2953-41ff-ae09-075b19f401dc None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:26.162285 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698de520-2953-41ff-ae09-075b19f401dc None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:26.162741 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698de520-2953-41ff-ae09-075b19f401dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:26.188288 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-698de520-2953-41ff-ae09-075b19f401dc None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:26.189772 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-698de520-2953-41ff-ae09-075b19f401dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:26.238431 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:26.254254 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1198/2382] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:26.262085 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d7854-10ec-4ff4-bb16-ebefe157417b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:26.262377 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d7854-10ec-4ff4-bb16-ebefe157417b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:26.262670 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d7854-10ec-4ff4-bb16-ebefe157417b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:26.282120 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-6d5d7854-10ec-4ff4-bb16-ebefe157417b None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:26.283311 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6d5d7854-10ec-4ff4-bb16-ebefe157417b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:26.291276 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1185/2383] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:26.295716 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698de520-2953-41ff-ae09-075b19f401dc None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:26.306111 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698de520-2953-41ff-ae09-075b19f401dc None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:26.311860 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e30d0e-d4f4-42ef-9224-e2735e9a6bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:26.312494 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e30d0e-d4f4-42ef-9224-e2735e9a6bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:26.312809 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e30d0e-d4f4-42ef-9224-e2735e9a6bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:26.313110 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e30d0e-d4f4-42ef-9224-e2735e9a6bd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:26.313867 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e30d0e-d4f4-42ef-9224-e2735e9a6bd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:59:26.314232 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e30d0e-d4f4-42ef-9224-e2735e9a6bd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:26.315846 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e30d0e-d4f4-42ef-9224-e2735e9a6bd4 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:26.328910 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1199/2384] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:59:26.333616 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d7854-10ec-4ff4-bb16-ebefe157417b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:26.343490 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d7854-10ec-4ff4-bb16-ebefe157417b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:26.348366 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee85b806-c709-4a76-8d28-f6dc0a1dd3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:26.348981 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85b806-c709-4a76-8d28-f6dc0a1dd3bb admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:26.349254 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85b806-c709-4a76-8d28-f6dc0a1dd3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:26.349517 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85b806-c709-4a76-8d28-f6dc0a1dd3bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:26.352607 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee85b806-c709-4a76-8d28-f6dc0a1dd3bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:26.353646 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee85b806-c709-4a76-8d28-f6dc0a1dd3bb admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:26.363737 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:26.389106 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1186/2385] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:59:26 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:59:26.393493 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e30d0e-d4f4-42ef-9224-e2735e9a6bd4 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:26.404120 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e30d0e-d4f4-42ef-9224-e2735e9a6bd4 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:26.463336 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a8cca-add8-4b46-b85a-7de57c5574b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:26.463972 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a8cca-add8-4b46-b85a-7de57c5574b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:26.464282 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a8cca-add8-4b46-b85a-7de57c5574b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:26.464966 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a8cca-add8-4b46-b85a-7de57c5574b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:26.465583 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a8cca-add8-4b46-b85a-7de57c5574b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:26.467302 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a8cca-add8-4b46-b85a-7de57c5574b4 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:26.491561 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1200/2386] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:59:26 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:59:26.496032 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee85b806-c709-4a76-8d28-f6dc0a1dd3bb admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:26.506937 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee85b806-c709-4a76-8d28-f6dc0a1dd3bb admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:26.512503 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c0505-ae70-40c8-8d42-f76de250b4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:26.513211 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c0505-ae70-40c8-8d42-f76de250b4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:26.514068 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c0505-ae70-40c8-8d42-f76de250b4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:26.514068 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c0505-ae70-40c8-8d42-f76de250b4e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:26.514698 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c0505-ae70-40c8-8d42-f76de250b4e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:26.516384 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c0505-ae70-40c8-8d42-f76de250b4e6 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:26.528807 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1187/2387] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:59:26.533052 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a8cca-add8-4b46-b85a-7de57c5574b4 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:26.544515 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a8cca-add8-4b46-b85a-7de57c5574b4 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:26.549807 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08ccce-2b0d-4b88-8a58-13570cb0a6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:26.550451 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08ccce-2b0d-4b88-8a58-13570cb0a6e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:26.550730 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08ccce-2b0d-4b88-8a58-13570cb0a6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:26.551002 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08ccce-2b0d-4b88-8a58-13570cb0a6e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:26.551645 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f08ccce-2b0d-4b88-8a58-13570cb0a6e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:26.553262 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f08ccce-2b0d-4b88-8a58-13570cb0a6e0 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:26.564299 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1201/2388] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:59:26.568683 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c0505-ae70-40c8-8d42-f76de250b4e6 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:26.579159 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c0505-ae70-40c8-8d42-f76de250b4e6 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:26.583853 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d29cb9-f7c7-4569-b9d9-e6ac4abf36d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:26.584538 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d29cb9-f7c7-4569-b9d9-e6ac4abf36d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:26.584822 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d29cb9-f7c7-4569-b9d9-e6ac4abf36d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:26.585094 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d29cb9-f7c7-4569-b9d9-e6ac4abf36d1 admin admin] PATH_INFO: `/v3/projects/a6ac28d7ab044724a690440bd5ac6b64/users/3006e2c33cae4d50b621c8eda6299f7f/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:26.601420 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d29cb9-f7c7-4569-b9d9-e6ac4abf36d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ac28d7ab044724a690440bd5ac6b64, user_id=3006e2c33cae4d50b621c8eda6299f7f, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:26.604534 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d29cb9-f7c7-4569-b9d9-e6ac4abf36d1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:26.618790 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1188/2389] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:59:26 2022] PUT /identity/v3/projects/a6ac28d7ab044724a690440bd5ac6b64/users/3006e2c33cae4d50b621c8eda6299f7f/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:26.631175 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a2d2c-31d5-4fdc-ac39-d89abe18944d None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:26.631462 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a2d2c-31d5-4fdc-ac39-d89abe18944d None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:26.631734 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a2d2c-31d5-4fdc-ac39-d89abe18944d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:26.661686 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-4c5a2d2c-31d5-4fdc-ac39-d89abe18944d None None] MFA Rules not processed for user `3006e2c33cae4d50b621c8eda6299f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:26.663107 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-4c5a2d2c-31d5-4fdc-ac39-d89abe18944d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:26.752275 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1202/2390] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:59:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:59:26.764205 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d29cb9-f7c7-4569-b9d9-e6ac4abf36d1 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:26.766208 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-84d29cb9-f7c7-4569-b9d9-e6ac4abf36d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:26.837870 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d29cb9-f7c7-4569-b9d9-e6ac4abf36d1 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:26.841604 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234ebc0-c080-4c91-8cdd-7fb99d9df363 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:26.842256 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234ebc0-c080-4c91-8cdd-7fb99d9df363 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:26.842531 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234ebc0-c080-4c91-8cdd-7fb99d9df363 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:26.842805 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234ebc0-c080-4c91-8cdd-7fb99d9df363 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:26.850988 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7234ebc0-c080-4c91-8cdd-7fb99d9df363 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:26.852444 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7234ebc0-c080-4c91-8cdd-7fb99d9df363 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:26.861420 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1189/2391] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:32.308817 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a2d2c-31d5-4fdc-ac39-d89abe18944d None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:32.360434 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:32.376514 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a2d2c-31d5-4fdc-ac39-d89abe18944d None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:32.382122 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b196be-4a68-4333-9978-e7ba5a74188f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:32.382791 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b196be-4a68-4333-9978-e7ba5a74188f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:32.383596 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b196be-4a68-4333-9978-e7ba5a74188f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:32.383878 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b196be-4a68-4333-9978-e7ba5a74188f admin admin] PATH_INFO: `/v3/users/3006e2c33cae4d50b621c8eda6299f7f` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:32.385285 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b196be-4a68-4333-9978-e7ba5a74188f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3006e2c33cae4d50b621c8eda6299f7f)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:32.387346 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b196be-4a68-4333-9978-e7ba5a74188f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:32.445394 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d9b196be-4a68-4333-9978-e7ba5a74188f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3006e2c33cae4d50b621c8eda6299f7f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:32.454042 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d9b196be-4a68-4333-9978-e7ba5a74188f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3006e2c33cae4d50b621c8eda6299f7f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:32.464693 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d9b196be-4a68-4333-9978-e7ba5a74188f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3006e2c33cae4d50b621c8eda6299f7f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:32.486107 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d9b196be-4a68-4333-9978-e7ba5a74188f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3006e2c33cae4d50b621c8eda6299f7f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:32.486809 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d9b196be-4a68-4333-9978-e7ba5a74188f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3006e2c33cae4d50b621c8eda6299f7f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:32.493235 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1203/2392] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:59:32 2022] DELETE /identity/v3/users/3006e2c33cae4d50b621c8eda6299f7f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:32.498641 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d02ca-2a1c-4360-a290-20c53e9c8dfb None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:32.499104 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d02ca-2a1c-4360-a290-20c53e9c8dfb None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:32.499199 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d02ca-2a1c-4360-a290-20c53e9c8dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:32.518048 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-5a0d02ca-2a1c-4360-a290-20c53e9c8dfb None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:32.519778 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5a0d02ca-2a1c-4360-a290-20c53e9c8dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:32.586488 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1190/2393] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:32.596986 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b196be-4a68-4333-9978-e7ba5a74188f admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:32.598858 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d9b196be-4a68-4333-9978-e7ba5a74188f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:32.719487 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b196be-4a68-4333-9978-e7ba5a74188f admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:32.723627 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9701b-7960-4f41-9a04-75a3ca4a38f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:32.724261 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9701b-7960-4f41-9a04-75a3ca4a38f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:32.725394 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9701b-7960-4f41-9a04-75a3ca4a38f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:32.725394 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9701b-7960-4f41-9a04-75a3ca4a38f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:32.736566 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9701b-7960-4f41-9a04-75a3ca4a38f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:32.738125 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9701b-7960-4f41-9a04-75a3ca4a38f2 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:32.749622 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1204/2394] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:32.766507 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c3a02-eb9b-4d5c-a0a2-688316f4719d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:32.766787 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c3a02-eb9b-4d5c-a0a2-688316f4719d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:32.767163 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c3a02-eb9b-4d5c-a0a2-688316f4719d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:32.789622 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-bd3c3a02-eb9b-4d5c-a0a2-688316f4719d None None] MFA Rules not processed for user `3302fdf33b5b4583a10e7c760c577cda`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:32.791163 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bd3c3a02-eb9b-4d5c-a0a2-688316f4719d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:32.863346 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1191/2395] 10.222.0.52 () {58 vars in 1009 bytes} [Sun Aug 28 00:59:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:32.920877 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9701b-7960-4f41-9a04-75a3ca4a38f2 service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:32.922365 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-bad9701b-7960-4f41-9a04-75a3ca4a38f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:33.009184 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9701b-7960-4f41-9a04-75a3ca4a38f2 service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:33.014479 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60a79c-b5f9-4304-b253-ac190e1207d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80a6019cf424c16a1d461a632cf8568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:33.015099 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60a79c-b5f9-4304-b253-ac190e1207d2 service swift] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:33.015377 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60a79c-b5f9-4304-b253-ac190e1207d2 service swift] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:33.015648 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60a79c-b5f9-4304-b253-ac190e1207d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:33.024946 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd60a79c-b5f9-4304-b253-ac190e1207d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:33.026599 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd60a79c-b5f9-4304-b253-ac190e1207d2 service swift] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:33.035418 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1205/2396] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Aug 28 00:59:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 00:59:33.132243 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c3a02-eb9b-4d5c-a0a2-688316f4719d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:33.133921 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bd3c3a02-eb9b-4d5c-a0a2-688316f4719d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:33.151062 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:33.172463 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c3a02-eb9b-4d5c-a0a2-688316f4719d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:33.182709 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6e43d-5f6d-4472-93b5-6fb89a906950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:33.183596 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6e43d-5f6d-4472-93b5-6fb89a906950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:33.183778 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6e43d-5f6d-4472-93b5-6fb89a906950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:33.184045 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6e43d-5f6d-4472-93b5-6fb89a906950 admin admin] PATH_INFO: `/v3/projects/a6ac28d7ab044724a690440bd5ac6b64` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:33.186840 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6e43d-5f6d-4472-93b5-6fb89a906950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6ac28d7ab044724a690440bd5ac6b64)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:33.189161 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6e43d-5f6d-4472-93b5-6fb89a906950 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:33.264050 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-02b6e43d-5f6d-4472-93b5-6fb89a906950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6ac28d7ab044724a690440bd5ac6b64', 'request_id': 'req-02b6e43d-5f6d-4472-93b5-6fb89a906950'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:33.270237 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-02b6e43d-5f6d-4472-93b5-6fb89a906950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6ac28d7ab044724a690440bd5ac6b64', 'request_id': 'req-02b6e43d-5f6d-4472-93b5-6fb89a906950'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:33.281457 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-02b6e43d-5f6d-4472-93b5-6fb89a906950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6ac28d7ab044724a690440bd5ac6b64', 'request_id': 'req-02b6e43d-5f6d-4472-93b5-6fb89a906950'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:33.298636 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-02b6e43d-5f6d-4472-93b5-6fb89a906950 admin admin] The token cache is being invalidate because project a6ac28d7ab044724a690440bd5ac6b64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:59:33.298986 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-02b6e43d-5f6d-4472-93b5-6fb89a906950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:33.299782 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-02b6e43d-5f6d-4472-93b5-6fb89a906950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:33.301502 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1192/2397] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:59:33 2022] DELETE /identity/v3/projects/a6ac28d7ab044724a690440bd5ac6b64 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:33.306231 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71216412-c839-4625-aaca-787496f1cf11 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:33.306904 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71216412-c839-4625-aaca-787496f1cf11 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:33.307385 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71216412-c839-4625-aaca-787496f1cf11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:33.316241 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:33.335232 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-71216412-c839-4625-aaca-787496f1cf11 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:33.336451 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-71216412-c839-4625-aaca-787496f1cf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:33.403862 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1206/2398] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:33.411690 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567462ce-9955-4842-baec-df4b68816e23 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:33.411972 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567462ce-9955-4842-baec-df4b68816e23 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:33.412264 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567462ce-9955-4842-baec-df4b68816e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:33.435441 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-567462ce-9955-4842-baec-df4b68816e23 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:33.436662 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-567462ce-9955-4842-baec-df4b68816e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:33.446441 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1193/2399] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:33.451034 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71216412-c839-4625-aaca-787496f1cf11 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:33.461339 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71216412-c839-4625-aaca-787496f1cf11 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:33.466512 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71eba3d-3b3e-4916-9030-dbebd5728a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:33.467134 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71eba3d-3b3e-4916-9030-dbebd5728a69 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:33.467408 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71eba3d-3b3e-4916-9030-dbebd5728a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:33.467674 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71eba3d-3b3e-4916-9030-dbebd5728a69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:33.468329 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71eba3d-3b3e-4916-9030-dbebd5728a69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:59:33.468614 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71eba3d-3b3e-4916-9030-dbebd5728a69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:33.470333 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71eba3d-3b3e-4916-9030-dbebd5728a69 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:33.483862 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1207/2400] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:59:33.488379 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567462ce-9955-4842-baec-df4b68816e23 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:33.498987 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567462ce-9955-4842-baec-df4b68816e23 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:33.503810 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c14b25-09aa-4771-ba3f-96d5243dac0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:33.504516 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c14b25-09aa-4771-ba3f-96d5243dac0d admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:33.504765 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c14b25-09aa-4771-ba3f-96d5243dac0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:33.505067 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c14b25-09aa-4771-ba3f-96d5243dac0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:33.505754 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c14b25-09aa-4771-ba3f-96d5243dac0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:33.507743 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c14b25-09aa-4771-ba3f-96d5243dac0d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:33.537703 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1194/2401] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:59:33 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:59:33.542189 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71eba3d-3b3e-4916-9030-dbebd5728a69 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:33.553293 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71eba3d-3b3e-4916-9030-dbebd5728a69 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:33.621740 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f5828-5fed-4014-b556-52c26cc47450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:33.622417 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f5828-5fed-4014-b556-52c26cc47450 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:33.622689 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f5828-5fed-4014-b556-52c26cc47450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:33.622966 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f5828-5fed-4014-b556-52c26cc47450 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:33.623622 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f5828-5fed-4014-b556-52c26cc47450 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:33.625562 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f5828-5fed-4014-b556-52c26cc47450 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:33.653482 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1208/2402] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:59:33 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:59:33.657610 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c14b25-09aa-4771-ba3f-96d5243dac0d admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:33.669126 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c14b25-09aa-4771-ba3f-96d5243dac0d admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:33.674295 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46d20f-b52f-4b5b-9f26-98cf6f5357fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:33.675027 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46d20f-b52f-4b5b-9f26-98cf6f5357fe admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:33.675301 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46d20f-b52f-4b5b-9f26-98cf6f5357fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:33.675572 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46d20f-b52f-4b5b-9f26-98cf6f5357fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:33.676212 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46d20f-b52f-4b5b-9f26-98cf6f5357fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:33.677862 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46d20f-b52f-4b5b-9f26-98cf6f5357fe admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:33.696160 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1195/2403] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:59:33.697369 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f5828-5fed-4014-b556-52c26cc47450 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:33.708991 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f5828-5fed-4014-b556-52c26cc47450 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:33.714925 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae67e7b-439a-481f-a232-66adac9baff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:33.715682 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae67e7b-439a-481f-a232-66adac9baff6 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:33.716028 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae67e7b-439a-481f-a232-66adac9baff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:33.716450 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae67e7b-439a-481f-a232-66adac9baff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:33.717441 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae67e7b-439a-481f-a232-66adac9baff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:33.719228 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae67e7b-439a-481f-a232-66adac9baff6 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:33.731397 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1209/2404] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:59:33.735767 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46d20f-b52f-4b5b-9f26-98cf6f5357fe admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:33.747043 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46d20f-b52f-4b5b-9f26-98cf6f5357fe admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:33.752522 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a48bf0-f13f-4f9c-a8a6-ca17a1c0174b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:33.753185 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a48bf0-f13f-4f9c-a8a6-ca17a1c0174b admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:33.753491 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a48bf0-f13f-4f9c-a8a6-ca17a1c0174b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:33.753763 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a48bf0-f13f-4f9c-a8a6-ca17a1c0174b admin admin] PATH_INFO: `/v3/projects/5402442128f04aa39f47067b410a1d26/users/b07e2ceb884f4d6cbf14a86230a60c38/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:33.770599 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a48bf0-f13f-4f9c-a8a6-ca17a1c0174b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5402442128f04aa39f47067b410a1d26, user_id=b07e2ceb884f4d6cbf14a86230a60c38, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:33.773558 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a48bf0-f13f-4f9c-a8a6-ca17a1c0174b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:33.789071 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1196/2405] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:59:33 2022] PUT /identity/v3/projects/5402442128f04aa39f47067b410a1d26/users/b07e2ceb884f4d6cbf14a86230a60c38/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:33.799902 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d8ed6-6e8b-4d32-adaf-08b54ca40287 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:33.800189 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d8ed6-6e8b-4d32-adaf-08b54ca40287 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:33.800469 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d8ed6-6e8b-4d32-adaf-08b54ca40287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:33.831042 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-5e1d8ed6-6e8b-4d32-adaf-08b54ca40287 None None] MFA Rules not processed for user `b07e2ceb884f4d6cbf14a86230a60c38`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:33.832261 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-5e1d8ed6-6e8b-4d32-adaf-08b54ca40287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:33.913793 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:33.922094 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1210/2406] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:59:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:33.934606 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a48bf0-f13f-4f9c-a8a6-ca17a1c0174b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:33.936349 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-46a48bf0-f13f-4f9c-a8a6-ca17a1c0174b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:34.022449 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a48bf0-f13f-4f9c-a8a6-ca17a1c0174b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:34.026200 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29d644-a654-4449-b1cf-42f95bf30c28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:34.026811 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29d644-a654-4449-b1cf-42f95bf30c28 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:34.027135 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29d644-a654-4449-b1cf-42f95bf30c28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:34.028003 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29d644-a654-4449-b1cf-42f95bf30c28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:34.042501 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29d644-a654-4449-b1cf-42f95bf30c28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:34.044359 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29d644-a654-4449-b1cf-42f95bf30c28 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:34.068837 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1197/2407] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:37.327576 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d8ed6-6e8b-4d32-adaf-08b54ca40287 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:37.404876 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d8ed6-6e8b-4d32-adaf-08b54ca40287 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:37.410157 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f60b953-6ca3-4498-83d8-7c6bb6c50f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:37.410794 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60b953-6ca3-4498-83d8-7c6bb6c50f97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:37.411072 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60b953-6ca3-4498-83d8-7c6bb6c50f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:37.411353 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60b953-6ca3-4498-83d8-7c6bb6c50f97 admin admin] PATH_INFO: `/v3/users/b07e2ceb884f4d6cbf14a86230a60c38` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:37.412508 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f60b953-6ca3-4498-83d8-7c6bb6c50f97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b07e2ceb884f4d6cbf14a86230a60c38)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:37.414638 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f60b953-6ca3-4498-83d8-7c6bb6c50f97 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:37.470476 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-1f60b953-6ca3-4498-83d8-7c6bb6c50f97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b07e2ceb884f4d6cbf14a86230a60c38'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:37.478152 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-1f60b953-6ca3-4498-83d8-7c6bb6c50f97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b07e2ceb884f4d6cbf14a86230a60c38'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:37.488631 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-1f60b953-6ca3-4498-83d8-7c6bb6c50f97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b07e2ceb884f4d6cbf14a86230a60c38'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:37.502131 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-1f60b953-6ca3-4498-83d8-7c6bb6c50f97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b07e2ceb884f4d6cbf14a86230a60c38'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:37.502819 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-1f60b953-6ca3-4498-83d8-7c6bb6c50f97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b07e2ceb884f4d6cbf14a86230a60c38'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:37.513910 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1211/2408] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 00:59:37 2022] DELETE /identity/v3/users/b07e2ceb884f4d6cbf14a86230a60c38 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:37.519958 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d89a1-f4a6-4090-8086-35b0698810b9 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:37.520491 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d89a1-f4a6-4090-8086-35b0698810b9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:37.520838 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d89a1-f4a6-4090-8086-35b0698810b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:37.559138 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c85d89a1-f4a6-4090-8086-35b0698810b9 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:37.561012 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c85d89a1-f4a6-4090-8086-35b0698810b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:37.585413 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:37.648187 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1198/2409] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:37.663743 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f60b953-6ca3-4498-83d8-7c6bb6c50f97 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:37.665135 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1f60b953-6ca3-4498-83d8-7c6bb6c50f97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:37.758832 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f60b953-6ca3-4498-83d8-7c6bb6c50f97 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:37.763378 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c43ac7-3a74-4360-8e67-921b01458514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:37.764023 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c43ac7-3a74-4360-8e67-921b01458514 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:37.764289 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c43ac7-3a74-4360-8e67-921b01458514 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:37.764644 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c43ac7-3a74-4360-8e67-921b01458514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:37.774122 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c43ac7-3a74-4360-8e67-921b01458514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:37.775643 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c43ac7-3a74-4360-8e67-921b01458514 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:37.787575 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1212/2410] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:38.101653 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d89a1-f4a6-4090-8086-35b0698810b9 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:38.103425 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c85d89a1-f4a6-4090-8086-35b0698810b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:38.118594 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d89a1-f4a6-4090-8086-35b0698810b9 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:38.123936 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e33220-9cbb-4e4f-a95f-980d544fa5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:38.124601 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e33220-9cbb-4e4f-a95f-980d544fa5e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:38.124877 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e33220-9cbb-4e4f-a95f-980d544fa5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:38.125150 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e33220-9cbb-4e4f-a95f-980d544fa5e2 admin admin] PATH_INFO: `/v3/projects/5402442128f04aa39f47067b410a1d26` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:38.126403 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e33220-9cbb-4e4f-a95f-980d544fa5e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5402442128f04aa39f47067b410a1d26)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:38.128424 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e33220-9cbb-4e4f-a95f-980d544fa5e2 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:38.203062 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-21e33220-9cbb-4e4f-a95f-980d544fa5e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5402442128f04aa39f47067b410a1d26', 'request_id': 'req-21e33220-9cbb-4e4f-a95f-980d544fa5e2'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:38.209278 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-21e33220-9cbb-4e4f-a95f-980d544fa5e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5402442128f04aa39f47067b410a1d26', 'request_id': 'req-21e33220-9cbb-4e4f-a95f-980d544fa5e2'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:38.216441 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-21e33220-9cbb-4e4f-a95f-980d544fa5e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5402442128f04aa39f47067b410a1d26', 'request_id': 'req-21e33220-9cbb-4e4f-a95f-980d544fa5e2'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:38.242533 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-21e33220-9cbb-4e4f-a95f-980d544fa5e2 admin admin] The token cache is being invalidate because project 5402442128f04aa39f47067b410a1d26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:59:38.242829 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-21e33220-9cbb-4e4f-a95f-980d544fa5e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:38.243680 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-21e33220-9cbb-4e4f-a95f-980d544fa5e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:38.245291 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1199/2411] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 00:59:38 2022] DELETE /identity/v3/projects/5402442128f04aa39f47067b410a1d26 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:38.253902 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf9aa9-ef30-450a-bdc7-6e6b2273c200 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:38.253902 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf9aa9-ef30-450a-bdc7-6e6b2273c200 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:38.253902 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf9aa9-ef30-450a-bdc7-6e6b2273c200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:38.276081 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-aacf9aa9-ef30-450a-bdc7-6e6b2273c200 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:38.277597 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-aacf9aa9-ef30-450a-bdc7-6e6b2273c200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:38.294797 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:38.356495 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1213/2412] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:59:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:59:38.366940 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4b95e-e068-4b72-b064-147d682f8c5a None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:38.367380 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4b95e-e068-4b72-b064-147d682f8c5a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:38.367665 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4b95e-e068-4b72-b064-147d682f8c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:38.405145 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-3ce4b95e-e068-4b72-b064-147d682f8c5a None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:38.406395 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3ce4b95e-e068-4b72-b064-147d682f8c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:38.415317 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1200/2413] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:59:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:38.419729 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf9aa9-ef30-450a-bdc7-6e6b2273c200 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:38.430421 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf9aa9-ef30-450a-bdc7-6e6b2273c200 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:38.435954 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709fc86-0b72-4e70-b97b-39ca213d3e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:38.436556 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709fc86-0b72-4e70-b97b-39ca213d3e1c admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:38.436813 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709fc86-0b72-4e70-b97b-39ca213d3e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:38.437560 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709fc86-0b72-4e70-b97b-39ca213d3e1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:38.437704 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709fc86-0b72-4e70-b97b-39ca213d3e1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:59:38.438058 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709fc86-0b72-4e70-b97b-39ca213d3e1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:38.439652 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709fc86-0b72-4e70-b97b-39ca213d3e1c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:38.454802 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1214/2414] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 00:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:59:38.458950 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4b95e-e068-4b72-b064-147d682f8c5a None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:38.470353 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4b95e-e068-4b72-b064-147d682f8c5a None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:38.478865 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbef3db-7cdf-4142-b680-7753eebbd4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:38.480074 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbef3db-7cdf-4142-b680-7753eebbd4eb admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:38.480767 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbef3db-7cdf-4142-b680-7753eebbd4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:38.481011 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbef3db-7cdf-4142-b680-7753eebbd4eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:38.481724 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbef3db-7cdf-4142-b680-7753eebbd4eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:38.483713 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbef3db-7cdf-4142-b680-7753eebbd4eb admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:38.518693 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1201/2415] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 00:59:38 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:59:38.523164 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709fc86-0b72-4e70-b97b-39ca213d3e1c admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:38.542038 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709fc86-0b72-4e70-b97b-39ca213d3e1c admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:38.612689 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c4eae-65b3-47cc-86b4-025f145d883d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:38.613595 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c4eae-65b3-47cc-86b4-025f145d883d admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:38.614036 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c4eae-65b3-47cc-86b4-025f145d883d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:38.614409 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c4eae-65b3-47cc-86b4-025f145d883d admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:38.615260 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c4eae-65b3-47cc-86b4-025f145d883d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:38.617281 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c4eae-65b3-47cc-86b4-025f145d883d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:38.645609 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1215/2416] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 00:59:38 2022] POST /identity/v3/users => generated 285 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:59:38.647170 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbef3db-7cdf-4142-b680-7753eebbd4eb admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:38.660683 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbef3db-7cdf-4142-b680-7753eebbd4eb admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:38.665395 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb61788-7ff7-4692-853f-593cf2145029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:38.666028 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb61788-7ff7-4692-853f-593cf2145029 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:38.666306 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb61788-7ff7-4692-853f-593cf2145029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:38.666571 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb61788-7ff7-4692-853f-593cf2145029 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:38.667213 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb61788-7ff7-4692-853f-593cf2145029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:38.668962 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb61788-7ff7-4692-853f-593cf2145029 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:38.679958 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1202/2417] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:59:38.685482 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c4eae-65b3-47cc-86b4-025f145d883d admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:38.696824 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c4eae-65b3-47cc-86b4-025f145d883d admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:38.704217 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eee6ac-8585-42d7-8656-4a38b898c077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:38.704923 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eee6ac-8585-42d7-8656-4a38b898c077 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:38.705193 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eee6ac-8585-42d7-8656-4a38b898c077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:38.705423 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eee6ac-8585-42d7-8656-4a38b898c077 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:38.706131 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eee6ac-8585-42d7-8656-4a38b898c077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:38.707760 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eee6ac-8585-42d7-8656-4a38b898c077 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:38.720465 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1216/2418] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 00:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:59:38.725716 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb61788-7ff7-4692-853f-593cf2145029 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:38.737768 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb61788-7ff7-4692-853f-593cf2145029 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:38.750389 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80080ebc-2a50-447b-8c74-095e1148b491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:38.751652 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80080ebc-2a50-447b-8c74-095e1148b491 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:38.752352 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80080ebc-2a50-447b-8c74-095e1148b491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:38.752737 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80080ebc-2a50-447b-8c74-095e1148b491 admin admin] PATH_INFO: `/v3/projects/29c98e37701d46ff9232413d2c206660/users/a5a9abc92e474313b0b571d8b03da169/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:38.773141 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80080ebc-2a50-447b-8c74-095e1148b491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29c98e37701d46ff9232413d2c206660, user_id=a5a9abc92e474313b0b571d8b03da169, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:38.776016 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80080ebc-2a50-447b-8c74-095e1148b491 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:38.798969 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1203/2419] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 00:59:38 2022] PUT /identity/v3/projects/29c98e37701d46ff9232413d2c206660/users/a5a9abc92e474313b0b571d8b03da169/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:38.807319 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42efc98-2438-4476-ab44-6fe402f58a1b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:38.807608 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42efc98-2438-4476-ab44-6fe402f58a1b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:38.807906 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42efc98-2438-4476-ab44-6fe402f58a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:38.851666 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-a42efc98-2438-4476-ab44-6fe402f58a1b None None] MFA Rules not processed for user `a5a9abc92e474313b0b571d8b03da169`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:38.853029 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a42efc98-2438-4476-ab44-6fe402f58a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:38.960440 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1217/2420] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 00:59:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:38.961395 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80080ebc-2a50-447b-8c74-095e1148b491 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:38.961395 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-80080ebc-2a50-447b-8c74-095e1148b491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:39.019224 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:39.037115 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80080ebc-2a50-447b-8c74-095e1148b491 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:39.041476 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a756bf-5ffc-4c6b-9b46-9600d26cbd3c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34fd9f7932e14a409d7668d40ff6680e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:39.042207 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a756bf-5ffc-4c6b-9b46-9600d26cbd3c service glance] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:39.042550 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a756bf-5ffc-4c6b-9b46-9600d26cbd3c service glance] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:39.042951 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a756bf-5ffc-4c6b-9b46-9600d26cbd3c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:39.054530 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a756bf-5ffc-4c6b-9b46-9600d26cbd3c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:39.056906 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a756bf-5ffc-4c6b-9b46-9600d26cbd3c service glance] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:39.068183 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1204/2421] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:59:41.243297 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42efc98-2438-4476-ab44-6fe402f58a1b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:41.245136 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a42efc98-2438-4476-ab44-6fe402f58a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:41.267405 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:41.313287 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42efc98-2438-4476-ab44-6fe402f58a1b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:41.317517 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22546153-3568-4933-a5a8-badc4c3dce42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:41.318214 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22546153-3568-4933-a5a8-badc4c3dce42 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:41.318573 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22546153-3568-4933-a5a8-badc4c3dce42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:41.318931 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22546153-3568-4933-a5a8-badc4c3dce42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:41.320736 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-22546153-3568-4933-a5a8-badc4c3dce42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:41.427732 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22546153-3568-4933-a5a8-badc4c3dce42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:41.429414 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22546153-3568-4933-a5a8-badc4c3dce42 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:41.442014 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1218/2422] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:45.055723 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a756bf-5ffc-4c6b-9b46-9600d26cbd3c service glance] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:45.057287 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-08a756bf-5ffc-4c6b-9b46-9600d26cbd3c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:45.070630 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a756bf-5ffc-4c6b-9b46-9600d26cbd3c service glance] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:45.075249 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ea004-5907-4c0c-9809-9abac1078534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:45.075839 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ea004-5907-4c0c-9809-9abac1078534 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:45.076117 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ea004-5907-4c0c-9809-9abac1078534 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:45.076389 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ea004-5907-4c0c-9809-9abac1078534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:45.079788 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-960ea004-5907-4c0c-9809-9abac1078534 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:45.098001 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ea004-5907-4c0c-9809-9abac1078534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:45.099385 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ea004-5907-4c0c-9809-9abac1078534 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:45.111365 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1205/2423] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:47.427568 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1643f7-8e47-4f7d-aca3-befeabd237bc None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:47.428133 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1643f7-8e47-4f7d-aca3-befeabd237bc None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:47.428308 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1643f7-8e47-4f7d-aca3-befeabd237bc None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:47.429721 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1219/2424] 10.222.0.52 () {54 vars in 921 bytes} [Sun Aug 28 00:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:59:47.437132 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e3013-7cd4-44c1-b52b-b42d6795f989 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:47.437621 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e3013-7cd4-44c1-b52b-b42d6795f989 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:47.437621 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e3013-7cd4-44c1-b52b-b42d6795f989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:47.457910 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-cc5e3013-7cd4-44c1-b52b-b42d6795f989 None None] MFA Rules not processed for user `f890ff4e7807477db7f17c2f6434dce8`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:47.459174 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-cc5e3013-7cd4-44c1-b52b-b42d6795f989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:47.470676 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1206/2425] 10.222.0.52 () {58 vars in 1018 bytes} [Sun Aug 28 00:59:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:47.484024 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1643f7-8e47-4f7d-aca3-befeabd237bc None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:47.485936 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9e1643f7-8e47-4f7d-aca3-befeabd237bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:47.501015 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1643f7-8e47-4f7d-aca3-befeabd237bc None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:47.504794 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8b62b-ce56-4eab-8d9e-f69beeb23d97 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34fd9f7932e14a409d7668d40ff6680e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:47.505413 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8b62b-ce56-4eab-8d9e-f69beeb23d97 service glance] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:47.505688 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8b62b-ce56-4eab-8d9e-f69beeb23d97 service glance] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:47.506002 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8b62b-ce56-4eab-8d9e-f69beeb23d97 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:47.517014 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8b62b-ce56-4eab-8d9e-f69beeb23d97 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:47.518489 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8b62b-ce56-4eab-8d9e-f69beeb23d97 service glance] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:47.529738 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1220/2426] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:47.604235 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bed01d-740c-48e3-88dc-2379f87fcb5a None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:47.604858 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bed01d-740c-48e3-88dc-2379f87fcb5a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:47.605264 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bed01d-740c-48e3-88dc-2379f87fcb5a None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:47.606665 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1207/2427] 10.222.0.52 () {54 vars in 921 bytes} [Sun Aug 28 00:59:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:59:47.611690 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3006a-5101-47f8-9d95-66f6f7cf2c7d None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:47.611978 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3006a-5101-47f8-9d95-66f6f7cf2c7d None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:47.612252 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3006a-5101-47f8-9d95-66f6f7cf2c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:47.632896 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-c3f3006a-5101-47f8-9d95-66f6f7cf2c7d None None] MFA Rules not processed for user `0ca94d8693c64e388bd0d15db07f5fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:47.634119 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c3f3006a-5101-47f8-9d95-66f6f7cf2c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:47.641681 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1221/2428] 10.222.0.52 () {58 vars in 1018 bytes} [Sun Aug 28 00:59:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:47.654388 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bed01d-740c-48e3-88dc-2379f87fcb5a None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:47.667557 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bed01d-740c-48e3-88dc-2379f87fcb5a None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:47.671697 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aee1f0-81ed-4007-89b2-a9afaac9db2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:47.672317 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aee1f0-81ed-4007-89b2-a9afaac9db2b service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:47.672696 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aee1f0-81ed-4007-89b2-a9afaac9db2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:47.672977 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aee1f0-81ed-4007-89b2-a9afaac9db2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:47.681312 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aee1f0-81ed-4007-89b2-a9afaac9db2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:47.682820 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aee1f0-81ed-4007-89b2-a9afaac9db2b service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:47.692558 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1208/2429] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:47.794360 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc140e-e2be-454c-b890-675aa57f4ca6 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:47.794649 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc140e-e2be-454c-b890-675aa57f4ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:47.794920 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc140e-e2be-454c-b890-675aa57f4ca6 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:47.796292 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1222/2430] 10.222.0.52 () {54 vars in 921 bytes} [Sun Aug 28 00:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:59:47.801423 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bde1a-56a7-4dbf-9e3d-ac7794004f2d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:47.801710 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bde1a-56a7-4dbf-9e3d-ac7794004f2d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:47.802019 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bde1a-56a7-4dbf-9e3d-ac7794004f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:47.822749 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e49bde1a-56a7-4dbf-9e3d-ac7794004f2d None None] MFA Rules not processed for user `f890ff4e7807477db7f17c2f6434dce8`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:47.824068 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e49bde1a-56a7-4dbf-9e3d-ac7794004f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:47.833775 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1209/2431] 10.222.0.52 () {58 vars in 1018 bytes} [Sun Aug 28 00:59:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:59:47.844629 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc140e-e2be-454c-b890-675aa57f4ca6 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:47.856853 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc140e-e2be-454c-b890-675aa57f4ca6 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:47.860542 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cd9dd-7e5b-4535-aa9d-d7f6a1c8ac03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:47.861129 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cd9dd-7e5b-4535-aa9d-d7f6a1c8ac03 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:47.861406 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cd9dd-7e5b-4535-aa9d-d7f6a1c8ac03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:47.861649 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cd9dd-7e5b-4535-aa9d-d7f6a1c8ac03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:47.871910 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cd9dd-7e5b-4535-aa9d-d7f6a1c8ac03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:47.873370 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cd9dd-7e5b-4535-aa9d-d7f6a1c8ac03 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:47.885150 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1223/2432] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:50.524910 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d340e7b-2f5c-46a3-be5b-fd898ee1a8c6 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:50.525362 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d340e7b-2f5c-46a3-be5b-fd898ee1a8c6 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:50.525475 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d340e7b-2f5c-46a3-be5b-fd898ee1a8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:50.546533 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-4d340e7b-2f5c-46a3-be5b-fd898ee1a8c6 None None] MFA Rules not processed for user `3302fdf33b5b4583a10e7c760c577cda`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:50.547754 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4d340e7b-2f5c-46a3-be5b-fd898ee1a8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:50.602987 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1210/2433] 10.222.0.52 () {58 vars in 1009 bytes} [Sun Aug 28 00:59:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:50.615985 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cd9dd-7e5b-4535-aa9d-d7f6a1c8ac03 service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:50.617511 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6b9cd9dd-7e5b-4535-aa9d-d7f6a1c8ac03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:50.707840 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cd9dd-7e5b-4535-aa9d-d7f6a1c8ac03 service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:50.713729 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de2f8b-f09a-4668-86e6-cefc2083908a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80a6019cf424c16a1d461a632cf8568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:50.714439 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de2f8b-f09a-4668-86e6-cefc2083908a service swift] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:50.714737 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de2f8b-f09a-4668-86e6-cefc2083908a service swift] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:50.715032 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de2f8b-f09a-4668-86e6-cefc2083908a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:50.723715 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de2f8b-f09a-4668-86e6-cefc2083908a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:50.725396 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de2f8b-f09a-4668-86e6-cefc2083908a service swift] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:50.733818 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1224/2434] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Aug 28 00:59:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:00:00.595741 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=49 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:00.730514 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=94 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:02.084188 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d340e7b-2f5c-46a3-be5b-fd898ee1a8c6 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:02.153570 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d340e7b-2f5c-46a3-be5b-fd898ee1a8c6 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:02.158596 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0d5c8-15c5-4257-970d-556a40df6d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:02.159225 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0d5c8-15c5-4257-970d-556a40df6d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:02.159495 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0d5c8-15c5-4257-970d-556a40df6d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:02.159761 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0d5c8-15c5-4257-970d-556a40df6d8b admin admin] PATH_INFO: `/v3/users/a5a9abc92e474313b0b571d8b03da169` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:02.160923 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0d5c8-15c5-4257-970d-556a40df6d8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5a9abc92e474313b0b571d8b03da169)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:02.162990 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0d5c8-15c5-4257-970d-556a40df6d8b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:02.214551 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-94d0d5c8-15c5-4257-970d-556a40df6d8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5a9abc92e474313b0b571d8b03da169'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:02.228264 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-94d0d5c8-15c5-4257-970d-556a40df6d8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5a9abc92e474313b0b571d8b03da169'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:02.236404 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-94d0d5c8-15c5-4257-970d-556a40df6d8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5a9abc92e474313b0b571d8b03da169'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:02.247031 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-94d0d5c8-15c5-4257-970d-556a40df6d8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5a9abc92e474313b0b571d8b03da169'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:02.247772 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-94d0d5c8-15c5-4257-970d-556a40df6d8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5a9abc92e474313b0b571d8b03da169'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:02.254127 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1211/2435] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:00:02 2022] DELETE /identity/v3/users/a5a9abc92e474313b0b571d8b03da169 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:02.258585 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5258d3-16e1-474c-befb-42239ea053b5 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:02.259074 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5258d3-16e1-474c-befb-42239ea053b5 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:02.259197 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5258d3-16e1-474c-befb-42239ea053b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:02.278627 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-fe5258d3-16e1-474c-befb-42239ea053b5 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:02.279840 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-fe5258d3-16e1-474c-befb-42239ea053b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:02.347443 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1225/2436] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:02.357744 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0d5c8-15c5-4257-970d-556a40df6d8b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:02.359511 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-94d0d5c8-15c5-4257-970d-556a40df6d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:02.418867 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0d5c8-15c5-4257-970d-556a40df6d8b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:02.422938 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaad435-5806-4424-b086-fb854ba3780d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:02.423545 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaad435-5806-4424-b086-fb854ba3780d service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:02.423817 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaad435-5806-4424-b086-fb854ba3780d service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:02.424082 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaad435-5806-4424-b086-fb854ba3780d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:02.433673 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaad435-5806-4424-b086-fb854ba3780d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:02.435222 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaad435-5806-4424-b086-fb854ba3780d service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:02.444683 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1212/2437] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:02.732772 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5258d3-16e1-474c-befb-42239ea053b5 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:02.734825 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-fe5258d3-16e1-474c-befb-42239ea053b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:02.748409 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5258d3-16e1-474c-befb-42239ea053b5 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:02.753350 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61408ba-18f2-4330-b5d1-21ac7900fe62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:02.754303 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61408ba-18f2-4330-b5d1-21ac7900fe62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:02.754625 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61408ba-18f2-4330-b5d1-21ac7900fe62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:02.754967 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61408ba-18f2-4330-b5d1-21ac7900fe62 admin admin] PATH_INFO: `/v3/projects/29c98e37701d46ff9232413d2c206660` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:02.756177 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61408ba-18f2-4330-b5d1-21ac7900fe62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29c98e37701d46ff9232413d2c206660)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:02.758225 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61408ba-18f2-4330-b5d1-21ac7900fe62 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:02.811551 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c61408ba-18f2-4330-b5d1-21ac7900fe62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29c98e37701d46ff9232413d2c206660', 'request_id': 'req-c61408ba-18f2-4330-b5d1-21ac7900fe62'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:02.820021 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c61408ba-18f2-4330-b5d1-21ac7900fe62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29c98e37701d46ff9232413d2c206660', 'request_id': 'req-c61408ba-18f2-4330-b5d1-21ac7900fe62'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:02.826278 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c61408ba-18f2-4330-b5d1-21ac7900fe62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29c98e37701d46ff9232413d2c206660', 'request_id': 'req-c61408ba-18f2-4330-b5d1-21ac7900fe62'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:02.836134 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c61408ba-18f2-4330-b5d1-21ac7900fe62 admin admin] The token cache is being invalidate because project 29c98e37701d46ff9232413d2c206660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:00:02.836418 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c61408ba-18f2-4330-b5d1-21ac7900fe62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:02.837071 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c61408ba-18f2-4330-b5d1-21ac7900fe62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:02.838571 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1226/2438] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:00:02 2022] DELETE /identity/v3/projects/29c98e37701d46ff9232413d2c206660 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:02.843693 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f7712-01b1-4fd3-9b66-daa1f3fa069a None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:02.843968 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f7712-01b1-4fd3-9b66-daa1f3fa069a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:02.844234 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f7712-01b1-4fd3-9b66-daa1f3fa069a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:02.863639 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-038f7712-01b1-4fd3-9b66-daa1f3fa069a None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:02.864818 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-038f7712-01b1-4fd3-9b66-daa1f3fa069a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:02.881936 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:02.926840 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1213/2439] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:02.936150 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52a93c-910e-481f-a262-2b0dd3f46ea3 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:02.936436 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52a93c-910e-481f-a262-2b0dd3f46ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:02.936714 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52a93c-910e-481f-a262-2b0dd3f46ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:02.957716 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-3f52a93c-910e-481f-a262-2b0dd3f46ea3 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:02.958957 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3f52a93c-910e-481f-a262-2b0dd3f46ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:02.967787 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1227/2440] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:02.973034 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f7712-01b1-4fd3-9b66-daa1f3fa069a None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:02.990273 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f7712-01b1-4fd3-9b66-daa1f3fa069a None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:02.998473 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67dc9f-9f52-4ab7-b0b6-a7e389f50492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:02.999062 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67dc9f-9f52-4ab7-b0b6-a7e389f50492 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:02.999334 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67dc9f-9f52-4ab7-b0b6-a7e389f50492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:02.999598 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67dc9f-9f52-4ab7-b0b6-a7e389f50492 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:03.000237 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67dc9f-9f52-4ab7-b0b6-a7e389f50492 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:00:03.000540 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67dc9f-9f52-4ab7-b0b6-a7e389f50492 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:03.002195 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67dc9f-9f52-4ab7-b0b6-a7e389f50492 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:03.016693 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1214/2441] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 01:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:00:03.021258 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52a93c-910e-481f-a262-2b0dd3f46ea3 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:03.030821 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52a93c-910e-481f-a262-2b0dd3f46ea3 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:03.036384 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75826bfb-ddd1-43b8-886b-879118575398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:03.036982 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75826bfb-ddd1-43b8-886b-879118575398 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:03.037258 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75826bfb-ddd1-43b8-886b-879118575398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:03.037529 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75826bfb-ddd1-43b8-886b-879118575398 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:03.038214 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75826bfb-ddd1-43b8-886b-879118575398 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:03.040141 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75826bfb-ddd1-43b8-886b-879118575398 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:03.070082 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1228/2442] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:00:03 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:00:03.074893 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67dc9f-9f52-4ab7-b0b6-a7e389f50492 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:03.085393 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67dc9f-9f52-4ab7-b0b6-a7e389f50492 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:03.108039 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75826bfb-ddd1-43b8-886b-879118575398 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:03.109874 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-75826bfb-ddd1-43b8-886b-879118575398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:03.144115 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c2c79-f995-41ff-b853-92bb7ecb3c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:03.144754 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c2c79-f995-41ff-b853-92bb7ecb3c08 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:03.145035 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c2c79-f995-41ff-b853-92bb7ecb3c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:03.145311 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c2c79-f995-41ff-b853-92bb7ecb3c08 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:03.146011 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c2c79-f995-41ff-b853-92bb7ecb3c08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:03.147993 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c2c79-f995-41ff-b853-92bb7ecb3c08 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:03.169089 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:03.171760 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1215/2443] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:00:03 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:00:03.176065 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c2c79-f995-41ff-b853-92bb7ecb3c08 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:03.186503 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c2c79-f995-41ff-b853-92bb7ecb3c08 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:03.191385 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefe5d2-db4b-4aa6-b30a-33b2b42c85c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:03.191960 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefe5d2-db4b-4aa6-b30a-33b2b42c85c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:03.192381 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefe5d2-db4b-4aa6-b30a-33b2b42c85c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:03.192508 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75826bfb-ddd1-43b8-886b-879118575398 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:03.192631 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefe5d2-db4b-4aa6-b30a-33b2b42c85c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:03.193173 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefe5d2-db4b-4aa6-b30a-33b2b42c85c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:03.194960 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefe5d2-db4b-4aa6-b30a-33b2b42c85c3 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:03.199696 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe50f1-e63a-4859-8f82-5bf2d692871d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:03.200443 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe50f1-e63a-4859-8f82-5bf2d692871d service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:03.200721 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe50f1-e63a-4859-8f82-5bf2d692871d service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:03.200988 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe50f1-e63a-4859-8f82-5bf2d692871d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:03.202796 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-2ffe50f1-e63a-4859-8f82-5bf2d692871d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:03.207862 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1216/2444] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:03.211640 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefe5d2-db4b-4aa6-b30a-33b2b42c85c3 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:03.221729 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefe5d2-db4b-4aa6-b30a-33b2b42c85c3 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:03.226349 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b003e49-43a3-4134-9491-6f8cf32aba8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:03.226928 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b003e49-43a3-4134-9491-6f8cf32aba8a admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:03.227201 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b003e49-43a3-4134-9491-6f8cf32aba8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:03.227463 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b003e49-43a3-4134-9491-6f8cf32aba8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:03.228084 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b003e49-43a3-4134-9491-6f8cf32aba8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:03.229992 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b003e49-43a3-4134-9491-6f8cf32aba8a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:03.240194 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1217/2445] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:00:03.244236 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b003e49-43a3-4134-9491-6f8cf32aba8a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:03.253996 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b003e49-43a3-4134-9491-6f8cf32aba8a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:03.258462 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c636f3-4d90-4316-812e-7bab5a24a88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:03.259121 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c636f3-4d90-4316-812e-7bab5a24a88b admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:03.259394 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c636f3-4d90-4316-812e-7bab5a24a88b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:03.259659 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c636f3-4d90-4316-812e-7bab5a24a88b admin admin] PATH_INFO: `/v3/projects/78210b78f163485f9e6d4ec247d5a7aa/users/cf8b557e3d084aa7a38a1e617ba8f5a4/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:03.261922 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe50f1-e63a-4859-8f82-5bf2d692871d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:03.263513 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe50f1-e63a-4859-8f82-5bf2d692871d service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:03.272568 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1229/2446] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:03 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:00:03.273989 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c636f3-4d90-4316-812e-7bab5a24a88b admin admin] RBAC: Authorizing `identity:create_grant(project_id=78210b78f163485f9e6d4ec247d5a7aa, user_id=cf8b557e3d084aa7a38a1e617ba8f5a4, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:03.276627 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c636f3-4d90-4316-812e-7bab5a24a88b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:03.290704 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1218/2447] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:00:03 2022] PUT /identity/v3/projects/78210b78f163485f9e6d4ec247d5a7aa/users/cf8b557e3d084aa7a38a1e617ba8f5a4/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:00:03.301402 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f912498-84fd-40ee-ac82-822be209d3fb None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:03.301966 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f912498-84fd-40ee-ac82-822be209d3fb None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:03.302240 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f912498-84fd-40ee-ac82-822be209d3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:03.329462 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-3f912498-84fd-40ee-ac82-822be209d3fb None None] MFA Rules not processed for user `cf8b557e3d084aa7a38a1e617ba8f5a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:03.330707 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3f912498-84fd-40ee-ac82-822be209d3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:03.394932 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1230/2448] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:00:03.405960 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c636f3-4d90-4316-812e-7bab5a24a88b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:03.407680 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f1c636f3-4d90-4316-812e-7bab5a24a88b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:03.467003 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c636f3-4d90-4316-812e-7bab5a24a88b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:03.472291 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda533a-291f-46ea-b682-23306aa85d68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:03.473207 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda533a-291f-46ea-b682-23306aa85d68 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:03.473484 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda533a-291f-46ea-b682-23306aa85d68 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:03.473757 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda533a-291f-46ea-b682-23306aa85d68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:03.480832 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:03.484364 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda533a-291f-46ea-b682-23306aa85d68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:03.487041 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda533a-291f-46ea-b682-23306aa85d68 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:03.501199 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1219/2449] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:04.896913 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39160c-584c-4e0a-ad41-626c6ddebc29 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:04.897455 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39160c-584c-4e0a-ad41-626c6ddebc29 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:04.897455 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39160c-584c-4e0a-ad41-626c6ddebc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:04.917085 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-ca39160c-584c-4e0a-ad41-626c6ddebc29 None None] MFA Rules not processed for user `cf8b557e3d084aa7a38a1e617ba8f5a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:04.918429 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ca39160c-584c-4e0a-ad41-626c6ddebc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:04.925977 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1231/2450] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:05.411792 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda533a-291f-46ea-b682-23306aa85d68 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:05.413331 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-beda533a-291f-46ea-b682-23306aa85d68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:05.487582 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda533a-291f-46ea-b682-23306aa85d68 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:05.492688 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eedc23-d3b2-479b-97bc-e3278b6e4458 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae87149f6ab04a9997263598737ae27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:05.493288 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eedc23-d3b2-479b-97bc-e3278b6e4458 service placement] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:05.493562 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eedc23-d3b2-479b-97bc-e3278b6e4458 service placement] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:05.493826 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eedc23-d3b2-479b-97bc-e3278b6e4458 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:05.495881 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-24eedc23-d3b2-479b-97bc-e3278b6e4458 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:05.509958 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eedc23-d3b2-479b-97bc-e3278b6e4458 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:05.511639 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eedc23-d3b2-479b-97bc-e3278b6e4458 service placement] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:05.525043 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1220/2451] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:05.757880 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b66667-35f4-4fc6-8f11-81951d56eca8 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:05.758025 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b66667-35f4-4fc6-8f11-81951d56eca8 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:05.758190 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b66667-35f4-4fc6-8f11-81951d56eca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:05.785395 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-30b66667-35f4-4fc6-8f11-81951d56eca8 None None] MFA Rules not processed for user `3302fdf33b5b4583a10e7c760c577cda`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:05.786583 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-30b66667-35f4-4fc6-8f11-81951d56eca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:05.857436 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1232/2452] 10.222.0.52 () {58 vars in 967 bytes} [Sun Aug 28 01:00:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:05.870148 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eedc23-d3b2-479b-97bc-e3278b6e4458 service placement] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:05.872106 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-24eedc23-d3b2-479b-97bc-e3278b6e4458 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:05.950157 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eedc23-d3b2-479b-97bc-e3278b6e4458 service placement] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:05.955595 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ec720-a734-4d72-ad0c-1f306fe6bb02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80a6019cf424c16a1d461a632cf8568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:05.956226 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ec720-a734-4d72-ad0c-1f306fe6bb02 service swift] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:05.956517 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ec720-a734-4d72-ad0c-1f306fe6bb02 service swift] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:05.956780 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ec720-a734-4d72-ad0c-1f306fe6bb02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:05.969240 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ec720-a734-4d72-ad0c-1f306fe6bb02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:05.972669 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ec720-a734-4d72-ad0c-1f306fe6bb02 service swift] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:05.984464 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1221/2453] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Aug 28 01:00:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:00:07.990830 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b66667-35f4-4fc6-8f11-81951d56eca8 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:07.992272 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-30b66667-35f4-4fc6-8f11-81951d56eca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:08.017188 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:08.083700 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b66667-35f4-4fc6-8f11-81951d56eca8 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:08.089193 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe56ed-dfaa-455d-90d1-40a5e79ed2bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:08.089933 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe56ed-dfaa-455d-90d1-40a5e79ed2bf service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:08.090216 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe56ed-dfaa-455d-90d1-40a5e79ed2bf service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:08.090528 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe56ed-dfaa-455d-90d1-40a5e79ed2bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:08.092329 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-77fe56ed-dfaa-455d-90d1-40a5e79ed2bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:08.160390 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe56ed-dfaa-455d-90d1-40a5e79ed2bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:08.162634 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe56ed-dfaa-455d-90d1-40a5e79ed2bf service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:08.173770 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1233/2454] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:09.040042 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ec720-a734-4d72-ad0c-1f306fe6bb02 service swift] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:09.041815 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-582ec720-a734-4d72-ad0c-1f306fe6bb02 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:09.111615 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ec720-a734-4d72-ad0c-1f306fe6bb02 service swift] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:09.115949 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cddd18-f102-4e79-b650-d014accbe8c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:09.116539 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cddd18-f102-4e79-b650-d014accbe8c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:09.116809 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cddd18-f102-4e79-b650-d014accbe8c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:09.117075 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cddd18-f102-4e79-b650-d014accbe8c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:09.119172 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f1cddd18-f102-4e79-b650-d014accbe8c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:09.129731 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cddd18-f102-4e79-b650-d014accbe8c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:09.131190 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cddd18-f102-4e79-b650-d014accbe8c4 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:09.139188 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1222/2455] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:15.711606 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe56ed-dfaa-455d-90d1-40a5e79ed2bf service nova] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:15.723768 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe56ed-dfaa-455d-90d1-40a5e79ed2bf service nova] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:15.730686 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90a2c9-4a73-434e-b1cf-17b8bb81eece service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:15.731479 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90a2c9-4a73-434e-b1cf-17b8bb81eece service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:15.731760 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90a2c9-4a73-434e-b1cf-17b8bb81eece service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:15.732040 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90a2c9-4a73-434e-b1cf-17b8bb81eece service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:15.733978 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-0f90a2c9-4a73-434e-b1cf-17b8bb81eece service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:15.802396 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90a2c9-4a73-434e-b1cf-17b8bb81eece service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:15.804042 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90a2c9-4a73-434e-b1cf-17b8bb81eece service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:15.814583 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1234/2456] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:19.135460 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:19.466913 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cddd18-f102-4e79-b650-d014accbe8c4 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:19.484002 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cddd18-f102-4e79-b650-d014accbe8c4 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:19.489647 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0c183-f575-442a-bb99-74ad6d334297 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:19.490295 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0c183-f575-442a-bb99-74ad6d334297 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:19.490659 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0c183-f575-442a-bb99-74ad6d334297 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:19.490941 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0c183-f575-442a-bb99-74ad6d334297 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:19.492824 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-aed0c183-f575-442a-bb99-74ad6d334297 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:19.506269 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed0c183-f575-442a-bb99-74ad6d334297 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:19.507870 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed0c183-f575-442a-bb99-74ad6d334297 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:19.521096 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1223/2457] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:22.097719 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e8682-5a42-4bd9-b639-34c46630e105 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:22.098195 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e8682-5a42-4bd9-b639-34c46630e105 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:22.098283 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e8682-5a42-4bd9-b639-34c46630e105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:22.118640 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-bc5e8682-5a42-4bd9-b639-34c46630e105 None None] MFA Rules not processed for user `3302fdf33b5b4583a10e7c760c577cda`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:22.119875 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-bc5e8682-5a42-4bd9-b639-34c46630e105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:22.127634 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1235/2458] 10.222.0.52 () {58 vars in 1009 bytes} [Sun Aug 28 01:00:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:22.139788 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0c183-f575-442a-bb99-74ad6d334297 service nova] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:22.151465 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0c183-f575-442a-bb99-74ad6d334297 service nova] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:22.157034 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20aaddd-9e74-478e-ba46-2316cd8b836c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80a6019cf424c16a1d461a632cf8568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:22.157638 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20aaddd-9e74-478e-ba46-2316cd8b836c service swift] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:22.157944 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20aaddd-9e74-478e-ba46-2316cd8b836c service swift] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:22.158211 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20aaddd-9e74-478e-ba46-2316cd8b836c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:22.166263 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20aaddd-9e74-478e-ba46-2316cd8b836c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:22.167941 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20aaddd-9e74-478e-ba46-2316cd8b836c service swift] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:22.175999 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1224/2459] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Aug 28 01:00:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:00:22.726210 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fc74f-813d-4c4b-96ac-2d3e2366f259 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:22.726499 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fc74f-813d-4c4b-96ac-2d3e2366f259 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:22.726775 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fc74f-813d-4c4b-96ac-2d3e2366f259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:22.749357 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-601fc74f-813d-4c4b-96ac-2d3e2366f259 None None] MFA Rules not processed for user `3302fdf33b5b4583a10e7c760c577cda`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:22.750723 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-601fc74f-813d-4c4b-96ac-2d3e2366f259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:22.757807 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1236/2460] 10.222.0.52 () {58 vars in 967 bytes} [Sun Aug 28 01:00:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:00:22.770651 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20aaddd-9e74-478e-ba46-2316cd8b836c service swift] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:22.781466 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20aaddd-9e74-478e-ba46-2316cd8b836c service swift] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:22.786818 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb39631-7b0f-4eed-b10a-ae75d7e8ba11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80a6019cf424c16a1d461a632cf8568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:22.787402 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb39631-7b0f-4eed-b10a-ae75d7e8ba11 service swift] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:22.787675 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb39631-7b0f-4eed-b10a-ae75d7e8ba11 service swift] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:22.787971 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb39631-7b0f-4eed-b10a-ae75d7e8ba11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:22.796109 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb39631-7b0f-4eed-b10a-ae75d7e8ba11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:22.797686 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb39631-7b0f-4eed-b10a-ae75d7e8ba11 service swift] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:22.808722 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1225/2461] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Aug 28 01:00:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:00:23.046696 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c6078-8d2f-4bd6-aaa9-40e9a83ecd15 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:23.047101 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c6078-8d2f-4bd6-aaa9-40e9a83ecd15 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:23.047492 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c6078-8d2f-4bd6-aaa9-40e9a83ecd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:23.067324 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-536c6078-8d2f-4bd6-aaa9-40e9a83ecd15 None None] MFA Rules not processed for user `3302fdf33b5b4583a10e7c760c577cda`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:23.068569 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-536c6078-8d2f-4bd6-aaa9-40e9a83ecd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:23.076008 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1237/2462] 10.222.0.52 () {58 vars in 1009 bytes} [Sun Aug 28 01:00:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:00:23.088034 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb39631-7b0f-4eed-b10a-ae75d7e8ba11 service swift] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:23.099554 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb39631-7b0f-4eed-b10a-ae75d7e8ba11 service swift] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:23.104921 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa834948-0354-416e-a652-a1fdb2da32f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80a6019cf424c16a1d461a632cf8568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:23.105874 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa834948-0354-416e-a652-a1fdb2da32f1 service swift] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:23.106169 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa834948-0354-416e-a652-a1fdb2da32f1 service swift] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:23.106415 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa834948-0354-416e-a652-a1fdb2da32f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:23.114954 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa834948-0354-416e-a652-a1fdb2da32f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:23.116522 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa834948-0354-416e-a652-a1fdb2da32f1 service swift] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:23.124795 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1226/2463] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Aug 28 01:00:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:00:23.478936 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd1e06-7c2e-4daf-89c8-8eadc510703e None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:23.479407 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd1e06-7c2e-4daf-89c8-8eadc510703e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:23.479499 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd1e06-7c2e-4daf-89c8-8eadc510703e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:23.500251 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-c2fd1e06-7c2e-4daf-89c8-8eadc510703e None None] MFA Rules not processed for user `3302fdf33b5b4583a10e7c760c577cda`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:23.501463 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c2fd1e06-7c2e-4daf-89c8-8eadc510703e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:23.509149 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1238/2464] 10.222.0.52 () {58 vars in 967 bytes} [Sun Aug 28 01:00:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:23.522060 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa834948-0354-416e-a652-a1fdb2da32f1 service swift] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:23.533342 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa834948-0354-416e-a652-a1fdb2da32f1 service swift] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:23.539715 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d2ac6-9f77-4fda-87c4-dd5545c2a374 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80a6019cf424c16a1d461a632cf8568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:23.540363 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d2ac6-9f77-4fda-87c4-dd5545c2a374 service swift] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:23.540704 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d2ac6-9f77-4fda-87c4-dd5545c2a374 service swift] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:23.540942 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d2ac6-9f77-4fda-87c4-dd5545c2a374 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:23.550248 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d2ac6-9f77-4fda-87c4-dd5545c2a374 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:23.551904 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d2ac6-9f77-4fda-87c4-dd5545c2a374 service swift] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:23.560262 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1227/2465] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Aug 28 01:00:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:00:25.842222 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd1e06-7c2e-4daf-89c8-8eadc510703e None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:25.877059 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:25.912868 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd1e06-7c2e-4daf-89c8-8eadc510703e None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:25.917495 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc30dd-43e0-4ddf-b2ec-a13e995c88b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:25.918261 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc30dd-43e0-4ddf-b2ec-a13e995c88b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:25.918535 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc30dd-43e0-4ddf-b2ec-a13e995c88b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:25.918802 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc30dd-43e0-4ddf-b2ec-a13e995c88b2 admin admin] PATH_INFO: `/v3/users/cf8b557e3d084aa7a38a1e617ba8f5a4` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:25.919941 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc30dd-43e0-4ddf-b2ec-a13e995c88b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf8b557e3d084aa7a38a1e617ba8f5a4)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:25.922142 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc30dd-43e0-4ddf-b2ec-a13e995c88b2 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:25.981296 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-5edc30dd-43e0-4ddf-b2ec-a13e995c88b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf8b557e3d084aa7a38a1e617ba8f5a4'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:25.988958 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-5edc30dd-43e0-4ddf-b2ec-a13e995c88b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf8b557e3d084aa7a38a1e617ba8f5a4'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:25.999034 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-5edc30dd-43e0-4ddf-b2ec-a13e995c88b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf8b557e3d084aa7a38a1e617ba8f5a4'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:26.013138 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-5edc30dd-43e0-4ddf-b2ec-a13e995c88b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf8b557e3d084aa7a38a1e617ba8f5a4'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:26.013924 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-5edc30dd-43e0-4ddf-b2ec-a13e995c88b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf8b557e3d084aa7a38a1e617ba8f5a4'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:26.019956 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1239/2466] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:00:25 2022] DELETE /identity/v3/users/cf8b557e3d084aa7a38a1e617ba8f5a4 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:26.024528 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dba3f4-f069-44c9-bbde-64a104060382 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:26.025046 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dba3f4-f069-44c9-bbde-64a104060382 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:26.025196 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dba3f4-f069-44c9-bbde-64a104060382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:26.044958 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e6dba3f4-f069-44c9-bbde-64a104060382 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:26.046262 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e6dba3f4-f069-44c9-bbde-64a104060382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:26.107791 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1228/2467] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:00:26.117820 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc30dd-43e0-4ddf-b2ec-a13e995c88b2 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:26.119456 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-5edc30dd-43e0-4ddf-b2ec-a13e995c88b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:26.181665 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc30dd-43e0-4ddf-b2ec-a13e995c88b2 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:26.185720 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23da471-9bf5-4383-8813-f266e240272b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:26.186384 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23da471-9bf5-4383-8813-f266e240272b service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:26.186672 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23da471-9bf5-4383-8813-f266e240272b service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:26.186944 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23da471-9bf5-4383-8813-f266e240272b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:26.198998 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23da471-9bf5-4383-8813-f266e240272b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:26.200622 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23da471-9bf5-4383-8813-f266e240272b service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:26.213374 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1240/2468] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:26.431001 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dba3f4-f069-44c9-bbde-64a104060382 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:26.432433 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e6dba3f4-f069-44c9-bbde-64a104060382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:26.454709 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dba3f4-f069-44c9-bbde-64a104060382 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:26.464961 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4abf9-b8d6-4050-a658-83605643ad21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:26.465741 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4abf9-b8d6-4050-a658-83605643ad21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:26.466149 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4abf9-b8d6-4050-a658-83605643ad21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:26.466491 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4abf9-b8d6-4050-a658-83605643ad21 admin admin] PATH_INFO: `/v3/projects/78210b78f163485f9e6d4ec247d5a7aa` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:26.467732 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4abf9-b8d6-4050-a658-83605643ad21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78210b78f163485f9e6d4ec247d5a7aa)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:26.469729 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4abf9-b8d6-4050-a658-83605643ad21 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:26.519390 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e6f4abf9-b8d6-4050-a658-83605643ad21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78210b78f163485f9e6d4ec247d5a7aa', 'request_id': 'req-e6f4abf9-b8d6-4050-a658-83605643ad21'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:26.524891 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e6f4abf9-b8d6-4050-a658-83605643ad21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78210b78f163485f9e6d4ec247d5a7aa', 'request_id': 'req-e6f4abf9-b8d6-4050-a658-83605643ad21'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:26.531539 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e6f4abf9-b8d6-4050-a658-83605643ad21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78210b78f163485f9e6d4ec247d5a7aa', 'request_id': 'req-e6f4abf9-b8d6-4050-a658-83605643ad21'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:26.545515 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e6f4abf9-b8d6-4050-a658-83605643ad21 admin admin] The token cache is being invalidate because project 78210b78f163485f9e6d4ec247d5a7aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:00:26.545803 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e6f4abf9-b8d6-4050-a658-83605643ad21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:26.546497 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e6f4abf9-b8d6-4050-a658-83605643ad21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:26.548002 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1229/2469] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:00:26 2022] DELETE /identity/v3/projects/78210b78f163485f9e6d4ec247d5a7aa => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:26.552953 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129a71b-82ce-4082-b93a-1d03b21dda20 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:26.553243 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129a71b-82ce-4082-b93a-1d03b21dda20 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:26.553519 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129a71b-82ce-4082-b93a-1d03b21dda20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:26.573058 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-d129a71b-82ce-4082-b93a-1d03b21dda20 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:26.574537 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d129a71b-82ce-4082-b93a-1d03b21dda20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:26.624671 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:26.645315 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1241/2470] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:26.653601 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c565963-d4f9-4be5-906d-ffb3a273b144 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:26.653898 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c565963-d4f9-4be5-906d-ffb3a273b144 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:26.654199 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c565963-d4f9-4be5-906d-ffb3a273b144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:26.676470 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-6c565963-d4f9-4be5-906d-ffb3a273b144 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:26.677694 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6c565963-d4f9-4be5-906d-ffb3a273b144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:26.686527 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1230/2471] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:26.691064 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129a71b-82ce-4082-b93a-1d03b21dda20 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:26.702783 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129a71b-82ce-4082-b93a-1d03b21dda20 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:26.707906 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485d080-cf28-4885-bf9d-e61572112850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:26.708515 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485d080-cf28-4885-bf9d-e61572112850 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:26.708794 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485d080-cf28-4885-bf9d-e61572112850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:26.709066 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485d080-cf28-4885-bf9d-e61572112850 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:26.709714 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485d080-cf28-4885-bf9d-e61572112850 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:00:26.710054 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485d080-cf28-4885-bf9d-e61572112850 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:26.712010 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485d080-cf28-4885-bf9d-e61572112850 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:26.725668 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1242/2472] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 01:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:00:26.730032 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c565963-d4f9-4be5-906d-ffb3a273b144 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:26.739853 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c565963-d4f9-4be5-906d-ffb3a273b144 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:26.744654 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95c9b1-ce4f-47f6-a62d-7dfa6f949a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:26.745252 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95c9b1-ce4f-47f6-a62d-7dfa6f949a1a admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:26.745529 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95c9b1-ce4f-47f6-a62d-7dfa6f949a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:26.745971 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95c9b1-ce4f-47f6-a62d-7dfa6f949a1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:26.746605 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95c9b1-ce4f-47f6-a62d-7dfa6f949a1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:26.748412 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95c9b1-ce4f-47f6-a62d-7dfa6f949a1a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:26.758388 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:26.784765 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1231/2473] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:00:26 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:00:26.785925 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485d080-cf28-4885-bf9d-e61572112850 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:26.796713 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485d080-cf28-4885-bf9d-e61572112850 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:26.858248 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f722dd9-993f-43e9-84cf-50f5ec87599f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:26.858935 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f722dd9-993f-43e9-84cf-50f5ec87599f admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:26.859125 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f722dd9-993f-43e9-84cf-50f5ec87599f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:26.859392 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f722dd9-993f-43e9-84cf-50f5ec87599f admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:26.860031 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f722dd9-993f-43e9-84cf-50f5ec87599f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:26.862089 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f722dd9-993f-43e9-84cf-50f5ec87599f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:26.888347 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1243/2474] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:00:26 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:00:26.889638 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95c9b1-ce4f-47f6-a62d-7dfa6f949a1a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:26.900268 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95c9b1-ce4f-47f6-a62d-7dfa6f949a1a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:26.905206 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d142591-8779-4b25-a228-0a2cae47265f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:26.905803 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d142591-8779-4b25-a228-0a2cae47265f admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:26.906111 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d142591-8779-4b25-a228-0a2cae47265f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:26.906383 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d142591-8779-4b25-a228-0a2cae47265f admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:26.907085 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d142591-8779-4b25-a228-0a2cae47265f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:26.908702 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d142591-8779-4b25-a228-0a2cae47265f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:26.918793 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1232/2475] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:26.922978 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f722dd9-993f-43e9-84cf-50f5ec87599f admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:26.933630 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f722dd9-993f-43e9-84cf-50f5ec87599f admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:26.938933 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d7986-0cf7-4857-8464-b7a94dd2ca45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:26.939541 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d7986-0cf7-4857-8464-b7a94dd2ca45 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:26.939821 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d7986-0cf7-4857-8464-b7a94dd2ca45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:26.940092 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d7986-0cf7-4857-8464-b7a94dd2ca45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:26.940740 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d7986-0cf7-4857-8464-b7a94dd2ca45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:26.942386 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d7986-0cf7-4857-8464-b7a94dd2ca45 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:26.953789 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1244/2476] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:26.958043 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d142591-8779-4b25-a228-0a2cae47265f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:26.976456 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d142591-8779-4b25-a228-0a2cae47265f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:26.982247 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc41c0-0760-41a1-9d18-d9d36f4ca54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:26.983051 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc41c0-0760-41a1-9d18-d9d36f4ca54c admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:26.983424 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc41c0-0760-41a1-9d18-d9d36f4ca54c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:26.983766 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc41c0-0760-41a1-9d18-d9d36f4ca54c admin admin] PATH_INFO: `/v3/projects/9bb6aa93abcd4385b9e8a495e873fbfd/users/bbf6bdd1f9124a35a682d55057573fb7/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:27.000701 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc41c0-0760-41a1-9d18-d9d36f4ca54c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bb6aa93abcd4385b9e8a495e873fbfd, user_id=bbf6bdd1f9124a35a682d55057573fb7, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:27.004131 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc41c0-0760-41a1-9d18-d9d36f4ca54c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:27.025184 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1233/2477] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:00:26 2022] PUT /identity/v3/projects/9bb6aa93abcd4385b9e8a495e873fbfd/users/bbf6bdd1f9124a35a682d55057573fb7/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:27.036460 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7ffdc-6042-43ca-ab27-b0268c9f3492 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:27.037136 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7ffdc-6042-43ca-ab27-b0268c9f3492 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:27.037613 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7ffdc-6042-43ca-ab27-b0268c9f3492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:27.072521 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-d5b7ffdc-6042-43ca-ab27-b0268c9f3492 None None] MFA Rules not processed for user `bbf6bdd1f9124a35a682d55057573fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:27.073865 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d5b7ffdc-6042-43ca-ab27-b0268c9f3492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:27.163263 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1245/2478] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:27.175915 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc41c0-0760-41a1-9d18-d9d36f4ca54c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:27.177798 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e9dc41c0-0760-41a1-9d18-d9d36f4ca54c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:27.247936 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc41c0-0760-41a1-9d18-d9d36f4ca54c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:27.251614 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce7600-5f42-4ea3-aa92-b87639ce80c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:27.252227 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce7600-5f42-4ea3-aa92-b87639ce80c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:27.252508 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce7600-5f42-4ea3-aa92-b87639ce80c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:27.252779 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce7600-5f42-4ea3-aa92-b87639ce80c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:27.262233 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce7600-5f42-4ea3-aa92-b87639ce80c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:27.263886 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce7600-5f42-4ea3-aa92-b87639ce80c9 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:27.279680 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1234/2479] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:27 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:31.879164 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7ffdc-6042-43ca-ab27-b0268c9f3492 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:31.880692 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d5b7ffdc-6042-43ca-ab27-b0268c9f3492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:31.935433 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:31.943680 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7ffdc-6042-43ca-ab27-b0268c9f3492 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:31.947669 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866b16e-cd1f-44fe-87da-ee93a827f2ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:31.948277 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866b16e-cd1f-44fe-87da-ee93a827f2ac service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:31.948555 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866b16e-cd1f-44fe-87da-ee93a827f2ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:31.948956 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866b16e-cd1f-44fe-87da-ee93a827f2ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:31.950763 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8866b16e-cd1f-44fe-87da-ee93a827f2ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:32.020178 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8866b16e-cd1f-44fe-87da-ee93a827f2ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:32.021624 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8866b16e-cd1f-44fe-87da-ee93a827f2ac service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:32.035965 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1246/2480] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:33.749579 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce7600-5f42-4ea3-aa92-b87639ce80c9 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:33.760038 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce7600-5f42-4ea3-aa92-b87639ce80c9 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:33.764679 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32601b7b-ffdc-45cd-ab3f-8a7321ff60cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:33.765441 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32601b7b-ffdc-45cd-ab3f-8a7321ff60cb service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:33.765778 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32601b7b-ffdc-45cd-ab3f-8a7321ff60cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:33.766207 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32601b7b-ffdc-45cd-ab3f-8a7321ff60cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:33.768045 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-32601b7b-ffdc-45cd-ab3f-8a7321ff60cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:33.781517 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32601b7b-ffdc-45cd-ab3f-8a7321ff60cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:33.783110 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32601b7b-ffdc-45cd-ab3f-8a7321ff60cb service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:33.798143 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1235/2481] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:35.599537 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866b16e-cd1f-44fe-87da-ee93a827f2ac service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:35.601011 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8866b16e-cd1f-44fe-87da-ee93a827f2ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:35.627236 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866b16e-cd1f-44fe-87da-ee93a827f2ac service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:35.634158 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d422cf1-101a-46a1-9d5c-fb4d7e8d7ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:35.634811 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d422cf1-101a-46a1-9d5c-fb4d7e8d7ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:35.635089 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d422cf1-101a-46a1-9d5c-fb4d7e8d7ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:35.635530 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d422cf1-101a-46a1-9d5c-fb4d7e8d7ccc admin admin] PATH_INFO: `/v3/users/5f227aa72915442384469ddc844198dd` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:35.637430 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d422cf1-101a-46a1-9d5c-fb4d7e8d7ccc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f227aa72915442384469ddc844198dd)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:35.640340 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d422cf1-101a-46a1-9d5c-fb4d7e8d7ccc admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:35.712521 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-1d422cf1-101a-46a1-9d5c-fb4d7e8d7ccc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f227aa72915442384469ddc844198dd'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:35.724730 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-1d422cf1-101a-46a1-9d5c-fb4d7e8d7ccc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f227aa72915442384469ddc844198dd'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:35.735064 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-1d422cf1-101a-46a1-9d5c-fb4d7e8d7ccc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f227aa72915442384469ddc844198dd'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:35.750532 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-1d422cf1-101a-46a1-9d5c-fb4d7e8d7ccc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f227aa72915442384469ddc844198dd'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:35.751696 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-1d422cf1-101a-46a1-9d5c-fb4d7e8d7ccc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f227aa72915442384469ddc844198dd'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:35.761144 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1247/2482] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:00:35 2022] DELETE /identity/v3/users/5f227aa72915442384469ddc844198dd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:35.946979 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32601b7b-ffdc-45cd-ab3f-8a7321ff60cb service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:35.958262 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32601b7b-ffdc-45cd-ab3f-8a7321ff60cb service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:36.043956 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21deb0-0ce0-4acd-acc3-07ac5ee67652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:36.044703 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21deb0-0ce0-4acd-acc3-07ac5ee67652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:36.045051 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21deb0-0ce0-4acd-acc3-07ac5ee67652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:36.045389 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21deb0-0ce0-4acd-acc3-07ac5ee67652 admin admin] PATH_INFO: `/v3/projects/44778b8fc08d4efaadf42fe5a382b5da` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:36.046861 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba21deb0-0ce0-4acd-acc3-07ac5ee67652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44778b8fc08d4efaadf42fe5a382b5da)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:36.049371 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba21deb0-0ce0-4acd-acc3-07ac5ee67652 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:36.096768 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:36.099826 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ba21deb0-0ce0-4acd-acc3-07ac5ee67652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44778b8fc08d4efaadf42fe5a382b5da', 'request_id': 'req-ba21deb0-0ce0-4acd-acc3-07ac5ee67652'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:36.107559 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ba21deb0-0ce0-4acd-acc3-07ac5ee67652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44778b8fc08d4efaadf42fe5a382b5da', 'request_id': 'req-ba21deb0-0ce0-4acd-acc3-07ac5ee67652'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:36.115048 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ba21deb0-0ce0-4acd-acc3-07ac5ee67652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44778b8fc08d4efaadf42fe5a382b5da', 'request_id': 'req-ba21deb0-0ce0-4acd-acc3-07ac5ee67652'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:36.132853 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ba21deb0-0ce0-4acd-acc3-07ac5ee67652 admin admin] The token cache is being invalidate because project 44778b8fc08d4efaadf42fe5a382b5da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:00:36.133073 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ba21deb0-0ce0-4acd-acc3-07ac5ee67652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:36.133700 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ba21deb0-0ce0-4acd-acc3-07ac5ee67652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:36.135245 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1236/2483] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:00:35 2022] DELETE /identity/v3/projects/44778b8fc08d4efaadf42fe5a382b5da => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:36.140579 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6a843-ac13-4046-a5ca-f38701d24eaa None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:36.141141 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6a843-ac13-4046-a5ca-f38701d24eaa None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:36.141559 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6a843-ac13-4046-a5ca-f38701d24eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:36.163461 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-c2c6a843-ac13-4046-a5ca-f38701d24eaa None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:36.165096 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c2c6a843-ac13-4046-a5ca-f38701d24eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:36.232148 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1248/2484] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:36.240658 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec8064-b6d4-4c7b-8526-226e272485f0 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:36.240952 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec8064-b6d4-4c7b-8526-226e272485f0 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:36.241223 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec8064-b6d4-4c7b-8526-226e272485f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:36.265595 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-cbec8064-b6d4-4c7b-8526-226e272485f0 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:36.266796 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-cbec8064-b6d4-4c7b-8526-226e272485f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:36.275129 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1237/2485] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:36.279820 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6a843-ac13-4046-a5ca-f38701d24eaa None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:36.290426 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6a843-ac13-4046-a5ca-f38701d24eaa None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:36.296089 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85335448-04e5-4b3c-8c7b-b88f12da3c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:36.296732 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85335448-04e5-4b3c-8c7b-b88f12da3c89 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:36.297152 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85335448-04e5-4b3c-8c7b-b88f12da3c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:36.297270 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85335448-04e5-4b3c-8c7b-b88f12da3c89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:36.297936 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85335448-04e5-4b3c-8c7b-b88f12da3c89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:00:36.298239 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85335448-04e5-4b3c-8c7b-b88f12da3c89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:36.299881 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85335448-04e5-4b3c-8c7b-b88f12da3c89 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:36.302560 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:36.322167 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1249/2486] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 01:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:00:36.324155 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec8064-b6d4-4c7b-8526-226e272485f0 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:36.334074 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec8064-b6d4-4c7b-8526-226e272485f0 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:36.340730 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3bc83-b3ce-4399-a481-1c6f2eb41445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:36.341519 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3bc83-b3ce-4399-a481-1c6f2eb41445 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:36.341804 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3bc83-b3ce-4399-a481-1c6f2eb41445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:36.342210 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3bc83-b3ce-4399-a481-1c6f2eb41445 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:36.342994 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3bc83-b3ce-4399-a481-1c6f2eb41445 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:36.345230 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3bc83-b3ce-4399-a481-1c6f2eb41445 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:36.386893 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1238/2487] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:00:36 2022] POST /identity/v3/projects => generated 367 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:00:36.391543 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85335448-04e5-4b3c-8c7b-b88f12da3c89 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:36.403131 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85335448-04e5-4b3c-8c7b-b88f12da3c89 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:36.474201 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aaab75-25d4-42e9-a96c-8008aeb16c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:36.474813 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aaab75-25d4-42e9-a96c-8008aeb16c25 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:36.475115 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aaab75-25d4-42e9-a96c-8008aeb16c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:36.475384 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aaab75-25d4-42e9-a96c-8008aeb16c25 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:36.476016 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aaab75-25d4-42e9-a96c-8008aeb16c25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:36.477951 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aaab75-25d4-42e9-a96c-8008aeb16c25 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:36.504824 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1250/2488] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:00:36 2022] POST /identity/v3/users => generated 284 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:00:36.508906 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3bc83-b3ce-4399-a481-1c6f2eb41445 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:36.519713 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3bc83-b3ce-4399-a481-1c6f2eb41445 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:36.527434 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b66fc-050b-464d-bccb-dcf8739e9497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:36.528077 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b66fc-050b-464d-bccb-dcf8739e9497 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:36.528361 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b66fc-050b-464d-bccb-dcf8739e9497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:36.529111 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b66fc-050b-464d-bccb-dcf8739e9497 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:36.529322 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b66fc-050b-464d-bccb-dcf8739e9497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:36.543687 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b66fc-050b-464d-bccb-dcf8739e9497 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:36.556588 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1239/2489] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:36.560523 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aaab75-25d4-42e9-a96c-8008aeb16c25 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:36.570700 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aaab75-25d4-42e9-a96c-8008aeb16c25 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:36.580967 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef9359-ce25-4d73-b89f-14abc508df53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:36.582227 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef9359-ce25-4d73-b89f-14abc508df53 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:36.582649 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef9359-ce25-4d73-b89f-14abc508df53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:36.583022 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef9359-ce25-4d73-b89f-14abc508df53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:36.583939 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef9359-ce25-4d73-b89f-14abc508df53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:36.586098 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef9359-ce25-4d73-b89f-14abc508df53 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:36.598929 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1251/2490] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:36.603203 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b66fc-050b-464d-bccb-dcf8739e9497 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:36.614265 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b66fc-050b-464d-bccb-dcf8739e9497 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:36.619613 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145594e-1639-48b0-97da-8c014d1a92cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:36.620278 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145594e-1639-48b0-97da-8c014d1a92cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:36.620558 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145594e-1639-48b0-97da-8c014d1a92cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:36.620967 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145594e-1639-48b0-97da-8c014d1a92cd admin admin] PATH_INFO: `/v3/projects/fa7cc3f9ff7c4ade88190850f8d8d8bf/users/d69d7efad20a4f90a211070681e91e5f/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:36.639035 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145594e-1639-48b0-97da-8c014d1a92cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa7cc3f9ff7c4ade88190850f8d8d8bf, user_id=d69d7efad20a4f90a211070681e91e5f, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:36.646362 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145594e-1639-48b0-97da-8c014d1a92cd admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:36.664257 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1240/2491] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:00:36 2022] PUT /identity/v3/projects/fa7cc3f9ff7c4ade88190850f8d8d8bf/users/d69d7efad20a4f90a211070681e91e5f/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:00:36.675022 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ef731-b68c-4c97-8e50-3adea909b32e None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:36.675533 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ef731-b68c-4c97-8e50-3adea909b32e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:36.675646 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ef731-b68c-4c97-8e50-3adea909b32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:36.706500 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-df0ef731-b68c-4c97-8e50-3adea909b32e None None] MFA Rules not processed for user `d69d7efad20a4f90a211070681e91e5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:36.708344 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-df0ef731-b68c-4c97-8e50-3adea909b32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:36.820258 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1252/2492] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:36.833288 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145594e-1639-48b0-97da-8c014d1a92cd admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:36.835212 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6145594e-1639-48b0-97da-8c014d1a92cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:36.925382 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145594e-1639-48b0-97da-8c014d1a92cd admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:36.929514 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ee52d-2e7a-4bb6-998b-957fb8bf8282 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:36.930200 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ee52d-2e7a-4bb6-998b-957fb8bf8282 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:36.930480 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ee52d-2e7a-4bb6-998b-957fb8bf8282 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:36.931288 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ee52d-2e7a-4bb6-998b-957fb8bf8282 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:36.941235 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ee52d-2e7a-4bb6-998b-957fb8bf8282 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:36.942859 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ee52d-2e7a-4bb6-998b-957fb8bf8282 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:36.966142 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1241/2493] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:37.273539 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ef731-b68c-4c97-8e50-3adea909b32e None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:37.275036 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-df0ef731-b68c-4c97-8e50-3adea909b32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:37.377219 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ef731-b68c-4c97-8e50-3adea909b32e None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:37.382343 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee41f8-6898-43f4-a384-530de2399c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:37.383128 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee41f8-6898-43f4-a384-530de2399c19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:37.383274 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee41f8-6898-43f4-a384-530de2399c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:37.383542 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee41f8-6898-43f4-a384-530de2399c19 admin admin] PATH_INFO: `/v3/users/1810e64573d145d48b13c774b7a07e60` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:37.384696 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee41f8-6898-43f4-a384-530de2399c19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1810e64573d145d48b13c774b7a07e60)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:37.387511 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee41f8-6898-43f4-a384-530de2399c19 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:37.392186 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:37.441884 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-dcee41f8-6898-43f4-a384-530de2399c19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1810e64573d145d48b13c774b7a07e60'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:37.448554 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-dcee41f8-6898-43f4-a384-530de2399c19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1810e64573d145d48b13c774b7a07e60'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:37.455637 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-dcee41f8-6898-43f4-a384-530de2399c19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1810e64573d145d48b13c774b7a07e60'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:37.467625 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-dcee41f8-6898-43f4-a384-530de2399c19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1810e64573d145d48b13c774b7a07e60'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:37.468342 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-dcee41f8-6898-43f4-a384-530de2399c19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1810e64573d145d48b13c774b7a07e60'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:37.474512 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1253/2494] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:00:37 2022] DELETE /identity/v3/users/1810e64573d145d48b13c774b7a07e60 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:37.665976 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ee52d-2e7a-4bb6-998b-957fb8bf8282 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:37.679196 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ee52d-2e7a-4bb6-998b-957fb8bf8282 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:37.705231 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee41f8-6898-43f4-a384-530de2399c19 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:37.706725 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-dcee41f8-6898-43f4-a384-530de2399c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:37.747955 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372ff02-13c1-4048-a93f-890a676eb058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:37.748583 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372ff02-13c1-4048-a93f-890a676eb058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:37.748865 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372ff02-13c1-4048-a93f-890a676eb058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:37.749142 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372ff02-13c1-4048-a93f-890a676eb058 admin admin] PATH_INFO: `/v3/projects/92ce0c8bbcda4400b3dc7f220dff9ed1` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:37.750943 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372ff02-13c1-4048-a93f-890a676eb058 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92ce0c8bbcda4400b3dc7f220dff9ed1)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:37.753385 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372ff02-13c1-4048-a93f-890a676eb058 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:37.771064 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:37.776786 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee41f8-6898-43f4-a384-530de2399c19 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:37.781901 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126de48-30c6-4068-8ad8-dabda75cba9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:37.782548 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126de48-30c6-4068-8ad8-dabda75cba9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:37.782954 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126de48-30c6-4068-8ad8-dabda75cba9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:37.783299 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126de48-30c6-4068-8ad8-dabda75cba9d admin admin] PATH_INFO: `/v3/users/bbf6bdd1f9124a35a682d55057573fb7` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:37.784660 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1126de48-30c6-4068-8ad8-dabda75cba9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbf6bdd1f9124a35a682d55057573fb7)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:37.786838 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1126de48-30c6-4068-8ad8-dabda75cba9d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:37.803939 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a372ff02-13c1-4048-a93f-890a676eb058 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92ce0c8bbcda4400b3dc7f220dff9ed1', 'request_id': 'req-a372ff02-13c1-4048-a93f-890a676eb058'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:37.811168 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a372ff02-13c1-4048-a93f-890a676eb058 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92ce0c8bbcda4400b3dc7f220dff9ed1', 'request_id': 'req-a372ff02-13c1-4048-a93f-890a676eb058'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:37.818975 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a372ff02-13c1-4048-a93f-890a676eb058 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92ce0c8bbcda4400b3dc7f220dff9ed1', 'request_id': 'req-a372ff02-13c1-4048-a93f-890a676eb058'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:37.832051 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a372ff02-13c1-4048-a93f-890a676eb058 admin admin] The token cache is being invalidate because project 92ce0c8bbcda4400b3dc7f220dff9ed1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:00:37.832347 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a372ff02-13c1-4048-a93f-890a676eb058 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:37.832962 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a372ff02-13c1-4048-a93f-890a676eb058 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:37.834495 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1242/2495] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:00:37 2022] DELETE /identity/v3/projects/92ce0c8bbcda4400b3dc7f220dff9ed1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:37.838071 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-1126de48-30c6-4068-8ad8-dabda75cba9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbf6bdd1f9124a35a682d55057573fb7'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:37.839638 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145134a-cbd8-46b5-ac33-eb3825fa0072 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:37.840017 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145134a-cbd8-46b5-ac33-eb3825fa0072 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:37.840299 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145134a-cbd8-46b5-ac33-eb3825fa0072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:37.843359 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-1126de48-30c6-4068-8ad8-dabda75cba9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbf6bdd1f9124a35a682d55057573fb7'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:37.851726 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-1126de48-30c6-4068-8ad8-dabda75cba9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbf6bdd1f9124a35a682d55057573fb7'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:37.860553 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-4145134a-cbd8-46b5-ac33-eb3825fa0072 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:37.861957 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4145134a-cbd8-46b5-ac33-eb3825fa0072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:37.864321 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-1126de48-30c6-4068-8ad8-dabda75cba9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbf6bdd1f9124a35a682d55057573fb7'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:37.864967 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-1126de48-30c6-4068-8ad8-dabda75cba9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbf6bdd1f9124a35a682d55057573fb7'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:37.871042 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1254/2496] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:00:37 2022] DELETE /identity/v3/users/bbf6bdd1f9124a35a682d55057573fb7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:37.875407 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16e0e5-cea3-4cf1-9c8a-fa34137a1f71 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:37.875755 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16e0e5-cea3-4cf1-9c8a-fa34137a1f71 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:37.876087 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16e0e5-cea3-4cf1-9c8a-fa34137a1f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:37.883172 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:37.899663 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-9c16e0e5-cea3-4cf1-9c8a-fa34137a1f71 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:37.900864 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9c16e0e5-cea3-4cf1-9c8a-fa34137a1f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:37.922663 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1243/2497] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:37.930682 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058148c-ec4f-4617-a027-61e3e50f1f9c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:37.930969 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058148c-ec4f-4617-a027-61e3e50f1f9c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:37.931244 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058148c-ec4f-4617-a027-61e3e50f1f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:37.951741 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a058148c-ec4f-4617-a027-61e3e50f1f9c None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:37.952963 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a058148c-ec4f-4617-a027-61e3e50f1f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:37.960068 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1255/2498] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:00:37.961068 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1244/2499] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:00:37.966222 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16e0e5-cea3-4cf1-9c8a-fa34137a1f71 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:37.970311 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058148c-ec4f-4617-a027-61e3e50f1f9c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:37.971660 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a058148c-ec4f-4617-a027-61e3e50f1f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:37.976070 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16e0e5-cea3-4cf1-9c8a-fa34137a1f71 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:37.981350 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bceb3d-e810-48af-b155-25f377fcecc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:37.981985 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bceb3d-e810-48af-b155-25f377fcecc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:37.982260 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bceb3d-e810-48af-b155-25f377fcecc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:37.982529 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bceb3d-e810-48af-b155-25f377fcecc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:37.983170 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bceb3d-e810-48af-b155-25f377fcecc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:00:37.983470 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bceb3d-e810-48af-b155-25f377fcecc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:37.985065 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bceb3d-e810-48af-b155-25f377fcecc7 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:37.996474 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1256/2500] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 01:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:00:38.000702 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bceb3d-e810-48af-b155-25f377fcecc7 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:38.010074 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bceb3d-e810-48af-b155-25f377fcecc7 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:38.014750 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f293d-8628-440a-94cb-58581ca90e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:38.015328 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f293d-8628-440a-94cb-58581ca90e48 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:38.015601 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f293d-8628-440a-94cb-58581ca90e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:38.015866 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f293d-8628-440a-94cb-58581ca90e48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:38.016480 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f293d-8628-440a-94cb-58581ca90e48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:38.018394 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f293d-8628-440a-94cb-58581ca90e48 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:38.030545 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058148c-ec4f-4617-a027-61e3e50f1f9c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:38.034312 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08911809-c2c3-41ba-a216-d6af8bf0dcda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:38.034919 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08911809-c2c3-41ba-a216-d6af8bf0dcda service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:38.035196 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08911809-c2c3-41ba-a216-d6af8bf0dcda service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:38.035477 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08911809-c2c3-41ba-a216-d6af8bf0dcda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:38.045680 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08911809-c2c3-41ba-a216-d6af8bf0dcda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:38.047163 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08911809-c2c3-41ba-a216-d6af8bf0dcda service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:38.048407 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1257/2501] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:00:37 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:00:38.052466 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f293d-8628-440a-94cb-58581ca90e48 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:38.058486 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1245/2502] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:00:38.119087 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f293d-8628-440a-94cb-58581ca90e48 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:38.125439 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ac32e-5e70-45e6-8b0d-0a889bf72b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:38.126345 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ac32e-5e70-45e6-8b0d-0a889bf72b5f admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:38.126641 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ac32e-5e70-45e6-8b0d-0a889bf72b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:38.126915 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ac32e-5e70-45e6-8b0d-0a889bf72b5f admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:38.127645 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ac32e-5e70-45e6-8b0d-0a889bf72b5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:38.129757 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ac32e-5e70-45e6-8b0d-0a889bf72b5f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:38.154248 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1258/2503] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:00:38 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:00:38.158799 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08911809-c2c3-41ba-a216-d6af8bf0dcda service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:38.169524 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08911809-c2c3-41ba-a216-d6af8bf0dcda service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:38.174594 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5c91c-e127-4e55-b929-345f53899b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:38.175165 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5c91c-e127-4e55-b929-345f53899b4f admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:38.175442 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5c91c-e127-4e55-b929-345f53899b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:38.175707 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5c91c-e127-4e55-b929-345f53899b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:38.176463 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec5c91c-e127-4e55-b929-345f53899b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:38.178015 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec5c91c-e127-4e55-b929-345f53899b4f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:38.190158 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1246/2504] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:38.195014 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ac32e-5e70-45e6-8b0d-0a889bf72b5f admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:38.212321 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ac32e-5e70-45e6-8b0d-0a889bf72b5f admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:38.218596 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8f528-3d4d-4b68-bc1d-b335ad052a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:38.219213 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8f528-3d4d-4b68-bc1d-b335ad052a5c admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:38.219492 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8f528-3d4d-4b68-bc1d-b335ad052a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:38.219748 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8f528-3d4d-4b68-bc1d-b335ad052a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:38.220395 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8f528-3d4d-4b68-bc1d-b335ad052a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:38.222043 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8f528-3d4d-4b68-bc1d-b335ad052a5c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:38.233499 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1259/2505] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:38.237832 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5c91c-e127-4e55-b929-345f53899b4f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:38.247921 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5c91c-e127-4e55-b929-345f53899b4f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:38.253333 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905e0bc-d159-4b21-8eef-54b55a7737cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:38.254034 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905e0bc-d159-4b21-8eef-54b55a7737cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:38.254313 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905e0bc-d159-4b21-8eef-54b55a7737cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:38.254583 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905e0bc-d159-4b21-8eef-54b55a7737cc admin admin] PATH_INFO: `/v3/projects/ddf36be4bbac48a9a1eb056ccdd6c044/users/5bc5b6f563d3488ebab8b6e9f49bca21/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:38.269856 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905e0bc-d159-4b21-8eef-54b55a7737cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddf36be4bbac48a9a1eb056ccdd6c044, user_id=5bc5b6f563d3488ebab8b6e9f49bca21, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:38.272563 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905e0bc-d159-4b21-8eef-54b55a7737cc admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:38.295538 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1247/2506] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:00:38 2022] PUT /identity/v3/projects/ddf36be4bbac48a9a1eb056ccdd6c044/users/5bc5b6f563d3488ebab8b6e9f49bca21/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:38.297295 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a0a41-ae68-4236-bfb7-287a7e118709 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:38.297606 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a0a41-ae68-4236-bfb7-287a7e118709 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:38.297941 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a0a41-ae68-4236-bfb7-287a7e118709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:38.326498 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-475a0a41-ae68-4236-bfb7-287a7e118709 None None] MFA Rules not processed for user `5bc5b6f563d3488ebab8b6e9f49bca21`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:38.327944 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-475a0a41-ae68-4236-bfb7-287a7e118709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:38.346452 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905e0bc-d159-4b21-8eef-54b55a7737cc admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:38.349811 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6905e0bc-d159-4b21-8eef-54b55a7737cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:38.358161 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:38.367930 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:38.429554 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1260/2507] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:38.429554 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a0a41-ae68-4236-bfb7-287a7e118709 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:38.435294 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a0a41-ae68-4236-bfb7-287a7e118709 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:38.437249 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905e0bc-d159-4b21-8eef-54b55a7737cc admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:38.439507 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484a7c0-468d-481e-bdba-7e7c6e866504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:38.440262 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484a7c0-468d-481e-bdba-7e7c6e866504 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:38.440538 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484a7c0-468d-481e-bdba-7e7c6e866504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:38.440804 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484a7c0-468d-481e-bdba-7e7c6e866504 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:38.441513 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d484a7c0-468d-481e-bdba-7e7c6e866504 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:38.442416 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a4263-b7ea-49f6-9e3a-ef8bb568daea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:38.443054 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a4263-b7ea-49f6-9e3a-ef8bb568daea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:38.443332 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a4263-b7ea-49f6-9e3a-ef8bb568daea admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:38.443504 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d484a7c0-468d-481e-bdba-7e7c6e866504 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:38.443614 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a4263-b7ea-49f6-9e3a-ef8bb568daea admin admin] PATH_INFO: `/v3/projects/9bb6aa93abcd4385b9e8a495e873fbfd` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:38.444727 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a4263-b7ea-49f6-9e3a-ef8bb568daea admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bb6aa93abcd4385b9e8a495e873fbfd)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:38.446673 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a4263-b7ea-49f6-9e3a-ef8bb568daea admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:38.472661 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1261/2508] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:00:38 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:00:38.477206 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484a7c0-468d-481e-bdba-7e7c6e866504 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:38.502958 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ed4a4263-b7ea-49f6-9e3a-ef8bb568daea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bb6aa93abcd4385b9e8a495e873fbfd', 'request_id': 'req-ed4a4263-b7ea-49f6-9e3a-ef8bb568daea'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:38.509798 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ed4a4263-b7ea-49f6-9e3a-ef8bb568daea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bb6aa93abcd4385b9e8a495e873fbfd', 'request_id': 'req-ed4a4263-b7ea-49f6-9e3a-ef8bb568daea'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:38.516295 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ed4a4263-b7ea-49f6-9e3a-ef8bb568daea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bb6aa93abcd4385b9e8a495e873fbfd', 'request_id': 'req-ed4a4263-b7ea-49f6-9e3a-ef8bb568daea'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:38.533901 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ed4a4263-b7ea-49f6-9e3a-ef8bb568daea admin admin] The token cache is being invalidate because project 9bb6aa93abcd4385b9e8a495e873fbfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:00:38.533901 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ed4a4263-b7ea-49f6-9e3a-ef8bb568daea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:38.535808 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ed4a4263-b7ea-49f6-9e3a-ef8bb568daea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:38.542016 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1248/2509] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:00:38 2022] DELETE /identity/v3/projects/9bb6aa93abcd4385b9e8a495e873fbfd => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:38.544193 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d85d0c-9cde-4321-af23-2a293bf51c7b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:38.544479 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d85d0c-9cde-4321-af23-2a293bf51c7b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:38.544750 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d85d0c-9cde-4321-af23-2a293bf51c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:38.558857 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484a7c0-468d-481e-bdba-7e7c6e866504 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:38.571448 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-31d85d0c-9cde-4321-af23-2a293bf51c7b None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:38.572676 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-31d85d0c-9cde-4321-af23-2a293bf51c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:38.624885 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ec7fa-241a-41e1-8a6c-8edd5af0422a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:38.625516 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ec7fa-241a-41e1-8a6c-8edd5af0422a admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:38.625933 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ec7fa-241a-41e1-8a6c-8edd5af0422a admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:38.626094 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ec7fa-241a-41e1-8a6c-8edd5af0422a admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:38.626719 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ec7fa-241a-41e1-8a6c-8edd5af0422a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:38.629834 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ec7fa-241a-41e1-8a6c-8edd5af0422a admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:38.637168 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1249/2510] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:38.645676 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fbb6b-c173-4b82-8a57-1b5401076549 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:38.646064 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fbb6b-c173-4b82-8a57-1b5401076549 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:38.646462 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fbb6b-c173-4b82-8a57-1b5401076549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:38.662203 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1262/2511] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:00:38 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:00:38.665052 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ec7fa-241a-41e1-8a6c-8edd5af0422a admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:38.666880 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-581ec7fa-241a-41e1-8a6c-8edd5af0422a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:38.673829 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c93fbb6b-c173-4b82-8a57-1b5401076549 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:38.675266 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c93fbb6b-c173-4b82-8a57-1b5401076549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:38.679476 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ec7fa-241a-41e1-8a6c-8edd5af0422a admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:38.684294 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1250/2512] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:38.684457 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e08547-28b0-482b-a203-9f86f7e65d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:38.685058 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e08547-28b0-482b-a203-9f86f7e65d1c admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:38.685341 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e08547-28b0-482b-a203-9f86f7e65d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:38.686252 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e08547-28b0-482b-a203-9f86f7e65d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:38.686404 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e08547-28b0-482b-a203-9f86f7e65d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:38.688049 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e08547-28b0-482b-a203-9f86f7e65d1c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:38.688831 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fbb6b-c173-4b82-8a57-1b5401076549 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:38.699246 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fbb6b-c173-4b82-8a57-1b5401076549 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:38.706149 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1263/2513] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:00:38.706706 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a3efd-a564-4286-8f69-42192715c25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:38.706706 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a3efd-a564-4286-8f69-42192715c25e admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:38.706706 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a3efd-a564-4286-8f69-42192715c25e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:38.706706 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a3efd-a564-4286-8f69-42192715c25e admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:38.707319 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e08547-28b0-482b-a203-9f86f7e65d1c admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:38.707506 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a3efd-a564-4286-8f69-42192715c25e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:00:38.708033 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a3efd-a564-4286-8f69-42192715c25e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:38.709645 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a3efd-a564-4286-8f69-42192715c25e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:38.718166 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e08547-28b0-482b-a203-9f86f7e65d1c admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:38.723644 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152d1a4-d0b9-48ab-ac32-de9464307ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:38.725938 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1251/2514] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 01:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:00:38.726098 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152d1a4-d0b9-48ab-ac32-de9464307ce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:38.726098 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152d1a4-d0b9-48ab-ac32-de9464307ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:38.726098 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152d1a4-d0b9-48ab-ac32-de9464307ce5 admin admin] PATH_INFO: `/v3/projects/aaf2ea84f781475aaf090f9d2e46b18b/users/6036c7bdd7494637a713d71955f6c326/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:38.728365 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a3efd-a564-4286-8f69-42192715c25e admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:38.752449 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a3efd-a564-4286-8f69-42192715c25e admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:38.752813 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152d1a4-d0b9-48ab-ac32-de9464307ce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaf2ea84f781475aaf090f9d2e46b18b, user_id=6036c7bdd7494637a713d71955f6c326, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:38.752813 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152d1a4-d0b9-48ab-ac32-de9464307ce5 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:38.757973 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded5042-9076-4831-853c-d00a67f5b445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:38.758611 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded5042-9076-4831-853c-d00a67f5b445 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:38.758911 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded5042-9076-4831-853c-d00a67f5b445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:38.759209 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded5042-9076-4831-853c-d00a67f5b445 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:38.759892 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded5042-9076-4831-853c-d00a67f5b445 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:38.762102 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded5042-9076-4831-853c-d00a67f5b445 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:38.769153 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1264/2515] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:00:38 2022] PUT /identity/v3/projects/aaf2ea84f781475aaf090f9d2e46b18b/users/6036c7bdd7494637a713d71955f6c326/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:00:38.770503 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152d1a4-d0b9-48ab-ac32-de9464307ce5 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:38.777772 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:38.792697 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:38.796812 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1252/2516] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:00:38 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:00:38.797993 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded5042-9076-4831-853c-d00a67f5b445 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:38.850552 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152d1a4-d0b9-48ab-ac32-de9464307ce5 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:38.880839 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded5042-9076-4831-853c-d00a67f5b445 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:38.886205 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbfbbe-1492-4fad-b741-230910cf8b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:38.886990 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbfbbe-1492-4fad-b741-230910cf8b8a admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:38.887293 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbfbbe-1492-4fad-b741-230910cf8b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:38.887587 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbfbbe-1492-4fad-b741-230910cf8b8a admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:38.888312 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcbfbbe-1492-4fad-b741-230910cf8b8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:38.890564 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcbfbbe-1492-4fad-b741-230910cf8b8a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:38.909737 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9d052-abcf-44af-9c75-2b08cb073d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:38.910374 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9d052-abcf-44af-9c75-2b08cb073d57 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:38.910649 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9d052-abcf-44af-9c75-2b08cb073d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:38.910916 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9d052-abcf-44af-9c75-2b08cb073d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:38.911545 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9d052-abcf-44af-9c75-2b08cb073d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:38.913121 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9d052-abcf-44af-9c75-2b08cb073d57 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:38.913879 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1253/2517] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:00:38 2022] POST /identity/v3/users => generated 286 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:00:38.917343 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbfbbe-1492-4fad-b741-230910cf8b8a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:38.925874 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1265/2518] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:00:38.928444 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9d052-abcf-44af-9c75-2b08cb073d57 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:38.930324 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbfbbe-1492-4fad-b741-230910cf8b8a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:38.936084 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48937eb6-a2c3-4f0d-a1c2-eead1c6b2e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:38.936838 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48937eb6-a2c3-4f0d-a1c2-eead1c6b2e2d admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:38.937162 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48937eb6-a2c3-4f0d-a1c2-eead1c6b2e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:38.937436 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48937eb6-a2c3-4f0d-a1c2-eead1c6b2e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:38.938173 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48937eb6-a2c3-4f0d-a1c2-eead1c6b2e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:38.938342 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9d052-abcf-44af-9c75-2b08cb073d57 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:38.939785 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48937eb6-a2c3-4f0d-a1c2-eead1c6b2e2d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:38.942894 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287f396-43f8-4892-adad-abbb05a3fb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:38.943527 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287f396-43f8-4892-adad-abbb05a3fb7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:38.943803 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287f396-43f8-4892-adad-abbb05a3fb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:38.944073 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287f396-43f8-4892-adad-abbb05a3fb7d admin admin] PATH_INFO: `/v3/projects/aaf2ea84f781475aaf090f9d2e46b18b/users/6036c7bdd7494637a713d71955f6c326/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:38.945979 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287f396-43f8-4892-adad-abbb05a3fb7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaf2ea84f781475aaf090f9d2e46b18b, user_id=6036c7bdd7494637a713d71955f6c326, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:38.948634 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287f396-43f8-4892-adad-abbb05a3fb7d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:38.953871 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1254/2519] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:38.955315 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48937eb6-a2c3-4f0d-a1c2-eead1c6b2e2d admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:38.959785 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1266/2520] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:00:38 2022] PUT /identity/v3/projects/aaf2ea84f781475aaf090f9d2e46b18b/users/6036c7bdd7494637a713d71955f6c326/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:00:38.967923 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48937eb6-a2c3-4f0d-a1c2-eead1c6b2e2d admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:38.971674 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41182f-f0ec-4187-a0c3-af6a35288283 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:38.972003 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41182f-f0ec-4187-a0c3-af6a35288283 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:38.972275 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41182f-f0ec-4187-a0c3-af6a35288283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:39.000690 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-da41182f-f0ec-4187-a0c3-af6a35288283 None None] MFA Rules not processed for user `6036c7bdd7494637a713d71955f6c326`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:39.001950 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-da41182f-f0ec-4187-a0c3-af6a35288283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:39.027818 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e21b81-ffcb-453b-9ed5-4d5616cfddb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:39.028425 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e21b81-ffcb-453b-9ed5-4d5616cfddb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:39.028703 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e21b81-ffcb-453b-9ed5-4d5616cfddb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:39.028974 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e21b81-ffcb-453b-9ed5-4d5616cfddb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:39.029623 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e21b81-ffcb-453b-9ed5-4d5616cfddb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:39.031339 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e21b81-ffcb-453b-9ed5-4d5616cfddb8 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:39.044449 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1255/2521] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:00:39.045687 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e21b81-ffcb-453b-9ed5-4d5616cfddb8 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:39.055302 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e21b81-ffcb-453b-9ed5-4d5616cfddb8 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:39.060468 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b740e04-d9a3-41ed-be79-56832727728b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:39.061118 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b740e04-d9a3-41ed-be79-56832727728b admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:39.061390 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b740e04-d9a3-41ed-be79-56832727728b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:39.061655 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b740e04-d9a3-41ed-be79-56832727728b admin admin] PATH_INFO: `/v3/projects/afa739fb80584c4d9e99404bd102d512/users/d9e0ee03c3d440049eb1ac9dc3fbe02d/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:39.069451 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1267/2522] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:00:39.078298 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b740e04-d9a3-41ed-be79-56832727728b admin admin] RBAC: Authorizing `identity:create_grant(project_id=afa739fb80584c4d9e99404bd102d512, user_id=d9e0ee03c3d440049eb1ac9dc3fbe02d, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:39.081042 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b740e04-d9a3-41ed-be79-56832727728b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:39.081502 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41182f-f0ec-4187-a0c3-af6a35288283 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:39.082906 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-da41182f-f0ec-4187-a0c3-af6a35288283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:39.094814 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1256/2523] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:00:39 2022] PUT /identity/v3/projects/afa739fb80584c4d9e99404bd102d512/users/d9e0ee03c3d440049eb1ac9dc3fbe02d/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:00:39.099684 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9690be-0903-42e2-85eb-52308737a174 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:39.099990 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9690be-0903-42e2-85eb-52308737a174 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:39.100245 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9690be-0903-42e2-85eb-52308737a174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:39.117081 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:39.118819 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-8c9690be-0903-42e2-85eb-52308737a174 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:39.120050 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8c9690be-0903-42e2-85eb-52308737a174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:39.141964 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41182f-f0ec-4187-a0c3-af6a35288283 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:39.163076 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:39.184518 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1257/2524] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:00:39.194302 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9690be-0903-42e2-85eb-52308737a174 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:39.195981 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8c9690be-0903-42e2-85eb-52308737a174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:39.196106 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f7b44-ee19-4138-b42a-b2a47589c172 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:39.196760 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f7b44-ee19-4138-b42a-b2a47589c172 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:39.197048 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f7b44-ee19-4138-b42a-b2a47589c172 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:39.197357 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f7b44-ee19-4138-b42a-b2a47589c172 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:39.255384 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9690be-0903-42e2-85eb-52308737a174 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:39.259267 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ca0ca-3bbb-451f-8ffd-abbe718b9df5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:39.259424 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f7b44-ee19-4138-b42a-b2a47589c172 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:39.259893 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ca0ca-3bbb-451f-8ffd-abbe718b9df5 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:39.260150 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ca0ca-3bbb-451f-8ffd-abbe718b9df5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:39.260407 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ca0ca-3bbb-451f-8ffd-abbe718b9df5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:39.260792 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f7b44-ee19-4138-b42a-b2a47589c172 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:39.270208 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ca0ca-3bbb-451f-8ffd-abbe718b9df5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:39.270580 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1268/2525] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:39 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:00:39.271690 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ca0ca-3bbb-451f-8ffd-abbe718b9df5 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:39.283020 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1258/2526] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:39.349327 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f7b44-ee19-4138-b42a-b2a47589c172 service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:39.360282 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f7b44-ee19-4138-b42a-b2a47589c172 service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:39.365171 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86085407-cb73-4e8c-b44e-3f6b73321748 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:39.365789 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86085407-cb73-4e8c-b44e-3f6b73321748 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:39.366104 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86085407-cb73-4e8c-b44e-3f6b73321748 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:39.366375 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86085407-cb73-4e8c-b44e-3f6b73321748 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:39.368428 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-86085407-cb73-4e8c-b44e-3f6b73321748 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:39.431629 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86085407-cb73-4e8c-b44e-3f6b73321748 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:39.433169 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86085407-cb73-4e8c-b44e-3f6b73321748 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:39.442768 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1269/2527] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:42.402034 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ca0ca-3bbb-451f-8ffd-abbe718b9df5 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:42.412164 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ca0ca-3bbb-451f-8ffd-abbe718b9df5 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:42.417071 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2bc67-4071-48c6-8513-5a02e71f0e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:42.417984 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2bc67-4071-48c6-8513-5a02e71f0e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:42.418321 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2bc67-4071-48c6-8513-5a02e71f0e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:42.418663 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2bc67-4071-48c6-8513-5a02e71f0e61 admin admin] PATH_INFO: `/v3/users/5bc5b6f563d3488ebab8b6e9f49bca21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:42.419912 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2bc67-4071-48c6-8513-5a02e71f0e61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bc5b6f563d3488ebab8b6e9f49bca21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:42.421903 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2bc67-4071-48c6-8513-5a02e71f0e61 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:42.484715 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f7e2bc67-4071-48c6-8513-5a02e71f0e61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bc5b6f563d3488ebab8b6e9f49bca21'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:42.500373 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f7e2bc67-4071-48c6-8513-5a02e71f0e61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bc5b6f563d3488ebab8b6e9f49bca21'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:42.509189 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f7e2bc67-4071-48c6-8513-5a02e71f0e61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bc5b6f563d3488ebab8b6e9f49bca21'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:42.520557 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f7e2bc67-4071-48c6-8513-5a02e71f0e61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bc5b6f563d3488ebab8b6e9f49bca21'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:42.521795 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f7e2bc67-4071-48c6-8513-5a02e71f0e61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bc5b6f563d3488ebab8b6e9f49bca21'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:42.541638 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158333ab-7cae-46a9-8699-3c0a36c4bae1 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:42.542279 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158333ab-7cae-46a9-8699-3c0a36c4bae1 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:42.542279 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158333ab-7cae-46a9-8699-3c0a36c4bae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:42.547651 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1259/2528] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:00:42 2022] DELETE /identity/v3/users/5bc5b6f563d3488ebab8b6e9f49bca21 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:42.570915 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-158333ab-7cae-46a9-8699-3c0a36c4bae1 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:42.573763 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-158333ab-7cae-46a9-8699-3c0a36c4bae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:42.615719 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:42.655759 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1270/2529] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:42.667758 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2bc67-4071-48c6-8513-5a02e71f0e61 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:42.669424 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f7e2bc67-4071-48c6-8513-5a02e71f0e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:42.744190 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2bc67-4071-48c6-8513-5a02e71f0e61 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:42.751855 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb50928-ed14-49f7-8e27-f1b984ecbb51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:42.752511 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb50928-ed14-49f7-8e27-f1b984ecbb51 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:42.752793 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb50928-ed14-49f7-8e27-f1b984ecbb51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:42.753067 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb50928-ed14-49f7-8e27-f1b984ecbb51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:42.772744 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb50928-ed14-49f7-8e27-f1b984ecbb51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:42.772744 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb50928-ed14-49f7-8e27-f1b984ecbb51 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:42.782572 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1260/2530] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:43.340374 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158333ab-7cae-46a9-8699-3c0a36c4bae1 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:43.344916 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-158333ab-7cae-46a9-8699-3c0a36c4bae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:43.377673 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158333ab-7cae-46a9-8699-3c0a36c4bae1 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:43.384571 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cdb64c-3fe9-4ef8-ad23-e3003dd4c34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:43.385216 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdb64c-3fe9-4ef8-ad23-e3003dd4c34a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:43.385498 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdb64c-3fe9-4ef8-ad23-e3003dd4c34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:43.385770 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdb64c-3fe9-4ef8-ad23-e3003dd4c34a admin admin] PATH_INFO: `/v3/projects/ddf36be4bbac48a9a1eb056ccdd6c044` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:43.387038 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cdb64c-3fe9-4ef8-ad23-e3003dd4c34a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddf36be4bbac48a9a1eb056ccdd6c044)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:43.390129 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cdb64c-3fe9-4ef8-ad23-e3003dd4c34a admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:43.453287 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-91cdb64c-3fe9-4ef8-ad23-e3003dd4c34a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddf36be4bbac48a9a1eb056ccdd6c044', 'request_id': 'req-91cdb64c-3fe9-4ef8-ad23-e3003dd4c34a'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:43.464257 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-91cdb64c-3fe9-4ef8-ad23-e3003dd4c34a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddf36be4bbac48a9a1eb056ccdd6c044', 'request_id': 'req-91cdb64c-3fe9-4ef8-ad23-e3003dd4c34a'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:43.473818 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-91cdb64c-3fe9-4ef8-ad23-e3003dd4c34a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddf36be4bbac48a9a1eb056ccdd6c044', 'request_id': 'req-91cdb64c-3fe9-4ef8-ad23-e3003dd4c34a'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:43.488223 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-91cdb64c-3fe9-4ef8-ad23-e3003dd4c34a admin admin] The token cache is being invalidate because project ddf36be4bbac48a9a1eb056ccdd6c044 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:00:43.488223 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-91cdb64c-3fe9-4ef8-ad23-e3003dd4c34a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:43.488749 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-91cdb64c-3fe9-4ef8-ad23-e3003dd4c34a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:43.493276 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1271/2531] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:00:43 2022] DELETE /identity/v3/projects/ddf36be4bbac48a9a1eb056ccdd6c044 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:43.494449 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb50928-ed14-49f7-8e27-f1b984ecbb51 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:43.500320 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:43.515606 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb50928-ed14-49f7-8e27-f1b984ecbb51 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:43.680177 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64d82b-b165-48d5-89fd-980be2c8f28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:43.680863 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64d82b-b165-48d5-89fd-980be2c8f28c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:43.683292 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64d82b-b165-48d5-89fd-980be2c8f28c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:43.683610 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64d82b-b165-48d5-89fd-980be2c8f28c admin admin] PATH_INFO: `/v3/users/6036c7bdd7494637a713d71955f6c326` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:43.689672 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64d82b-b165-48d5-89fd-980be2c8f28c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6036c7bdd7494637a713d71955f6c326)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:43.692387 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64d82b-b165-48d5-89fd-980be2c8f28c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:43.821164 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4e64d82b-b165-48d5-89fd-980be2c8f28c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6036c7bdd7494637a713d71955f6c326'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:43.850031 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4e64d82b-b165-48d5-89fd-980be2c8f28c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6036c7bdd7494637a713d71955f6c326'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:43.869133 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4e64d82b-b165-48d5-89fd-980be2c8f28c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6036c7bdd7494637a713d71955f6c326'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:43.885531 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4e64d82b-b165-48d5-89fd-980be2c8f28c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6036c7bdd7494637a713d71955f6c326'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:43.886591 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4e64d82b-b165-48d5-89fd-980be2c8f28c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6036c7bdd7494637a713d71955f6c326'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:43.900781 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1261/2532] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:00:43 2022] DELETE /identity/v3/users/6036c7bdd7494637a713d71955f6c326 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:44.403300 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cdb64c-3fe9-4ef8-ad23-e3003dd4c34a admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:44.406910 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-91cdb64c-3fe9-4ef8-ad23-e3003dd4c34a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:44.442545 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cdb64c-3fe9-4ef8-ad23-e3003dd4c34a admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:44.633094 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7207fac-010d-436b-8d06-45993b03ae38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:44.633761 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7207fac-010d-436b-8d06-45993b03ae38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:44.634070 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7207fac-010d-436b-8d06-45993b03ae38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:44.634344 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7207fac-010d-436b-8d06-45993b03ae38 admin admin] PATH_INFO: `/v3/projects/aaf2ea84f781475aaf090f9d2e46b18b` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:44.636942 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7207fac-010d-436b-8d06-45993b03ae38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaf2ea84f781475aaf090f9d2e46b18b)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:44.638950 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7207fac-010d-436b-8d06-45993b03ae38 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:44.760669 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f7207fac-010d-436b-8d06-45993b03ae38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaf2ea84f781475aaf090f9d2e46b18b', 'request_id': 'req-f7207fac-010d-436b-8d06-45993b03ae38'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:44.781129 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f7207fac-010d-436b-8d06-45993b03ae38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaf2ea84f781475aaf090f9d2e46b18b', 'request_id': 'req-f7207fac-010d-436b-8d06-45993b03ae38'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:44.790511 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f7207fac-010d-436b-8d06-45993b03ae38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaf2ea84f781475aaf090f9d2e46b18b', 'request_id': 'req-f7207fac-010d-436b-8d06-45993b03ae38'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:44.794265 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:44.820131 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f7207fac-010d-436b-8d06-45993b03ae38 admin admin] The token cache is being invalidate because project aaf2ea84f781475aaf090f9d2e46b18b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:00:44.820432 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f7207fac-010d-436b-8d06-45993b03ae38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:44.821101 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f7207fac-010d-436b-8d06-45993b03ae38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:44.822676 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1272/2533] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:00:44 2022] DELETE /identity/v3/projects/aaf2ea84f781475aaf090f9d2e46b18b => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:44.827797 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6782be-043c-44d7-a114-a0075193e8a8 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:44.828292 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6782be-043c-44d7-a114-a0075193e8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:44.828400 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6782be-043c-44d7-a114-a0075193e8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:44.857939 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-1a6782be-043c-44d7-a114-a0075193e8a8 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:44.859266 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1a6782be-043c-44d7-a114-a0075193e8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:44.939243 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1262/2534] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:44.947370 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e0b88-6930-47d5-961e-de6638ead971 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:44.947657 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e0b88-6930-47d5-961e-de6638ead971 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:44.947930 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e0b88-6930-47d5-961e-de6638ead971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:44.977164 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-149e0b88-6930-47d5-961e-de6638ead971 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:44.978639 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-149e0b88-6930-47d5-961e-de6638ead971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:44.991326 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1273/2535] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:44.992047 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6782be-043c-44d7-a114-a0075193e8a8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:45.003036 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6782be-043c-44d7-a114-a0075193e8a8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:45.007879 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b3ac9-2836-43e3-8730-9b7d6980fe1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:45.008743 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b3ac9-2836-43e3-8730-9b7d6980fe1c admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:45.009192 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b3ac9-2836-43e3-8730-9b7d6980fe1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:45.009468 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b3ac9-2836-43e3-8730-9b7d6980fe1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:45.010177 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b3ac9-2836-43e3-8730-9b7d6980fe1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:00:45.010511 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b3ac9-2836-43e3-8730-9b7d6980fe1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:45.012675 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b3ac9-2836-43e3-8730-9b7d6980fe1c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:45.029291 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1263/2536] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 01:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:00:45.031033 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e0b88-6930-47d5-961e-de6638ead971 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:45.047293 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e0b88-6930-47d5-961e-de6638ead971 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:45.057411 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c323a0-60df-49d0-8e3b-bba4cd365948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:45.058187 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c323a0-60df-49d0-8e3b-bba4cd365948 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:45.058448 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c323a0-60df-49d0-8e3b-bba4cd365948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:45.058723 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c323a0-60df-49d0-8e3b-bba4cd365948 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:45.059372 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c323a0-60df-49d0-8e3b-bba4cd365948 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:45.061370 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c323a0-60df-49d0-8e3b-bba4cd365948 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:45.119138 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1274/2537] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:00:45 2022] POST /identity/v3/projects => generated 385 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:00:45.119611 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b3ac9-2836-43e3-8730-9b7d6980fe1c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:45.135589 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b3ac9-2836-43e3-8730-9b7d6980fe1c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:45.146423 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:45.299806 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6553e-f8f3-4ee6-9665-238056f9c4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:45.300722 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6553e-f8f3-4ee6-9665-238056f9c4ba admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:45.300722 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6553e-f8f3-4ee6-9665-238056f9c4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:45.301037 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6553e-f8f3-4ee6-9665-238056f9c4ba admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:45.301694 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6553e-f8f3-4ee6-9665-238056f9c4ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:45.303941 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6553e-f8f3-4ee6-9665-238056f9c4ba admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:45.357604 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1264/2538] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:00:45 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:00:45.359172 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c323a0-60df-49d0-8e3b-bba4cd365948 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:45.378752 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c323a0-60df-49d0-8e3b-bba4cd365948 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:45.385309 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf9a27-fef9-4144-ad43-7bf2a163dcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:45.386026 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf9a27-fef9-4144-ad43-7bf2a163dcff admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:45.386673 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf9a27-fef9-4144-ad43-7bf2a163dcff admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:45.387007 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf9a27-fef9-4144-ad43-7bf2a163dcff admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:45.388263 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf9a27-fef9-4144-ad43-7bf2a163dcff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:45.390481 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf9a27-fef9-4144-ad43-7bf2a163dcff admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:45.404417 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1275/2539] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:45.406047 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6553e-f8f3-4ee6-9665-238056f9c4ba admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:45.416863 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6553e-f8f3-4ee6-9665-238056f9c4ba admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:45.423244 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45cd2c-f640-443c-89b9-a055905eac22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:45.424023 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45cd2c-f640-443c-89b9-a055905eac22 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:45.424323 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45cd2c-f640-443c-89b9-a055905eac22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:45.424601 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45cd2c-f640-443c-89b9-a055905eac22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:45.425598 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45cd2c-f640-443c-89b9-a055905eac22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:45.427352 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45cd2c-f640-443c-89b9-a055905eac22 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:45.445506 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1265/2540] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:45.449373 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf9a27-fef9-4144-ad43-7bf2a163dcff admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:45.460258 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf9a27-fef9-4144-ad43-7bf2a163dcff admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:45.465971 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e02eef-0201-457d-b7db-c15070421d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:45.466583 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e02eef-0201-457d-b7db-c15070421d42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:45.466879 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e02eef-0201-457d-b7db-c15070421d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:45.467182 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e02eef-0201-457d-b7db-c15070421d42 admin admin] PATH_INFO: `/v3/projects/e03e735a49d648c388cec8d2a23ac2d9/users/60781deff5f2499db041924efc5e6965/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:45.495382 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e02eef-0201-457d-b7db-c15070421d42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e03e735a49d648c388cec8d2a23ac2d9, user_id=60781deff5f2499db041924efc5e6965, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:45.505215 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e02eef-0201-457d-b7db-c15070421d42 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:45.537569 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1276/2541] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:00:45 2022] PUT /identity/v3/projects/e03e735a49d648c388cec8d2a23ac2d9/users/60781deff5f2499db041924efc5e6965/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:45.541939 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bab4d-a3d1-42d3-973f-5a04b2c414ed None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:45.541939 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bab4d-a3d1-42d3-973f-5a04b2c414ed None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:45.541939 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bab4d-a3d1-42d3-973f-5a04b2c414ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:45.584708 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-224bab4d-a3d1-42d3-973f-5a04b2c414ed None None] MFA Rules not processed for user `60781deff5f2499db041924efc5e6965`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:45.589867 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-224bab4d-a3d1-42d3-973f-5a04b2c414ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:45.719160 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee38082-ccd1-4d89-b882-df3595344b2a None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:45.719775 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee38082-ccd1-4d89-b882-df3595344b2a None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:45.720298 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee38082-ccd1-4d89-b882-df3595344b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:45.736211 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1266/2542] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:00:45.740677 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224bab4d-a3d1-42d3-973f-5a04b2c414ed None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:45.774262 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-6ee38082-ccd1-4d89-b882-df3595344b2a None None] MFA Rules not processed for user `d9e0ee03c3d440049eb1ac9dc3fbe02d`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:45.775586 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6ee38082-ccd1-4d89-b882-df3595344b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:45.815108 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224bab4d-a3d1-42d3-973f-5a04b2c414ed None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:45.823835 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725c0fe-e01d-470c-9af8-c226a35339db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:45.824505 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725c0fe-e01d-470c-9af8-c226a35339db admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:45.824822 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725c0fe-e01d-470c-9af8-c226a35339db admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:45.825633 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725c0fe-e01d-470c-9af8-c226a35339db admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:45.825751 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725c0fe-e01d-470c-9af8-c226a35339db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:45.828321 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725c0fe-e01d-470c-9af8-c226a35339db admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:45.854003 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1277/2543] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:45.865593 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee38082-ccd1-4d89-b882-df3595344b2a None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:45.867222 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6ee38082-ccd1-4d89-b882-df3595344b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:45.871987 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1267/2544] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:00:45 2022] POST /identity/v3/projects => generated 387 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:00:45.876455 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725c0fe-e01d-470c-9af8-c226a35339db admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:45.881168 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:45.892381 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee38082-ccd1-4d89-b882-df3595344b2a None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:45.944820 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725c0fe-e01d-470c-9af8-c226a35339db admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:45.949321 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b675984-33b5-4e2d-96ea-21d38c6aa406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:45.949863 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c13861-6268-4ebf-8f38-c33a2da177b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:45.950528 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c13861-6268-4ebf-8f38-c33a2da177b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:45.950641 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b675984-33b5-4e2d-96ea-21d38c6aa406 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:45.950831 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c13861-6268-4ebf-8f38-c33a2da177b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:45.950935 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b675984-33b5-4e2d-96ea-21d38c6aa406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:45.951088 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b675984-33b5-4e2d-96ea-21d38c6aa406 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:45.951195 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c13861-6268-4ebf-8f38-c33a2da177b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:45.951708 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c13861-6268-4ebf-8f38-c33a2da177b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:45.951819 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b675984-33b5-4e2d-96ea-21d38c6aa406 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:45.953680 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c13861-6268-4ebf-8f38-c33a2da177b0 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:45.953797 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b675984-33b5-4e2d-96ea-21d38c6aa406 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:45.977146 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1268/2545] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:00:45 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:00:45.980098 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:45.982350 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c13861-6268-4ebf-8f38-c33a2da177b0 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:45.990606 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1278/2546] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:00:45 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:00:45.994320 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c13861-6268-4ebf-8f38-c33a2da177b0 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:45.994687 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b675984-33b5-4e2d-96ea-21d38c6aa406 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:46.058903 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea85a39-1c90-47ee-996f-31cee1abf519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:46.059463 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea85a39-1c90-47ee-996f-31cee1abf519 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:46.059793 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea85a39-1c90-47ee-996f-31cee1abf519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:46.060064 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea85a39-1c90-47ee-996f-31cee1abf519 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:46.060761 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea85a39-1c90-47ee-996f-31cee1abf519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:46.062859 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea85a39-1c90-47ee-996f-31cee1abf519 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:46.063857 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b675984-33b5-4e2d-96ea-21d38c6aa406 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:46.069812 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22bff2-8164-42c1-bb7a-55317f5524f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:46.070559 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22bff2-8164-42c1-bb7a-55317f5524f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:46.070975 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22bff2-8164-42c1-bb7a-55317f5524f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:46.071325 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22bff2-8164-42c1-bb7a-55317f5524f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:46.072147 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22bff2-8164-42c1-bb7a-55317f5524f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:46.074609 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22bff2-8164-42c1-bb7a-55317f5524f9 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:46.078786 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1269/2547] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:46.079826 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea85a39-1c90-47ee-996f-31cee1abf519 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:46.091675 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea85a39-1c90-47ee-996f-31cee1abf519 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:46.098353 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71dea5-0034-4ed4-a197-28680f62551b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:46.099021 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71dea5-0034-4ed4-a197-28680f62551b admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:46.099296 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71dea5-0034-4ed4-a197-28680f62551b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:46.102935 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71dea5-0034-4ed4-a197-28680f62551b admin admin] PATH_INFO: `/v3/projects/81a85cf93b4f4f2c97f0a8f2527d549b/users/27022729a7cb413cac5bcd021db7a995/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:46.103065 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1279/2548] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:00:45 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:00:46.103643 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22bff2-8164-42c1-bb7a-55317f5524f9 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:46.114396 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22bff2-8164-42c1-bb7a-55317f5524f9 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:46.118124 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71dea5-0034-4ed4-a197-28680f62551b admin admin] RBAC: Authorizing `identity:create_grant(project_id=81a85cf93b4f4f2c97f0a8f2527d549b, user_id=27022729a7cb413cac5bcd021db7a995, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:46.120901 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779c519-50a6-4150-a869-9e1b476a141b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:46.121084 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71dea5-0034-4ed4-a197-28680f62551b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:46.121834 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779c519-50a6-4150-a869-9e1b476a141b admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:46.122227 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779c519-50a6-4150-a869-9e1b476a141b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:46.122505 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779c519-50a6-4150-a869-9e1b476a141b admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:46.123162 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779c519-50a6-4150-a869-9e1b476a141b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:46.125986 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779c519-50a6-4150-a869-9e1b476a141b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:46.136288 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1270/2549] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:00:46 2022] PUT /identity/v3/projects/81a85cf93b4f4f2c97f0a8f2527d549b/users/27022729a7cb413cac5bcd021db7a995/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:00:46.140092 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1280/2550] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:46.142986 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71dea5-0034-4ed4-a197-28680f62551b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:46.144434 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779c519-50a6-4150-a869-9e1b476a141b admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:46.155073 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779c519-50a6-4150-a869-9e1b476a141b admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:46.208567 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71dea5-0034-4ed4-a197-28680f62551b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:46.213322 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d68d4c-308c-496e-8bda-919a8af6aa1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:46.213956 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d68d4c-308c-496e-8bda-919a8af6aa1b admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:46.214230 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d68d4c-308c-496e-8bda-919a8af6aa1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:46.214527 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d68d4c-308c-496e-8bda-919a8af6aa1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:46.215258 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d68d4c-308c-496e-8bda-919a8af6aa1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:46.216819 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e760d-90b0-474f-bf5a-575614b1d92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:46.216975 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d68d4c-308c-496e-8bda-919a8af6aa1b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:46.217606 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e760d-90b0-474f-bf5a-575614b1d92c admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:46.218008 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e760d-90b0-474f-bf5a-575614b1d92c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:46.218349 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e760d-90b0-474f-bf5a-575614b1d92c admin admin] PATH_INFO: `/v3/projects/615b66d24e4f4b3bad86b1a09ad625ad/users/352335baa500425399e907313dba6209/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:46.223067 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:46.228147 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1271/2551] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:46.232729 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d68d4c-308c-496e-8bda-919a8af6aa1b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:46.234250 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e760d-90b0-474f-bf5a-575614b1d92c admin admin] RBAC: Authorizing `identity:create_grant(project_id=615b66d24e4f4b3bad86b1a09ad625ad, user_id=352335baa500425399e907313dba6209, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:46.237235 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e760d-90b0-474f-bf5a-575614b1d92c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:46.243811 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d68d4c-308c-496e-8bda-919a8af6aa1b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:46.248854 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a40105-2cf7-4194-8bf9-10adabd7af2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:46.249711 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a40105-2cf7-4194-8bf9-10adabd7af2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:46.249831 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a40105-2cf7-4194-8bf9-10adabd7af2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:46.250067 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a40105-2cf7-4194-8bf9-10adabd7af2d admin admin] PATH_INFO: `/v3/projects/81a85cf93b4f4f2c97f0a8f2527d549b/users/27022729a7cb413cac5bcd021db7a995/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:46.251980 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a40105-2cf7-4194-8bf9-10adabd7af2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=81a85cf93b4f4f2c97f0a8f2527d549b, user_id=27022729a7cb413cac5bcd021db7a995, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:46.255096 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1281/2552] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:00:46 2022] PUT /identity/v3/projects/615b66d24e4f4b3bad86b1a09ad625ad/users/352335baa500425399e907313dba6209/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:00:46.255321 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a40105-2cf7-4194-8bf9-10adabd7af2d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:46.259961 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e760d-90b0-474f-bf5a-575614b1d92c admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:46.271109 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1272/2553] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:00:46 2022] PUT /identity/v3/projects/81a85cf93b4f4f2c97f0a8f2527d549b/users/27022729a7cb413cac5bcd021db7a995/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:00:46.286610 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b24002-fef4-4a22-9bf3-339f6f169fe9 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:46.287125 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b24002-fef4-4a22-9bf3-339f6f169fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:46.287405 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b24002-fef4-4a22-9bf3-339f6f169fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:46.315451 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-95b24002-fef4-4a22-9bf3-339f6f169fe9 None None] MFA Rules not processed for user `27022729a7cb413cac5bcd021db7a995`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:46.316686 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-95b24002-fef4-4a22-9bf3-339f6f169fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:46.326151 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e760d-90b0-474f-bf5a-575614b1d92c admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:46.331108 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:46.392153 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1273/2554] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:46 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:00:46.404510 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b24002-fef4-4a22-9bf3-339f6f169fe9 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:46.406113 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-95b24002-fef4-4a22-9bf3-339f6f169fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:46.475932 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b24002-fef4-4a22-9bf3-339f6f169fe9 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:46.481770 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d49a64-dc7d-42ca-80c7-2a7adaa520ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:46.482436 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d49a64-dc7d-42ca-80c7-2a7adaa520ce service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:46.482711 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d49a64-dc7d-42ca-80c7-2a7adaa520ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:46.482983 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d49a64-dc7d-42ca-80c7-2a7adaa520ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:46.493679 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d49a64-dc7d-42ca-80c7-2a7adaa520ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:46.495158 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d49a64-dc7d-42ca-80c7-2a7adaa520ce service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:46.505808 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1274/2555] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:46 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:46.518263 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876488a-16bf-41bb-a0ab-93d2844c3754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:46.518883 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876488a-16bf-41bb-a0ab-93d2844c3754 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:46.519160 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876488a-16bf-41bb-a0ab-93d2844c3754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:46.519430 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876488a-16bf-41bb-a0ab-93d2844c3754 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:46.520080 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876488a-16bf-41bb-a0ab-93d2844c3754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:46.521673 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876488a-16bf-41bb-a0ab-93d2844c3754 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:46.542046 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1282/2556] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:46.542215 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d49a64-dc7d-42ca-80c7-2a7adaa520ce service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:46.553300 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d49a64-dc7d-42ca-80c7-2a7adaa520ce service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:46.562449 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ba5bc-487f-4d90-a49a-0b0ecb4ddebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:46.563119 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ba5bc-487f-4d90-a49a-0b0ecb4ddebc admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:46.563526 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ba5bc-487f-4d90-a49a-0b0ecb4ddebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:46.563796 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ba5bc-487f-4d90-a49a-0b0ecb4ddebc admin admin] PATH_INFO: `/v3/projects/615b66d24e4f4b3bad86b1a09ad625ad/users/352335baa500425399e907313dba6209/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:46.565829 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ba5bc-487f-4d90-a49a-0b0ecb4ddebc admin admin] RBAC: Authorizing `identity:create_grant(project_id=615b66d24e4f4b3bad86b1a09ad625ad, user_id=352335baa500425399e907313dba6209, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:46.568674 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ba5bc-487f-4d90-a49a-0b0ecb4ddebc admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:46.578905 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876488a-16bf-41bb-a0ab-93d2844c3754 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:46.583624 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1275/2557] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:00:46 2022] PUT /identity/v3/projects/615b66d24e4f4b3bad86b1a09ad625ad/users/352335baa500425399e907313dba6209/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:46.593986 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876488a-16bf-41bb-a0ab-93d2844c3754 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:46.657503 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597a436-08ac-4606-b3e9-350ee1a107c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:46.658182 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597a436-08ac-4606-b3e9-350ee1a107c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:46.658592 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597a436-08ac-4606-b3e9-350ee1a107c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:46.659019 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597a436-08ac-4606-b3e9-350ee1a107c6 admin admin] PATH_INFO: `/v3/users/60781deff5f2499db041924efc5e6965` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:46.660445 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597a436-08ac-4606-b3e9-350ee1a107c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60781deff5f2499db041924efc5e6965)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:46.662575 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597a436-08ac-4606-b3e9-350ee1a107c6 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:46.725293 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-4597a436-08ac-4606-b3e9-350ee1a107c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60781deff5f2499db041924efc5e6965'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:46.735978 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-4597a436-08ac-4606-b3e9-350ee1a107c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60781deff5f2499db041924efc5e6965'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:46.747370 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ba5bc-487f-4d90-a49a-0b0ecb4ddebc admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:46.749648 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-df7ba5bc-487f-4d90-a49a-0b0ecb4ddebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:46.750364 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-4597a436-08ac-4606-b3e9-350ee1a107c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60781deff5f2499db041924efc5e6965'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:46.768316 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ba5bc-487f-4d90-a49a-0b0ecb4ddebc admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:46.773452 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-4597a436-08ac-4606-b3e9-350ee1a107c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60781deff5f2499db041924efc5e6965'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:46.774450 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-4597a436-08ac-4606-b3e9-350ee1a107c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60781deff5f2499db041924efc5e6965'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:46.778476 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78822830-f311-4389-80e2-b030994b03d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:46.780414 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78822830-f311-4389-80e2-b030994b03d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:46.780778 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78822830-f311-4389-80e2-b030994b03d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:46.781420 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78822830-f311-4389-80e2-b030994b03d5 admin admin] PATH_INFO: `/v3/users/d69d7efad20a4f90a211070681e91e5f` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:46.782455 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1283/2558] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:00:46 2022] DELETE /identity/v3/users/60781deff5f2499db041924efc5e6965 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:46.783477 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78822830-f311-4389-80e2-b030994b03d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d69d7efad20a4f90a211070681e91e5f)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:46.786493 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78822830-f311-4389-80e2-b030994b03d5 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:46.787688 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a88fe-1807-4e42-9158-385ce5bfc80b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:46.788148 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a88fe-1807-4e42-9158-385ce5bfc80b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:46.788585 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a88fe-1807-4e42-9158-385ce5bfc80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:46.813457 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-543a88fe-1807-4e42-9158-385ce5bfc80b None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:46.815680 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-543a88fe-1807-4e42-9158-385ce5bfc80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:46.843507 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:46.869397 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-78822830-f311-4389-80e2-b030994b03d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd69d7efad20a4f90a211070681e91e5f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:46.883743 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:46.896793 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-78822830-f311-4389-80e2-b030994b03d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd69d7efad20a4f90a211070681e91e5f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:46.904251 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1284/2559] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:00:46.919314 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a88fe-1807-4e42-9158-385ce5bfc80b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:46.921230 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-543a88fe-1807-4e42-9158-385ce5bfc80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:46.926420 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-78822830-f311-4389-80e2-b030994b03d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd69d7efad20a4f90a211070681e91e5f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:46.944870 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-78822830-f311-4389-80e2-b030994b03d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd69d7efad20a4f90a211070681e91e5f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:46.945489 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-78822830-f311-4389-80e2-b030994b03d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd69d7efad20a4f90a211070681e91e5f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:46.960721 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1276/2560] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:00:46 2022] DELETE /identity/v3/users/d69d7efad20a4f90a211070681e91e5f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:46.965312 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42ef4b-3f02-4ae6-afac-a94b8614492a None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:46.965627 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42ef4b-3f02-4ae6-afac-a94b8614492a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:46.965897 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42ef4b-3f02-4ae6-afac-a94b8614492a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:47.027084 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-4b42ef4b-3f02-4ae6-afac-a94b8614492a None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:47.028339 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4b42ef4b-3f02-4ae6-afac-a94b8614492a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:47.034148 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a88fe-1807-4e42-9158-385ce5bfc80b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:47.115880 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c68394-ab95-415f-a82a-25ab89e901eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:47.119246 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c68394-ab95-415f-a82a-25ab89e901eb service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:47.119526 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c68394-ab95-415f-a82a-25ab89e901eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:47.121676 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c68394-ab95-415f-a82a-25ab89e901eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:47.125476 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-10c68394-ab95-415f-a82a-25ab89e901eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:47.153581 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1277/2561] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:47.173024 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42ef4b-3f02-4ae6-afac-a94b8614492a None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:47.175150 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4b42ef4b-3f02-4ae6-afac-a94b8614492a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:47.214188 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42ef4b-3f02-4ae6-afac-a94b8614492a None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:47.226791 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c68394-ab95-415f-a82a-25ab89e901eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:47.228671 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c68394-ab95-415f-a82a-25ab89e901eb service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:47.234726 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f050f-5c21-4692-af01-d4c4cdbf45e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:47.235489 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f050f-5c21-4692-af01-d4c4cdbf45e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:47.235776 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f050f-5c21-4692-af01-d4c4cdbf45e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:47.236097 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f050f-5c21-4692-af01-d4c4cdbf45e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:47.251171 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f050f-5c21-4692-af01-d4c4cdbf45e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:47.253422 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f050f-5c21-4692-af01-d4c4cdbf45e5 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:47.255394 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1285/2562] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:47.281585 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1278/2563] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:47.905738 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c68394-ab95-415f-a82a-25ab89e901eb service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:47.908002 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-10c68394-ab95-415f-a82a-25ab89e901eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:47.930575 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c68394-ab95-415f-a82a-25ab89e901eb service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:47.940878 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8d686-478b-4a36-bc45-2303c483b0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:47.942393 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8d686-478b-4a36-bc45-2303c483b0e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:47.943030 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8d686-478b-4a36-bc45-2303c483b0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:47.943183 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f050f-5c21-4692-af01-d4c4cdbf45e5 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:47.944688 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d63f050f-5c21-4692-af01-d4c4cdbf45e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:47.944964 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8d686-478b-4a36-bc45-2303c483b0e4 admin admin] PATH_INFO: `/v3/projects/fa7cc3f9ff7c4ade88190850f8d8d8bf` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:47.947127 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f8d686-478b-4a36-bc45-2303c483b0e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa7cc3f9ff7c4ade88190850f8d8d8bf)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:47.950542 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f8d686-478b-4a36-bc45-2303c483b0e4 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:47.970294 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f050f-5c21-4692-af01-d4c4cdbf45e5 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:47.982871 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89824eb1-c0b8-440e-ab02-68b5f9969eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:47.984080 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89824eb1-c0b8-440e-ab02-68b5f9969eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:47.984861 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89824eb1-c0b8-440e-ab02-68b5f9969eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:47.985502 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89824eb1-c0b8-440e-ab02-68b5f9969eef admin admin] PATH_INFO: `/v3/projects/e03e735a49d648c388cec8d2a23ac2d9` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:47.991913 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89824eb1-c0b8-440e-ab02-68b5f9969eef admin admin] RBAC: Authorizing `identity:delete_project(project_id=e03e735a49d648c388cec8d2a23ac2d9)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:47.994650 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89824eb1-c0b8-440e-ab02-68b5f9969eef admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:48.001725 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:48.042790 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-29f8d686-478b-4a36-bc45-2303c483b0e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa7cc3f9ff7c4ade88190850f8d8d8bf', 'request_id': 'req-29f8d686-478b-4a36-bc45-2303c483b0e4'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:48.054383 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-29f8d686-478b-4a36-bc45-2303c483b0e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa7cc3f9ff7c4ade88190850f8d8d8bf', 'request_id': 'req-29f8d686-478b-4a36-bc45-2303c483b0e4'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:48.081957 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-29f8d686-478b-4a36-bc45-2303c483b0e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa7cc3f9ff7c4ade88190850f8d8d8bf', 'request_id': 'req-29f8d686-478b-4a36-bc45-2303c483b0e4'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:48.108514 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-29f8d686-478b-4a36-bc45-2303c483b0e4 admin admin] The token cache is being invalidate because project fa7cc3f9ff7c4ade88190850f8d8d8bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:00:48.108514 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-29f8d686-478b-4a36-bc45-2303c483b0e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:48.108514 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-29f8d686-478b-4a36-bc45-2303c483b0e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:48.111586 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1286/2564] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:00:47 2022] DELETE /identity/v3/projects/fa7cc3f9ff7c4ade88190850f8d8d8bf => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:00:48.117166 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a1d78-7854-4dca-8ed8-b3495cc21e24 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:48.117449 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a1d78-7854-4dca-8ed8-b3495cc21e24 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:48.117721 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a1d78-7854-4dca-8ed8-b3495cc21e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:48.118899 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-89824eb1-c0b8-440e-ab02-68b5f9969eef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e03e735a49d648c388cec8d2a23ac2d9', 'request_id': 'req-89824eb1-c0b8-440e-ab02-68b5f9969eef'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:48.126640 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-89824eb1-c0b8-440e-ab02-68b5f9969eef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e03e735a49d648c388cec8d2a23ac2d9', 'request_id': 'req-89824eb1-c0b8-440e-ab02-68b5f9969eef'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:48.134065 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-89824eb1-c0b8-440e-ab02-68b5f9969eef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e03e735a49d648c388cec8d2a23ac2d9', 'request_id': 'req-89824eb1-c0b8-440e-ab02-68b5f9969eef'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:48.155884 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-984a1d78-7854-4dca-8ed8-b3495cc21e24 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:48.158737 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-984a1d78-7854-4dca-8ed8-b3495cc21e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:48.170265 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-89824eb1-c0b8-440e-ab02-68b5f9969eef admin admin] The token cache is being invalidate because project e03e735a49d648c388cec8d2a23ac2d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:00:48.170265 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-89824eb1-c0b8-440e-ab02-68b5f9969eef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:48.170265 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-89824eb1-c0b8-440e-ab02-68b5f9969eef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:48.172623 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1279/2565] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:00:47 2022] DELETE /identity/v3/projects/e03e735a49d648c388cec8d2a23ac2d9 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:48.176412 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89824eb1-c0b8-440e-ab02-68b5f9969eef admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:48.180690 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-89824eb1-c0b8-440e-ab02-68b5f9969eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:48.263473 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1287/2566] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:00:48.271440 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d3f44-5a2c-4f19-8e43-ac5cdf483e97 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:48.272444 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d3f44-5a2c-4f19-8e43-ac5cdf483e97 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:48.272840 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d3f44-5a2c-4f19-8e43-ac5cdf483e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:48.288614 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:48.330649 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-ec9d3f44-5a2c-4f19-8e43-ac5cdf483e97 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:48.333669 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ec9d3f44-5a2c-4f19-8e43-ac5cdf483e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:48.348623 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89824eb1-c0b8-440e-ab02-68b5f9969eef admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:48.364370 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d5594-72bc-4336-bbfa-76288e96176e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:48.364600 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1288/2567] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:00:48.364709 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d5594-72bc-4336-bbfa-76288e96176e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:48.364709 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d5594-72bc-4336-bbfa-76288e96176e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:48.364709 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d5594-72bc-4336-bbfa-76288e96176e admin admin] PATH_INFO: `/v3/users/27022729a7cb413cac5bcd021db7a995` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:48.366922 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d3f44-5a2c-4f19-8e43-ac5cdf483e97 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:48.370488 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d5594-72bc-4336-bbfa-76288e96176e admin admin] RBAC: Authorizing `identity:delete_user(user_id=27022729a7cb413cac5bcd021db7a995)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:48.372917 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d5594-72bc-4336-bbfa-76288e96176e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:48.389223 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d3f44-5a2c-4f19-8e43-ac5cdf483e97 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:48.406210 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad97d81-a459-4aa1-9577-006b47b9805d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:48.406934 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad97d81-a459-4aa1-9577-006b47b9805d admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:48.407272 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad97d81-a459-4aa1-9577-006b47b9805d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:48.407640 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad97d81-a459-4aa1-9577-006b47b9805d admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:48.408508 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad97d81-a459-4aa1-9577-006b47b9805d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:00:48.408878 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad97d81-a459-4aa1-9577-006b47b9805d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:48.411763 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad97d81-a459-4aa1-9577-006b47b9805d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:48.437102 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1289/2568] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 01:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:00:48.441426 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad97d81-a459-4aa1-9577-006b47b9805d admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:48.444480 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-0ad97d81-a459-4aa1-9577-006b47b9805d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:48.464924 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-198d5594-72bc-4336-bbfa-76288e96176e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27022729a7cb413cac5bcd021db7a995'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:48.484520 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-198d5594-72bc-4336-bbfa-76288e96176e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27022729a7cb413cac5bcd021db7a995'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:48.494283 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-198d5594-72bc-4336-bbfa-76288e96176e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27022729a7cb413cac5bcd021db7a995'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:48.505485 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-198d5594-72bc-4336-bbfa-76288e96176e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27022729a7cb413cac5bcd021db7a995'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:48.506408 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-198d5594-72bc-4336-bbfa-76288e96176e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27022729a7cb413cac5bcd021db7a995'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:48.517911 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1280/2569] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:00:48 2022] DELETE /identity/v3/users/27022729a7cb413cac5bcd021db7a995 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:48.518837 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d5594-72bc-4336-bbfa-76288e96176e admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:48.520262 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-198d5594-72bc-4336-bbfa-76288e96176e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:48.534820 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad97d81-a459-4aa1-9577-006b47b9805d admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:48.624620 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d5594-72bc-4336-bbfa-76288e96176e admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:48.630856 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec00d5-d0fd-4b8c-8645-8a9d85bdf605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:48.631534 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec00d5-d0fd-4b8c-8645-8a9d85bdf605 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:48.632339 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec00d5-d0fd-4b8c-8645-8a9d85bdf605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:48.632722 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec00d5-d0fd-4b8c-8645-8a9d85bdf605 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:48.633952 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec00d5-d0fd-4b8c-8645-8a9d85bdf605 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:48.636136 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec00d5-d0fd-4b8c-8645-8a9d85bdf605 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:48.647543 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342971d-a91c-43e4-ae24-060c6ab542e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:48.648225 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342971d-a91c-43e4-ae24-060c6ab542e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:48.648542 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342971d-a91c-43e4-ae24-060c6ab542e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:48.648851 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342971d-a91c-43e4-ae24-060c6ab542e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:48.657267 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1342971d-a91c-43e4-ae24-060c6ab542e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:48.680402 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:48.691045 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342971d-a91c-43e4-ae24-060c6ab542e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:48.692467 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342971d-a91c-43e4-ae24-060c6ab542e8 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:48.694633 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1281/2570] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:00:48 2022] POST /identity/v3/projects => generated 403 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:00:48.699440 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec00d5-d0fd-4b8c-8645-8a9d85bdf605 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:48.721548 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1290/2571] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:48.774743 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:48.791926 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec00d5-d0fd-4b8c-8645-8a9d85bdf605 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:48.798598 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90e960-2b84-4eb8-a804-577834dd0a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:48.799269 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90e960-2b84-4eb8-a804-577834dd0a3f admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:48.799609 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90e960-2b84-4eb8-a804-577834dd0a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:48.799882 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90e960-2b84-4eb8-a804-577834dd0a3f admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:48.800527 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c90e960-2b84-4eb8-a804-577834dd0a3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:48.802821 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c90e960-2b84-4eb8-a804-577834dd0a3f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:48.840795 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1282/2572] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:00:48 2022] POST /identity/v3/users => generated 302 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:00:48.842051 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342971d-a91c-43e4-ae24-060c6ab542e8 service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:48.856575 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342971d-a91c-43e4-ae24-060c6ab542e8 service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:48.863628 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673280ff-b0fc-4472-995b-fffe56dc3612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:48.864263 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673280ff-b0fc-4472-995b-fffe56dc3612 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:48.864693 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673280ff-b0fc-4472-995b-fffe56dc3612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:48.865485 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673280ff-b0fc-4472-995b-fffe56dc3612 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:48.866454 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673280ff-b0fc-4472-995b-fffe56dc3612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:48.869228 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673280ff-b0fc-4472-995b-fffe56dc3612 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:48.889567 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1291/2573] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:48.890817 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90e960-2b84-4eb8-a804-577834dd0a3f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:48.904471 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90e960-2b84-4eb8-a804-577834dd0a3f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:48.910485 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66599e7b-4c37-45e0-bdc1-9df49d8d3b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:48.911118 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66599e7b-4c37-45e0-bdc1-9df49d8d3b8b admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:48.911396 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66599e7b-4c37-45e0-bdc1-9df49d8d3b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:48.911666 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66599e7b-4c37-45e0-bdc1-9df49d8d3b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:48.912323 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66599e7b-4c37-45e0-bdc1-9df49d8d3b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:48.914448 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66599e7b-4c37-45e0-bdc1-9df49d8d3b8b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:48.929890 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1283/2574] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:00:48.934069 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673280ff-b0fc-4472-995b-fffe56dc3612 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:48.952832 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673280ff-b0fc-4472-995b-fffe56dc3612 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:48.959512 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9bb04-ebdb-414a-9aa9-79578146eafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:48.960853 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9bb04-ebdb-414a-9aa9-79578146eafc admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:48.961724 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9bb04-ebdb-414a-9aa9-79578146eafc admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:48.961724 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9bb04-ebdb-414a-9aa9-79578146eafc admin admin] PATH_INFO: `/v3/projects/67d8fefaf89c436ca32731f9e1c45213/users/a5f2bfa67a284927b795f966741d8081/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:49.005200 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9bb04-ebdb-414a-9aa9-79578146eafc admin admin] RBAC: Authorizing `identity:create_grant(project_id=67d8fefaf89c436ca32731f9e1c45213, user_id=a5f2bfa67a284927b795f966741d8081, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:49.009132 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9bb04-ebdb-414a-9aa9-79578146eafc admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:49.039390 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1292/2575] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:00:48 2022] PUT /identity/v3/projects/67d8fefaf89c436ca32731f9e1c45213/users/a5f2bfa67a284927b795f966741d8081/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:49.045293 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3cc54-203d-4446-a2d8-7f8cbb66f63a None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:49.047325 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3cc54-203d-4446-a2d8-7f8cbb66f63a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:49.048169 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3cc54-203d-4446-a2d8-7f8cbb66f63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:49.089382 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-37f3cc54-203d-4446-a2d8-7f8cbb66f63a None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:49.091030 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-37f3cc54-203d-4446-a2d8-7f8cbb66f63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:49.199918 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1284/2576] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:49.212165 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9bb04-ebdb-414a-9aa9-79578146eafc admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:49.214406 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e8b9bb04-ebdb-414a-9aa9-79578146eafc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:49.329650 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9bb04-ebdb-414a-9aa9-79578146eafc admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:49.338662 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95697244-e95f-4c4e-a134-558e2c0bdcce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:49.340979 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95697244-e95f-4c4e-a134-558e2c0bdcce service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:49.341283 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95697244-e95f-4c4e-a134-558e2c0bdcce service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:49.343036 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95697244-e95f-4c4e-a134-558e2c0bdcce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:49.365880 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95697244-e95f-4c4e-a134-558e2c0bdcce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:49.368818 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95697244-e95f-4c4e-a134-558e2c0bdcce service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:49.409606 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1293/2577] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:49.988018 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3cc54-203d-4446-a2d8-7f8cbb66f63a None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:49.989964 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-37f3cc54-203d-4446-a2d8-7f8cbb66f63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:50.010347 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3cc54-203d-4446-a2d8-7f8cbb66f63a None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:50.039755 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560955e-4b91-4788-8a6f-701a6bc560d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:50.040644 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560955e-4b91-4788-8a6f-701a6bc560d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:50.041042 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560955e-4b91-4788-8a6f-701a6bc560d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:50.041402 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560955e-4b91-4788-8a6f-701a6bc560d0 admin admin] PATH_INFO: `/v3/projects/81a85cf93b4f4f2c97f0a8f2527d549b` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:50.042866 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560955e-4b91-4788-8a6f-701a6bc560d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81a85cf93b4f4f2c97f0a8f2527d549b)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:50.045067 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560955e-4b91-4788-8a6f-701a6bc560d0 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:50.109411 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a560955e-4b91-4788-8a6f-701a6bc560d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81a85cf93b4f4f2c97f0a8f2527d549b', 'request_id': 'req-a560955e-4b91-4788-8a6f-701a6bc560d0'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:50.117217 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a560955e-4b91-4788-8a6f-701a6bc560d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81a85cf93b4f4f2c97f0a8f2527d549b', 'request_id': 'req-a560955e-4b91-4788-8a6f-701a6bc560d0'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:50.125162 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a560955e-4b91-4788-8a6f-701a6bc560d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81a85cf93b4f4f2c97f0a8f2527d549b', 'request_id': 'req-a560955e-4b91-4788-8a6f-701a6bc560d0'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:50.144372 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a560955e-4b91-4788-8a6f-701a6bc560d0 admin admin] The token cache is being invalidate because project 81a85cf93b4f4f2c97f0a8f2527d549b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:00:50.144951 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a560955e-4b91-4788-8a6f-701a6bc560d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:50.146196 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a560955e-4b91-4788-8a6f-701a6bc560d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:50.152876 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1285/2578] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:00:49 2022] DELETE /identity/v3/projects/81a85cf93b4f4f2c97f0a8f2527d549b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:50.153723 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9833b-0e39-4bc2-afeb-49b5a1ce25d1 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:50.154190 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9833b-0e39-4bc2-afeb-49b5a1ce25d1 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:50.154312 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9833b-0e39-4bc2-afeb-49b5a1ce25d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:50.194346 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-49e9833b-0e39-4bc2-afeb-49b5a1ce25d1 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:50.196024 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-49e9833b-0e39-4bc2-afeb-49b5a1ce25d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:50.335874 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6498a-eb84-49f3-912c-73514c7b5ffb None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:50.336157 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6498a-eb84-49f3-912c-73514c7b5ffb None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:50.336436 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6498a-eb84-49f3-912c-73514c7b5ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:50.344476 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1294/2579] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:50.365407 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a7b6498a-eb84-49f3-912c-73514c7b5ffb None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:50.366901 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a7b6498a-eb84-49f3-912c-73514c7b5ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:50.383245 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9833b-0e39-4bc2-afeb-49b5a1ce25d1 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:50.390576 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1286/2580] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:50.399478 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9833b-0e39-4bc2-afeb-49b5a1ce25d1 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:50.411000 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56881f4-3ec9-44ad-b398-b48794ed9665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:50.412268 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56881f4-3ec9-44ad-b398-b48794ed9665 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:50.412763 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56881f4-3ec9-44ad-b398-b48794ed9665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:50.413513 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56881f4-3ec9-44ad-b398-b48794ed9665 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:50.414361 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56881f4-3ec9-44ad-b398-b48794ed9665 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:00:50.415275 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56881f4-3ec9-44ad-b398-b48794ed9665 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:50.418800 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56881f4-3ec9-44ad-b398-b48794ed9665 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:50.437717 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1295/2581] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 01:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:00:50.443414 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6498a-eb84-49f3-912c-73514c7b5ffb None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:50.456122 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6498a-eb84-49f3-912c-73514c7b5ffb None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:50.463646 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd075bf-c4a2-4cff-8089-7c5cce0f248c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:50.464575 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd075bf-c4a2-4cff-8089-7c5cce0f248c admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:50.465538 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd075bf-c4a2-4cff-8089-7c5cce0f248c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:50.465820 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd075bf-c4a2-4cff-8089-7c5cce0f248c admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:50.466504 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd075bf-c4a2-4cff-8089-7c5cce0f248c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:50.475522 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd075bf-c4a2-4cff-8089-7c5cce0f248c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:50.518395 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1287/2582] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:00:50 2022] POST /identity/v3/projects => generated 389 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:00:50.522685 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56881f4-3ec9-44ad-b398-b48794ed9665 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:50.536320 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56881f4-3ec9-44ad-b398-b48794ed9665 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:50.608878 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:50.626843 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df4f78-0f59-41da-b770-46a119361049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:50.627643 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df4f78-0f59-41da-b770-46a119361049 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:50.628243 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df4f78-0f59-41da-b770-46a119361049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:50.628623 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df4f78-0f59-41da-b770-46a119361049 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:50.629371 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df4f78-0f59-41da-b770-46a119361049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:50.631846 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df4f78-0f59-41da-b770-46a119361049 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:50.676134 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1296/2583] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:00:50 2022] POST /identity/v3/users => generated 295 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:00:50.680484 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd075bf-c4a2-4cff-8089-7c5cce0f248c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:50.692954 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd075bf-c4a2-4cff-8089-7c5cce0f248c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:50.698782 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81174d3d-9fbc-41e7-b9dc-631de2126906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:50.699657 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81174d3d-9fbc-41e7-b9dc-631de2126906 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:50.700122 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81174d3d-9fbc-41e7-b9dc-631de2126906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:50.700492 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81174d3d-9fbc-41e7-b9dc-631de2126906 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:50.701367 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81174d3d-9fbc-41e7-b9dc-631de2126906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:50.703338 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81174d3d-9fbc-41e7-b9dc-631de2126906 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:50.738328 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1288/2584] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:50.742434 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df4f78-0f59-41da-b770-46a119361049 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:50.768769 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df4f78-0f59-41da-b770-46a119361049 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:50.777942 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5995d1c-e2a3-4b81-a611-95febb999c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:50.778950 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5995d1c-e2a3-4b81-a611-95febb999c29 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:50.779824 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5995d1c-e2a3-4b81-a611-95febb999c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:50.780264 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5995d1c-e2a3-4b81-a611-95febb999c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:50.781740 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5995d1c-e2a3-4b81-a611-95febb999c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:50.784030 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5995d1c-e2a3-4b81-a611-95febb999c29 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:50.802533 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1297/2585] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:50.806641 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81174d3d-9fbc-41e7-b9dc-631de2126906 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:50.847798 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81174d3d-9fbc-41e7-b9dc-631de2126906 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:50.862462 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b479d2c-60af-4a12-bd49-57210c607065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:50.863156 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b479d2c-60af-4a12-bd49-57210c607065 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:50.863442 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b479d2c-60af-4a12-bd49-57210c607065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:50.863721 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b479d2c-60af-4a12-bd49-57210c607065 admin admin] PATH_INFO: `/v3/projects/64dbf60d47404a93beabbce7c077676e/users/531f0a4d7c1a4cd4b06f12fab0fc3dbb/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:50.885325 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:50.921920 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b479d2c-60af-4a12-bd49-57210c607065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64dbf60d47404a93beabbce7c077676e, user_id=531f0a4d7c1a4cd4b06f12fab0fc3dbb, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:50.927983 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b479d2c-60af-4a12-bd49-57210c607065 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:50.962135 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1289/2586] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:00:50 2022] PUT /identity/v3/projects/64dbf60d47404a93beabbce7c077676e/users/531f0a4d7c1a4cd4b06f12fab0fc3dbb/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:00:50.976113 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac1ac1-2fdd-47f6-b862-1b1a55970135 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:50.976719 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac1ac1-2fdd-47f6-b862-1b1a55970135 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:50.976992 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac1ac1-2fdd-47f6-b862-1b1a55970135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:51.033722 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-78ac1ac1-2fdd-47f6-b862-1b1a55970135 None None] MFA Rules not processed for user `531f0a4d7c1a4cd4b06f12fab0fc3dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:51.035111 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-78ac1ac1-2fdd-47f6-b862-1b1a55970135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:51.160004 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1298/2587] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:51.164248 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b479d2c-60af-4a12-bd49-57210c607065 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:51.280148 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b479d2c-60af-4a12-bd49-57210c607065 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:51.286981 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781264ec-a87c-4f11-a623-a7fcbac54281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:51.287654 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781264ec-a87c-4f11-a623-a7fcbac54281 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:51.288017 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781264ec-a87c-4f11-a623-a7fcbac54281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:51.288405 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781264ec-a87c-4f11-a623-a7fcbac54281 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:51.289128 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781264ec-a87c-4f11-a623-a7fcbac54281 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:51.291286 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781264ec-a87c-4f11-a623-a7fcbac54281 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:51.330009 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1290/2588] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:00:51 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:00:51.331237 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac1ac1-2fdd-47f6-b862-1b1a55970135 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:51.344358 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac1ac1-2fdd-47f6-b862-1b1a55970135 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:51.508984 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d263b5-5edb-475b-aa47-1961f242690f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:51.510537 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d263b5-5edb-475b-aa47-1961f242690f admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:51.512996 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d263b5-5edb-475b-aa47-1961f242690f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:51.513340 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d263b5-5edb-475b-aa47-1961f242690f admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:51.514147 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d263b5-5edb-475b-aa47-1961f242690f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:51.522073 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d263b5-5edb-475b-aa47-1961f242690f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:51.583936 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1299/2589] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:00:51 2022] POST /identity/v3/users => generated 300 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:00:51.585418 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0146d-b7ea-4b28-86bc-a9a24758096a None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:51.585716 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0146d-b7ea-4b28-86bc-a9a24758096a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:51.586341 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0146d-b7ea-4b28-86bc-a9a24758096a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:51.590578 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d263b5-5edb-475b-aa47-1961f242690f admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:51.626240 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d263b5-5edb-475b-aa47-1961f242690f admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:51.642312 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd801b5-ec0c-4aaf-9d29-d78d16f1121f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:51.642903 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd801b5-ec0c-4aaf-9d29-d78d16f1121f admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:51.643182 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd801b5-ec0c-4aaf-9d29-d78d16f1121f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:51.643456 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd801b5-ec0c-4aaf-9d29-d78d16f1121f admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:51.644108 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd801b5-ec0c-4aaf-9d29-d78d16f1121f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:51.645754 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd801b5-ec0c-4aaf-9d29-d78d16f1121f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:51.653698 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-5df0146d-b7ea-4b28-86bc-a9a24758096a None None] MFA Rules not processed for user `a5f2bfa67a284927b795f966741d8081`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:51.655475 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5df0146d-b7ea-4b28-86bc-a9a24758096a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:51.668580 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1300/2590] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:51.670124 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd801b5-ec0c-4aaf-9d29-d78d16f1121f admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:51.696956 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd801b5-ec0c-4aaf-9d29-d78d16f1121f admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:51.705012 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c73438-a388-42b9-a6c9-9ce1cbaa6d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:51.706084 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c73438-a388-42b9-a6c9-9ce1cbaa6d54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:51.706507 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c73438-a388-42b9-a6c9-9ce1cbaa6d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:51.706939 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c73438-a388-42b9-a6c9-9ce1cbaa6d54 admin admin] PATH_INFO: `/v3/projects/46dfe3af52654963b5469bc16fc7a759/users/087454471e184313bccface3b04514d9/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:51.749823 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c73438-a388-42b9-a6c9-9ce1cbaa6d54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46dfe3af52654963b5469bc16fc7a759, user_id=087454471e184313bccface3b04514d9, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:51.753250 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c73438-a388-42b9-a6c9-9ce1cbaa6d54 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:51.786087 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1301/2591] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:00:51 2022] PUT /identity/v3/projects/46dfe3af52654963b5469bc16fc7a759/users/087454471e184313bccface3b04514d9/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:51.790656 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c73438-a388-42b9-a6c9-9ce1cbaa6d54 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:51.828551 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:51.835952 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1291/2592] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:51 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:51.840774 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0146d-b7ea-4b28-86bc-a9a24758096a None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:51.842211 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5df0146d-b7ea-4b28-86bc-a9a24758096a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:51.877418 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0146d-b7ea-4b28-86bc-a9a24758096a None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:51.998381 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c73438-a388-42b9-a6c9-9ce1cbaa6d54 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:52.008406 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210b6d2-02b4-49b7-9eb6-de462f965cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:52.009041 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210b6d2-02b4-49b7-9eb6-de462f965cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:52.009318 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210b6d2-02b4-49b7-9eb6-de462f965cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:52.009587 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210b6d2-02b4-49b7-9eb6-de462f965cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:52.010302 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6210b6d2-02b4-49b7-9eb6-de462f965cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:52.015314 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6210b6d2-02b4-49b7-9eb6-de462f965cf8 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:52.043595 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1302/2593] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:52.045302 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210b6d2-02b4-49b7-9eb6-de462f965cf8 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:52.046393 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb40ec1-874a-4057-941b-e21367f1f5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:52.047297 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb40ec1-874a-4057-941b-e21367f1f5f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:52.047580 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb40ec1-874a-4057-941b-e21367f1f5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:52.047853 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb40ec1-874a-4057-941b-e21367f1f5f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:52.048564 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb40ec1-874a-4057-941b-e21367f1f5f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:52.050787 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb40ec1-874a-4057-941b-e21367f1f5f6 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:52.078269 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:52.083190 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210b6d2-02b4-49b7-9eb6-de462f965cf8 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:52.098912 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427bb63-5edb-4ed7-81b5-c30d8122ec43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:52.099653 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427bb63-5edb-4ed7-81b5-c30d8122ec43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:52.099932 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427bb63-5edb-4ed7-81b5-c30d8122ec43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:52.100203 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427bb63-5edb-4ed7-81b5-c30d8122ec43 admin admin] PATH_INFO: `/v3/projects/46dfe3af52654963b5469bc16fc7a759/users/087454471e184313bccface3b04514d9/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:52.104711 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427bb63-5edb-4ed7-81b5-c30d8122ec43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46dfe3af52654963b5469bc16fc7a759, user_id=087454471e184313bccface3b04514d9, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:52.109716 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427bb63-5edb-4ed7-81b5-c30d8122ec43 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:52.131344 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1292/2594] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:00:51 2022] POST /identity/v3/projects => generated 405 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:00:52.136452 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb40ec1-874a-4057-941b-e21367f1f5f6 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:52.143052 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1303/2595] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:00:52 2022] PUT /identity/v3/projects/46dfe3af52654963b5469bc16fc7a759/users/087454471e184313bccface3b04514d9/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:52.155987 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88705d-195e-4fd4-8ad7-79b2f086bb22 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:52.156455 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88705d-195e-4fd4-8ad7-79b2f086bb22 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:52.157036 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88705d-195e-4fd4-8ad7-79b2f086bb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:52.228057 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-4e88705d-195e-4fd4-8ad7-79b2f086bb22 None None] MFA Rules not processed for user `087454471e184313bccface3b04514d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:52.231092 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-4e88705d-195e-4fd4-8ad7-79b2f086bb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:52.302129 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb40ec1-874a-4057-941b-e21367f1f5f6 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:52.315062 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5336814-6277-4989-880a-6bbac8bed1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:52.315865 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5336814-6277-4989-880a-6bbac8bed1e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:52.317697 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5336814-6277-4989-880a-6bbac8bed1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:52.318118 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5336814-6277-4989-880a-6bbac8bed1e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:52.318885 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5336814-6277-4989-880a-6bbac8bed1e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:52.321585 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5336814-6277-4989-880a-6bbac8bed1e1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:52.364988 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1293/2596] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:00:52 2022] POST /identity/v3/users => generated 309 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:00:52.370232 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5336814-6277-4989-880a-6bbac8bed1e1 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:52.398900 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5336814-6277-4989-880a-6bbac8bed1e1 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:52.411446 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec9c64-c727-49dc-b7b5-2e0e36073b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:52.412108 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec9c64-c727-49dc-b7b5-2e0e36073b6d admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:52.412569 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec9c64-c727-49dc-b7b5-2e0e36073b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:52.413377 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec9c64-c727-49dc-b7b5-2e0e36073b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:52.415089 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec9c64-c727-49dc-b7b5-2e0e36073b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:52.420505 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec9c64-c727-49dc-b7b5-2e0e36073b6d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:52.429155 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1304/2597] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:52 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:52.437656 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88705d-195e-4fd4-8ad7-79b2f086bb22 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:52.440199 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-4e88705d-195e-4fd4-8ad7-79b2f086bb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:52.462006 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1294/2598] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:52.463900 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec9c64-c727-49dc-b7b5-2e0e36073b6d admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:52.487551 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec9c64-c727-49dc-b7b5-2e0e36073b6d admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:52.504390 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8bb87-057f-4c49-88da-5cbb3a81b407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:52.505106 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8bb87-057f-4c49-88da-5cbb3a81b407 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:52.505461 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8bb87-057f-4c49-88da-5cbb3a81b407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:52.505744 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8bb87-057f-4c49-88da-5cbb3a81b407 admin admin] PATH_INFO: `/v3/projects/e47d167a3de845bab83d0a74572e9f61/users/437b902e0a114036a1fcceb8fb0593e9/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:52.527258 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8bb87-057f-4c49-88da-5cbb3a81b407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e47d167a3de845bab83d0a74572e9f61, user_id=437b902e0a114036a1fcceb8fb0593e9, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:52.531191 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8bb87-057f-4c49-88da-5cbb3a81b407 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:52.551526 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1295/2599] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:00:52 2022] PUT /identity/v3/projects/e47d167a3de845bab83d0a74572e9f61/users/437b902e0a114036a1fcceb8fb0593e9/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:52.555282 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8bb87-057f-4c49-88da-5cbb3a81b407 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:52.621652 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88705d-195e-4fd4-8ad7-79b2f086bb22 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:52.664159 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8bb87-057f-4c49-88da-5cbb3a81b407 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:52.671241 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda32bce-3f32-4432-b659-8d7da1c50abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:52.672013 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda32bce-3f32-4432-b659-8d7da1c50abc admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:52.672394 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda32bce-3f32-4432-b659-8d7da1c50abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:52.673306 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda32bce-3f32-4432-b659-8d7da1c50abc admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:52.674120 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda32bce-3f32-4432-b659-8d7da1c50abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:52.676977 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda32bce-3f32-4432-b659-8d7da1c50abc admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:52.696775 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1296/2600] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:00:52.701030 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda32bce-3f32-4432-b659-8d7da1c50abc admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:52.726325 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:52.737109 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda32bce-3f32-4432-b659-8d7da1c50abc admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:52.753001 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9117c-03aa-45cf-aea9-9c2b15bc41dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:52.753935 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9117c-03aa-45cf-aea9-9c2b15bc41dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:52.756749 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9117c-03aa-45cf-aea9-9c2b15bc41dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:52.757143 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9117c-03aa-45cf-aea9-9c2b15bc41dc admin admin] PATH_INFO: `/v3/projects/e47d167a3de845bab83d0a74572e9f61/users/437b902e0a114036a1fcceb8fb0593e9/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:52.762087 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9117c-03aa-45cf-aea9-9c2b15bc41dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e47d167a3de845bab83d0a74572e9f61, user_id=437b902e0a114036a1fcceb8fb0593e9, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:52.767182 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9117c-03aa-45cf-aea9-9c2b15bc41dc admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:52.773006 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd092444-c4b5-4371-a827-75bed44b4fb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:52.773774 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd092444-c4b5-4371-a827-75bed44b4fb8 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:52.774154 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd092444-c4b5-4371-a827-75bed44b4fb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:52.774492 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd092444-c4b5-4371-a827-75bed44b4fb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:52.796693 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1297/2601] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:00:52 2022] PUT /identity/v3/projects/e47d167a3de845bab83d0a74572e9f61/users/437b902e0a114036a1fcceb8fb0593e9/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:00:52.936565 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd092444-c4b5-4371-a827-75bed44b4fb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:52.938403 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd092444-c4b5-4371-a827-75bed44b4fb8 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:52.997801 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1305/2602] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:52 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:53.226186 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9117c-03aa-45cf-aea9-9c2b15bc41dc admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:53.266289 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:53.320067 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9117c-03aa-45cf-aea9-9c2b15bc41dc admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:53.325631 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5098e0-4edc-46f2-b262-87b1274c8358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:53.326502 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5098e0-4edc-46f2-b262-87b1274c8358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:53.326885 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5098e0-4edc-46f2-b262-87b1274c8358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:53.327467 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5098e0-4edc-46f2-b262-87b1274c8358 admin admin] PATH_INFO: `/v3/users/531f0a4d7c1a4cd4b06f12fab0fc3dbb` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:53.328710 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5098e0-4edc-46f2-b262-87b1274c8358 admin admin] RBAC: Authorizing `identity:delete_user(user_id=531f0a4d7c1a4cd4b06f12fab0fc3dbb)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:53.331902 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5098e0-4edc-46f2-b262-87b1274c8358 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:53.411495 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-bc5098e0-4edc-46f2-b262-87b1274c8358 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '531f0a4d7c1a4cd4b06f12fab0fc3dbb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:53.429817 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-bc5098e0-4edc-46f2-b262-87b1274c8358 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '531f0a4d7c1a4cd4b06f12fab0fc3dbb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:53.440007 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-bc5098e0-4edc-46f2-b262-87b1274c8358 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '531f0a4d7c1a4cd4b06f12fab0fc3dbb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:53.455679 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-bc5098e0-4edc-46f2-b262-87b1274c8358 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '531f0a4d7c1a4cd4b06f12fab0fc3dbb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:53.457509 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-bc5098e0-4edc-46f2-b262-87b1274c8358 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '531f0a4d7c1a4cd4b06f12fab0fc3dbb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:53.476620 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1298/2603] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:00:53 2022] DELETE /identity/v3/users/531f0a4d7c1a4cd4b06f12fab0fc3dbb => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:53.482512 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be33f33-e620-4f55-ba7e-128a06728e39 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:53.484023 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be33f33-e620-4f55-ba7e-128a06728e39 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:53.484546 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be33f33-e620-4f55-ba7e-128a06728e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:53.537531 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-2be33f33-e620-4f55-ba7e-128a06728e39 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:53.541047 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-2be33f33-e620-4f55-ba7e-128a06728e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:53.693512 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1306/2604] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:00:53.707067 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5098e0-4edc-46f2-b262-87b1274c8358 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:53.709197 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bc5098e0-4edc-46f2-b262-87b1274c8358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:53.905560 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5098e0-4edc-46f2-b262-87b1274c8358 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:53.911856 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8489e43-13dd-47e6-80dd-021ffc4fb6b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:53.912504 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8489e43-13dd-47e6-80dd-021ffc4fb6b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:53.912783 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8489e43-13dd-47e6-80dd-021ffc4fb6b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:53.913056 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8489e43-13dd-47e6-80dd-021ffc4fb6b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:53.937212 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8489e43-13dd-47e6-80dd-021ffc4fb6b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:53.938806 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8489e43-13dd-47e6-80dd-021ffc4fb6b6 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:53.962168 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1299/2605] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:54.385760 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be33f33-e620-4f55-ba7e-128a06728e39 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:54.388216 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-2be33f33-e620-4f55-ba7e-128a06728e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:54.408130 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be33f33-e620-4f55-ba7e-128a06728e39 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:54.417276 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fe6df-f3ed-4997-99d2-f515608fd45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:54.418090 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fe6df-f3ed-4997-99d2-f515608fd45f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:54.418372 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fe6df-f3ed-4997-99d2-f515608fd45f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:54.418644 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fe6df-f3ed-4997-99d2-f515608fd45f admin admin] PATH_INFO: `/v3/projects/64dbf60d47404a93beabbce7c077676e` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:54.419816 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906fe6df-f3ed-4997-99d2-f515608fd45f admin admin] RBAC: Authorizing `identity:delete_project(project_id=64dbf60d47404a93beabbce7c077676e)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:54.421930 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906fe6df-f3ed-4997-99d2-f515608fd45f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:54.514534 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-906fe6df-f3ed-4997-99d2-f515608fd45f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64dbf60d47404a93beabbce7c077676e', 'request_id': 'req-906fe6df-f3ed-4997-99d2-f515608fd45f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:54.524774 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-906fe6df-f3ed-4997-99d2-f515608fd45f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64dbf60d47404a93beabbce7c077676e', 'request_id': 'req-906fe6df-f3ed-4997-99d2-f515608fd45f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:54.533724 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-906fe6df-f3ed-4997-99d2-f515608fd45f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64dbf60d47404a93beabbce7c077676e', 'request_id': 'req-906fe6df-f3ed-4997-99d2-f515608fd45f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:54.548167 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-906fe6df-f3ed-4997-99d2-f515608fd45f admin admin] The token cache is being invalidate because project 64dbf60d47404a93beabbce7c077676e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:00:54.548465 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-906fe6df-f3ed-4997-99d2-f515608fd45f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:54.549747 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-906fe6df-f3ed-4997-99d2-f515608fd45f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:54.553952 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1307/2606] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:00:54 2022] DELETE /identity/v3/projects/64dbf60d47404a93beabbce7c077676e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:54.555511 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8489e43-13dd-47e6-80dd-021ffc4fb6b6 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:54.568513 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8489e43-13dd-47e6-80dd-021ffc4fb6b6 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:54.624556 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:54.643648 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96a3aa-e794-4d49-9acd-f4428b7b5ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:54.644294 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96a3aa-e794-4d49-9acd-f4428b7b5ef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:54.644694 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96a3aa-e794-4d49-9acd-f4428b7b5ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:54.644852 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96a3aa-e794-4d49-9acd-f4428b7b5ef5 admin admin] PATH_INFO: `/v3/users/087454471e184313bccface3b04514d9` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:54.646177 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96a3aa-e794-4d49-9acd-f4428b7b5ef5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=087454471e184313bccface3b04514d9)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:54.648130 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96a3aa-e794-4d49-9acd-f4428b7b5ef5 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:54.705195 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-bc96a3aa-e794-4d49-9acd-f4428b7b5ef5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '087454471e184313bccface3b04514d9'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:54.719921 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-bc96a3aa-e794-4d49-9acd-f4428b7b5ef5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '087454471e184313bccface3b04514d9'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:54.727102 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-bc96a3aa-e794-4d49-9acd-f4428b7b5ef5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '087454471e184313bccface3b04514d9'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:54.736744 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-bc96a3aa-e794-4d49-9acd-f4428b7b5ef5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '087454471e184313bccface3b04514d9'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:54.738015 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-bc96a3aa-e794-4d49-9acd-f4428b7b5ef5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '087454471e184313bccface3b04514d9'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:54.746131 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1300/2607] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:00:54 2022] DELETE /identity/v3/users/087454471e184313bccface3b04514d9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:54.786644 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9a490-fef9-4856-bf7a-52c26a2ce279 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:54.786929 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9a490-fef9-4856-bf7a-52c26a2ce279 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:54.787202 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9a490-fef9-4856-bf7a-52c26a2ce279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:54.812190 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:54.836177 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-71e9a490-fef9-4856-bf7a-52c26a2ce279 None None] MFA Rules not processed for user `352335baa500425399e907313dba6209`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:54.838265 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-71e9a490-fef9-4856-bf7a-52c26a2ce279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:54.958157 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1308/2608] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:54.972704 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96a3aa-e794-4d49-9acd-f4428b7b5ef5 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:54.974199 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bc96a3aa-e794-4d49-9acd-f4428b7b5ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:55.032035 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80626a5-108f-41ca-a346-00ca7c744817 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:55.032988 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80626a5-108f-41ca-a346-00ca7c744817 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:55.033469 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80626a5-108f-41ca-a346-00ca7c744817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:55.075710 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-e80626a5-108f-41ca-a346-00ca7c744817 None None] MFA Rules not processed for user `437b902e0a114036a1fcceb8fb0593e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:55.076965 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e80626a5-108f-41ca-a346-00ca7c744817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:55.127119 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96a3aa-e794-4d49-9acd-f4428b7b5ef5 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:55.136089 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688309c-aa50-4479-b56b-95b8caa57118 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:55.137310 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688309c-aa50-4479-b56b-95b8caa57118 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:55.137887 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688309c-aa50-4479-b56b-95b8caa57118 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:55.138963 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688309c-aa50-4479-b56b-95b8caa57118 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:55.142278 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9688309c-aa50-4479-b56b-95b8caa57118 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:55.196836 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1309/2609] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:55 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:00:55.197743 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80626a5-108f-41ca-a346-00ca7c744817 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:55.205444 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e80626a5-108f-41ca-a346-00ca7c744817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:55.319551 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80626a5-108f-41ca-a346-00ca7c744817 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:55.327897 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0bdb8-0b80-41ea-9728-5146cffb18e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:55.328482 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0bdb8-0b80-41ea-9728-5146cffb18e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:55.329392 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0bdb8-0b80-41ea-9728-5146cffb18e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:55.329630 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0bdb8-0b80-41ea-9728-5146cffb18e9 admin admin] PATH_INFO: `/v3/projects/46dfe3af52654963b5469bc16fc7a759` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:55.331011 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0bdb8-0b80-41ea-9728-5146cffb18e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46dfe3af52654963b5469bc16fc7a759)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:55.332735 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688309c-aa50-4479-b56b-95b8caa57118 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:55.333432 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0bdb8-0b80-41ea-9728-5146cffb18e9 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:55.336526 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688309c-aa50-4479-b56b-95b8caa57118 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:55.347478 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1301/2610] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:55.348344 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688309c-aa50-4479-b56b-95b8caa57118 service nova] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:55.349763 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9688309c-aa50-4479-b56b-95b8caa57118 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:55.359393 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:55.368191 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688309c-aa50-4479-b56b-95b8caa57118 service nova] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:55.388705 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263abf7-0744-432b-bc59-c5c26a377c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:55.389238 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:55.391545 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263abf7-0744-432b-bc59-c5c26a377c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:55.391842 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263abf7-0744-432b-bc59-c5c26a377c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:55.392130 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263abf7-0744-432b-bc59-c5c26a377c6f admin admin] PATH_INFO: `/v3/users/cc8eaa6c0af74ff3aa6e41189388dc8e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:55.396380 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263abf7-0744-432b-bc59-c5c26a377c6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc8eaa6c0af74ff3aa6e41189388dc8e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:55.403897 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263abf7-0744-432b-bc59-c5c26a377c6f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:55.432711 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-07e0bdb8-0b80-41ea-9728-5146cffb18e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46dfe3af52654963b5469bc16fc7a759', 'request_id': 'req-07e0bdb8-0b80-41ea-9728-5146cffb18e9'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:55.446668 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-07e0bdb8-0b80-41ea-9728-5146cffb18e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46dfe3af52654963b5469bc16fc7a759', 'request_id': 'req-07e0bdb8-0b80-41ea-9728-5146cffb18e9'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:55.456876 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-07e0bdb8-0b80-41ea-9728-5146cffb18e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46dfe3af52654963b5469bc16fc7a759', 'request_id': 'req-07e0bdb8-0b80-41ea-9728-5146cffb18e9'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:55.479263 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-07e0bdb8-0b80-41ea-9728-5146cffb18e9 admin admin] The token cache is being invalidate because project 46dfe3af52654963b5469bc16fc7a759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:00:55.479611 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-07e0bdb8-0b80-41ea-9728-5146cffb18e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:55.481392 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-07e0bdb8-0b80-41ea-9728-5146cffb18e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:55.483442 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1310/2611] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:00:55 2022] DELETE /identity/v3/projects/46dfe3af52654963b5469bc16fc7a759 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:55.494246 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97596bfe-a8ae-49e0-8314-06fa58bebccc None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:55.494833 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97596bfe-a8ae-49e0-8314-06fa58bebccc None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:55.495318 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97596bfe-a8ae-49e0-8314-06fa58bebccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:55.509955 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f263abf7-0744-432b-bc59-c5c26a377c6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc8eaa6c0af74ff3aa6e41189388dc8e'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:55.524025 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f263abf7-0744-432b-bc59-c5c26a377c6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc8eaa6c0af74ff3aa6e41189388dc8e'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:55.532738 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f263abf7-0744-432b-bc59-c5c26a377c6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc8eaa6c0af74ff3aa6e41189388dc8e'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:55.544743 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f263abf7-0744-432b-bc59-c5c26a377c6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc8eaa6c0af74ff3aa6e41189388dc8e'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:55.545468 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f263abf7-0744-432b-bc59-c5c26a377c6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc8eaa6c0af74ff3aa6e41189388dc8e'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:55.557748 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-97596bfe-a8ae-49e0-8314-06fa58bebccc None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:55.560227 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1302/2612] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:00:55 2022] DELETE /identity/v3/users/cc8eaa6c0af74ff3aa6e41189388dc8e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:55.561755 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-97596bfe-a8ae-49e0-8314-06fa58bebccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:55.671236 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1311/2613] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:55.673958 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0438a48-77ed-40a6-82cb-4d99834aa869 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:55.675071 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0438a48-77ed-40a6-82cb-4d99834aa869 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:55.675370 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0438a48-77ed-40a6-82cb-4d99834aa869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:55.699578 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b0438a48-77ed-40a6-82cb-4d99834aa869 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:55.700818 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b0438a48-77ed-40a6-82cb-4d99834aa869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:55.714532 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1303/2614] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:00:55.727495 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97596bfe-a8ae-49e0-8314-06fa58bebccc None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:55.744530 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97596bfe-a8ae-49e0-8314-06fa58bebccc None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:55.755581 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61dfb5-8ee1-41e7-ac03-1f6e3b0e88c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:55.756636 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61dfb5-8ee1-41e7-ac03-1f6e3b0e88c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:55.757946 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61dfb5-8ee1-41e7-ac03-1f6e3b0e88c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:55.758435 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61dfb5-8ee1-41e7-ac03-1f6e3b0e88c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:55.759477 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61dfb5-8ee1-41e7-ac03-1f6e3b0e88c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:00:55.759991 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61dfb5-8ee1-41e7-ac03-1f6e3b0e88c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:55.762829 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61dfb5-8ee1-41e7-ac03-1f6e3b0e88c7 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:55.811333 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1312/2615] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 01:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:00:55.813016 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0438a48-77ed-40a6-82cb-4d99834aa869 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:55.827203 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0438a48-77ed-40a6-82cb-4d99834aa869 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:55.838923 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324d550-95d4-4c86-943d-6ae73bbf230d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:55.839715 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324d550-95d4-4c86-943d-6ae73bbf230d admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:55.840021 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324d550-95d4-4c86-943d-6ae73bbf230d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:55.840260 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324d550-95d4-4c86-943d-6ae73bbf230d admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:55.840899 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324d550-95d4-4c86-943d-6ae73bbf230d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:55.847067 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324d550-95d4-4c86-943d-6ae73bbf230d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:55.890362 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1304/2616] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:00:55 2022] POST /identity/v3/projects => generated 367 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:00:55.894495 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61dfb5-8ee1-41e7-ac03-1f6e3b0e88c7 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:55.909117 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61dfb5-8ee1-41e7-ac03-1f6e3b0e88c7 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:56.001601 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6889153-c92b-4895-b5b8-93de0bc515d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:56.002452 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6889153-c92b-4895-b5b8-93de0bc515d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:56.002827 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6889153-c92b-4895-b5b8-93de0bc515d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:56.003528 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6889153-c92b-4895-b5b8-93de0bc515d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:56.004984 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6889153-c92b-4895-b5b8-93de0bc515d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:56.007958 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6889153-c92b-4895-b5b8-93de0bc515d3 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:56.060288 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1313/2617] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:00:55 2022] POST /identity/v3/users => generated 284 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:00:56.061855 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324d550-95d4-4c86-943d-6ae73bbf230d admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:56.075179 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324d550-95d4-4c86-943d-6ae73bbf230d admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:56.090938 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db6acc-4a4a-4d6f-8192-80d0045a04d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:56.091557 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db6acc-4a4a-4d6f-8192-80d0045a04d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:56.094543 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db6acc-4a4a-4d6f-8192-80d0045a04d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:56.094543 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db6acc-4a4a-4d6f-8192-80d0045a04d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:56.094543 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db6acc-4a4a-4d6f-8192-80d0045a04d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:56.095874 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db6acc-4a4a-4d6f-8192-80d0045a04d7 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:56.098998 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6889153-c92b-4895-b5b8-93de0bc515d3 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:56.103425 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a6889153-c92b-4895-b5b8-93de0bc515d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:56.121600 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1305/2618] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:56.127374 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db6acc-4a4a-4d6f-8192-80d0045a04d7 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:56.130807 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6889153-c92b-4895-b5b8-93de0bc515d3 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:56.137994 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5085d38-a3d0-4627-bebe-c7b6cd7c5946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:56.139199 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5085d38-a3d0-4627-bebe-c7b6cd7c5946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:56.139553 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5085d38-a3d0-4627-bebe-c7b6cd7c5946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:56.139899 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5085d38-a3d0-4627-bebe-c7b6cd7c5946 admin admin] PATH_INFO: `/v3/projects/74898ba0beb64167a612629cd2efb278` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:56.141640 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5085d38-a3d0-4627-bebe-c7b6cd7c5946 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74898ba0beb64167a612629cd2efb278)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:56.145396 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5085d38-a3d0-4627-bebe-c7b6cd7c5946 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:56.149861 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db6acc-4a4a-4d6f-8192-80d0045a04d7 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:56.160619 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecd41f-c26f-47fc-90eb-427af19bc31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:56.161251 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecd41f-c26f-47fc-90eb-427af19bc31d admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:56.161534 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecd41f-c26f-47fc-90eb-427af19bc31d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:56.161807 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecd41f-c26f-47fc-90eb-427af19bc31d admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:56.162554 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecd41f-c26f-47fc-90eb-427af19bc31d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:56.175356 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecd41f-c26f-47fc-90eb-427af19bc31d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:56.198423 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:56.210393 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1306/2619] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:00:56.212493 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecd41f-c26f-47fc-90eb-427af19bc31d admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:56.238781 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d5085d38-a3d0-4627-bebe-c7b6cd7c5946 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74898ba0beb64167a612629cd2efb278', 'request_id': 'req-d5085d38-a3d0-4627-bebe-c7b6cd7c5946'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:56.241819 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecd41f-c26f-47fc-90eb-427af19bc31d admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:56.250893 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d5085d38-a3d0-4627-bebe-c7b6cd7c5946 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74898ba0beb64167a612629cd2efb278', 'request_id': 'req-d5085d38-a3d0-4627-bebe-c7b6cd7c5946'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:56.271456 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d5085d38-a3d0-4627-bebe-c7b6cd7c5946 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74898ba0beb64167a612629cd2efb278', 'request_id': 'req-d5085d38-a3d0-4627-bebe-c7b6cd7c5946'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:56.293808 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d5085d38-a3d0-4627-bebe-c7b6cd7c5946 admin admin] The token cache is being invalidate because project 74898ba0beb64167a612629cd2efb278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:00:56.294456 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d5085d38-a3d0-4627-bebe-c7b6cd7c5946 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:56.295890 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d5085d38-a3d0-4627-bebe-c7b6cd7c5946 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:56.298384 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1314/2620] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:00:56 2022] DELETE /identity/v3/projects/74898ba0beb64167a612629cd2efb278 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:56.303159 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe264978-64c2-4e3d-a62a-0c4a23d69414 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:56.303765 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe264978-64c2-4e3d-a62a-0c4a23d69414 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:56.304263 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe264978-64c2-4e3d-a62a-0c4a23d69414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:56.343789 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-fe264978-64c2-4e3d-a62a-0c4a23d69414 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:56.345434 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-fe264978-64c2-4e3d-a62a-0c4a23d69414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:56.358900 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c5952-5909-476a-8e38-ccc43e37bc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:56.359786 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c5952-5909-476a-8e38-ccc43e37bc89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:56.360077 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c5952-5909-476a-8e38-ccc43e37bc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:56.360360 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c5952-5909-476a-8e38-ccc43e37bc89 admin admin] PATH_INFO: `/v3/projects/10e32a8671fb41e0b424cb5b6e903fa0/users/68d4d96a66ae44f188aef1ec4cda3cc2/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:56.380070 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c5952-5909-476a-8e38-ccc43e37bc89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10e32a8671fb41e0b424cb5b6e903fa0, user_id=68d4d96a66ae44f188aef1ec4cda3cc2, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:56.383063 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c5952-5909-476a-8e38-ccc43e37bc89 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:56.414388 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1307/2621] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:00:56 2022] PUT /identity/v3/projects/10e32a8671fb41e0b424cb5b6e903fa0/users/68d4d96a66ae44f188aef1ec4cda3cc2/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:00:56.426867 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9687f17-1558-42d7-9d1b-53d345ad2b2c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:56.427201 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9687f17-1558-42d7-9d1b-53d345ad2b2c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:56.427418 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9687f17-1558-42d7-9d1b-53d345ad2b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:56.443360 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:56.472580 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1315/2622] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:00:56.474442 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f9687f17-1558-42d7-9d1b-53d345ad2b2c None None] MFA Rules not processed for user `68d4d96a66ae44f188aef1ec4cda3cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:56.476962 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f9687f17-1558-42d7-9d1b-53d345ad2b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:56.481611 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f89eb-ca42-4137-a3e7-9538e8593db1 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:56.481976 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f89eb-ca42-4137-a3e7-9538e8593db1 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:56.482209 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f89eb-ca42-4137-a3e7-9538e8593db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:56.542764 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-ab3f89eb-ca42-4137-a3e7-9538e8593db1 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:56.545984 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ab3f89eb-ca42-4137-a3e7-9538e8593db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:56.597035 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1308/2623] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:00:56.601428 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9687f17-1558-42d7-9d1b-53d345ad2b2c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:56.602919 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f9687f17-1558-42d7-9d1b-53d345ad2b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:56.625640 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1316/2624] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:00:56.630123 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f89eb-ca42-4137-a3e7-9538e8593db1 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:56.641200 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f89eb-ca42-4137-a3e7-9538e8593db1 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:56.648239 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8408164-f8fc-4e12-9a8d-6b757f2b2b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:56.648911 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8408164-f8fc-4e12-9a8d-6b757f2b2b25 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:56.649186 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8408164-f8fc-4e12-9a8d-6b757f2b2b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:56.649785 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8408164-f8fc-4e12-9a8d-6b757f2b2b25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:56.650626 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8408164-f8fc-4e12-9a8d-6b757f2b2b25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:00:56.650925 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8408164-f8fc-4e12-9a8d-6b757f2b2b25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:56.653136 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8408164-f8fc-4e12-9a8d-6b757f2b2b25 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:56.667415 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1317/2625] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 01:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:00:56.672302 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8408164-f8fc-4e12-9a8d-6b757f2b2b25 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:56.684138 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9687f17-1558-42d7-9d1b-53d345ad2b2c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:56.689576 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e374cd-4add-4b44-9d32-53a42db4f49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:56.689962 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8408164-f8fc-4e12-9a8d-6b757f2b2b25 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:56.690254 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e374cd-4add-4b44-9d32-53a42db4f49e admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:56.690584 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e374cd-4add-4b44-9d32-53a42db4f49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:56.690872 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e374cd-4add-4b44-9d32-53a42db4f49e admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:56.691628 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e374cd-4add-4b44-9d32-53a42db4f49e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:56.693971 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e374cd-4add-4b44-9d32-53a42db4f49e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:56.696593 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06331529-878a-4d03-ba89-b513300d1b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:56.697880 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06331529-878a-4d03-ba89-b513300d1b09 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:56.698286 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06331529-878a-4d03-ba89-b513300d1b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:56.698619 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06331529-878a-4d03-ba89-b513300d1b09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:56.699509 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06331529-878a-4d03-ba89-b513300d1b09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:56.701626 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06331529-878a-4d03-ba89-b513300d1b09 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:56.732923 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1309/2626] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:00:56 2022] POST /identity/v3/projects => generated 363 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:00:56.734244 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e374cd-4add-4b44-9d32-53a42db4f49e admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:56.739522 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1318/2627] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:00:56 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:00:56.743592 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06331529-878a-4d03-ba89-b513300d1b09 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:56.781664 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:56.819155 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e374cd-4add-4b44-9d32-53a42db4f49e admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:56.866217 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:56.871802 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06331529-878a-4d03-ba89-b513300d1b09 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:56.891927 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c013ca5-03e0-44f6-829e-cf9442e9154c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:56.892584 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c013ca5-03e0-44f6-829e-cf9442e9154c admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:56.892872 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c013ca5-03e0-44f6-829e-cf9442e9154c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:56.893630 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c013ca5-03e0-44f6-829e-cf9442e9154c admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:56.894348 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c013ca5-03e0-44f6-829e-cf9442e9154c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:56.902458 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c013ca5-03e0-44f6-829e-cf9442e9154c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:56.919255 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751117ec-4b18-4b40-9b86-392358125375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:56.919927 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751117ec-4b18-4b40-9b86-392358125375 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:56.920206 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751117ec-4b18-4b40-9b86-392358125375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:56.920476 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751117ec-4b18-4b40-9b86-392358125375 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:56.921212 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751117ec-4b18-4b40-9b86-392358125375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:56.923488 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751117ec-4b18-4b40-9b86-392358125375 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:56.939272 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1319/2628] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:00:56 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:00:56.943219 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c013ca5-03e0-44f6-829e-cf9442e9154c admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:56.959471 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1310/2629] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:00:56 2022] POST /identity/v3/users => generated 288 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:00:56.963041 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751117ec-4b18-4b40-9b86-392358125375 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:56.964011 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c013ca5-03e0-44f6-829e-cf9442e9154c admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:56.969129 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb2426-ce55-4d65-81f7-948dce1bb508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:56.969831 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb2426-ce55-4d65-81f7-948dce1bb508 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:56.970198 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb2426-ce55-4d65-81f7-948dce1bb508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:56.970542 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb2426-ce55-4d65-81f7-948dce1bb508 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:56.971258 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb2426-ce55-4d65-81f7-948dce1bb508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:56.972936 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb2426-ce55-4d65-81f7-948dce1bb508 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:56.978136 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751117ec-4b18-4b40-9b86-392358125375 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:56.985885 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08160e-fa2d-463c-9e9f-dd68c90d83ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:56.986803 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08160e-fa2d-463c-9e9f-dd68c90d83ec admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:56.987297 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08160e-fa2d-463c-9e9f-dd68c90d83ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:56.987572 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08160e-fa2d-463c-9e9f-dd68c90d83ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:56.988350 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08160e-fa2d-463c-9e9f-dd68c90d83ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:56.988773 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1320/2630] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:56.990524 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08160e-fa2d-463c-9e9f-dd68c90d83ec admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:56.992916 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb2426-ce55-4d65-81f7-948dce1bb508 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:57.005760 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1311/2631] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:57.009627 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08160e-fa2d-463c-9e9f-dd68c90d83ec admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:57.011336 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb2426-ce55-4d65-81f7-948dce1bb508 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:57.018359 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277be66-553c-48d4-bf0d-c88b946daf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:57.019275 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277be66-553c-48d4-bf0d-c88b946daf5a admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:57.019516 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277be66-553c-48d4-bf0d-c88b946daf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:57.019882 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277be66-553c-48d4-bf0d-c88b946daf5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:57.020718 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9277be66-553c-48d4-bf0d-c88b946daf5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:57.022543 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9277be66-553c-48d4-bf0d-c88b946daf5a admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:57.023502 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08160e-fa2d-463c-9e9f-dd68c90d83ec admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:57.029809 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1b9a0-bcb1-4416-9cfb-7a3c7961e773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:57.030541 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1b9a0-bcb1-4416-9cfb-7a3c7961e773 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:57.030843 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1b9a0-bcb1-4416-9cfb-7a3c7961e773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:57.031120 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1b9a0-bcb1-4416-9cfb-7a3c7961e773 admin admin] PATH_INFO: `/v3/projects/48b6ddde72b043af9f7cd96107960576/users/68531d362f624f0c83ff11ac4244ddac/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:57.041182 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1321/2632] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:57.045209 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277be66-553c-48d4-bf0d-c88b946daf5a admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:57.052214 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e1b9a0-bcb1-4416-9cfb-7a3c7961e773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48b6ddde72b043af9f7cd96107960576, user_id=68531d362f624f0c83ff11ac4244ddac, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:57.056759 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e1b9a0-bcb1-4416-9cfb-7a3c7961e773 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:57.057174 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277be66-553c-48d4-bf0d-c88b946daf5a admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:57.068889 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397dd2d-0539-4624-9394-518229526de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:57.069919 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397dd2d-0539-4624-9394-518229526de3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:57.070370 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397dd2d-0539-4624-9394-518229526de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:57.070787 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397dd2d-0539-4624-9394-518229526de3 admin admin] PATH_INFO: `/v3/projects/42b135dcbd17440bae52fae8b9d99a15/users/ddf231e3d2f944a0aa1adc87579da2d4/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:57.079540 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1312/2633] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:00:57 2022] PUT /identity/v3/projects/48b6ddde72b043af9f7cd96107960576/users/68531d362f624f0c83ff11ac4244ddac/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:57.084737 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1b9a0-bcb1-4416-9cfb-7a3c7961e773 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:57.094074 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397dd2d-0539-4624-9394-518229526de3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42b135dcbd17440bae52fae8b9d99a15, user_id=ddf231e3d2f944a0aa1adc87579da2d4, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:57.100795 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397dd2d-0539-4624-9394-518229526de3 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:57.122352 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1322/2634] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:00:57 2022] PUT /identity/v3/projects/42b135dcbd17440bae52fae8b9d99a15/users/ddf231e3d2f944a0aa1adc87579da2d4/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:57.134418 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa395736-9913-408e-aba9-31874c6111b9 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:57.134706 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa395736-9913-408e-aba9-31874c6111b9 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:57.135102 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa395736-9913-408e-aba9-31874c6111b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:57.173432 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-fa395736-9913-408e-aba9-31874c6111b9 None None] MFA Rules not processed for user `ddf231e3d2f944a0aa1adc87579da2d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:57.174547 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-fa395736-9913-408e-aba9-31874c6111b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:57.179186 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1b9a0-bcb1-4416-9cfb-7a3c7961e773 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:57.248134 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1323/2635] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:00:57.249470 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b6f4b-e1f4-460a-a79e-3acf7b8b6cbe None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:57.249753 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b6f4b-e1f4-460a-a79e-3acf7b8b6cbe None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:57.250112 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b6f4b-e1f4-460a-a79e-3acf7b8b6cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:57.291976 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-9d8b6f4b-e1f4-460a-a79e-3acf7b8b6cbe None None] MFA Rules not processed for user `d9e0ee03c3d440049eb1ac9dc3fbe02d`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:57.294701 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9d8b6f4b-e1f4-460a-a79e-3acf7b8b6cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:57.304305 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e141b7-7b6c-438f-a03f-b2426b01ba2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:57.305032 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e141b7-7b6c-438f-a03f-b2426b01ba2f admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:57.305911 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e141b7-7b6c-438f-a03f-b2426b01ba2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:57.306366 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e141b7-7b6c-438f-a03f-b2426b01ba2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:57.307276 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e141b7-7b6c-438f-a03f-b2426b01ba2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:57.310535 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e141b7-7b6c-438f-a03f-b2426b01ba2f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:57.330820 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1313/2636] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:57.330820 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e141b7-7b6c-438f-a03f-b2426b01ba2f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:57.331530 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d5e141b7-7b6c-438f-a03f-b2426b01ba2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:57.366961 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:57.368283 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:57.386948 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1324/2637] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:57.387896 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b6f4b-e1f4-460a-a79e-3acf7b8b6cbe None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:57.421715 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b6f4b-e1f4-460a-a79e-3acf7b8b6cbe None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:57.427262 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a1024-68cf-4be0-a89b-a6624018a314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:57.428305 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a1024-68cf-4be0-a89b-a6624018a314 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:57.428305 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a1024-68cf-4be0-a89b-a6624018a314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:57.428528 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a1024-68cf-4be0-a89b-a6624018a314 admin admin] PATH_INFO: `/v3/projects/48b6ddde72b043af9f7cd96107960576/users/68531d362f624f0c83ff11ac4244ddac/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:57.430805 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a1024-68cf-4be0-a89b-a6624018a314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48b6ddde72b043af9f7cd96107960576, user_id=68531d362f624f0c83ff11ac4244ddac, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:57.433573 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a1024-68cf-4be0-a89b-a6624018a314 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:57.458189 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1325/2638] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:00:57 2022] PUT /identity/v3/projects/48b6ddde72b043af9f7cd96107960576/users/68531d362f624f0c83ff11ac4244ddac/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:57.458189 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a1024-68cf-4be0-a89b-a6624018a314 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:57.458189 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e55a1024-68cf-4be0-a89b-a6624018a314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:57.473276 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e141b7-7b6c-438f-a03f-b2426b01ba2f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:57.557749 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a1024-68cf-4be0-a89b-a6624018a314 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:57.566673 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f2c6f-bb1f-40b5-967b-4354e68cdcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:57.567329 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f2c6f-bb1f-40b5-967b-4354e68cdcfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:57.567610 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f2c6f-bb1f-40b5-967b-4354e68cdcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:57.567884 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f2c6f-bb1f-40b5-967b-4354e68cdcfe admin admin] PATH_INFO: `/v3/users/a5f2bfa67a284927b795f966741d8081` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:57.569773 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3f2c6f-bb1f-40b5-967b-4354e68cdcfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5f2bfa67a284927b795f966741d8081)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:57.571307 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80c0ec-0c47-4896-8149-fefc018dca0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:57.571874 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80c0ec-0c47-4896-8149-fefc018dca0f service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:57.572150 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80c0ec-0c47-4896-8149-fefc018dca0f service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:57.572419 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80c0ec-0c47-4896-8149-fefc018dca0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:57.572761 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3f2c6f-bb1f-40b5-967b-4354e68cdcfe admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:57.643167 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-fd3f2c6f-bb1f-40b5-967b-4354e68cdcfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5f2bfa67a284927b795f966741d8081'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:57.646971 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80c0ec-0c47-4896-8149-fefc018dca0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:57.648591 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80c0ec-0c47-4896-8149-fefc018dca0f service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:57.654186 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-fd3f2c6f-bb1f-40b5-967b-4354e68cdcfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5f2bfa67a284927b795f966741d8081'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:57.659398 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1314/2639] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:57.660994 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801e95d-bd26-430a-9fcc-795b4f862c5d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:57.661316 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801e95d-bd26-430a-9fcc-795b4f862c5d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:57.661586 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801e95d-bd26-430a-9fcc-795b4f862c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:57.690652 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-fd3f2c6f-bb1f-40b5-967b-4354e68cdcfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5f2bfa67a284927b795f966741d8081'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:57.711309 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-fd3f2c6f-bb1f-40b5-967b-4354e68cdcfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5f2bfa67a284927b795f966741d8081'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:57.712087 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f801e95d-bd26-430a-9fcc-795b4f862c5d None None] MFA Rules not processed for user `68531d362f624f0c83ff11ac4244ddac`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:57.712495 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-fd3f2c6f-bb1f-40b5-967b-4354e68cdcfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5f2bfa67a284927b795f966741d8081'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:57.715212 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f801e95d-bd26-430a-9fcc-795b4f862c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:57.741273 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1326/2640] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:00:57 2022] DELETE /identity/v3/users/a5f2bfa67a284927b795f966741d8081 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:57.834664 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:57.885526 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1315/2641] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:57.907314 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f2c6f-bb1f-40b5-967b-4354e68cdcfe admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:57.910883 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-fd3f2c6f-bb1f-40b5-967b-4354e68cdcfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:57.998944 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f2c6f-bb1f-40b5-967b-4354e68cdcfe admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:58.026860 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0a325-1a91-4bcb-b7ac-fa5dda6a6450 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:58.028595 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0a325-1a91-4bcb-b7ac-fa5dda6a6450 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:58.028897 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0a325-1a91-4bcb-b7ac-fa5dda6a6450 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:58.029162 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0a325-1a91-4bcb-b7ac-fa5dda6a6450 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:58.063312 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:58.065699 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801e95d-bd26-430a-9fcc-795b4f862c5d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:58.082827 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f801e95d-bd26-430a-9fcc-795b4f862c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:58.116543 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801e95d-bd26-430a-9fcc-795b4f862c5d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:58.216891 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0a325-1a91-4bcb-b7ac-fa5dda6a6450 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:58.218512 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0a325-1a91-4bcb-b7ac-fa5dda6a6450 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:58.221999 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee75ffa-ecfd-43e8-a0a8-b5bfc49014cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:58.224403 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee75ffa-ecfd-43e8-a0a8-b5bfc49014cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:58.224761 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee75ffa-ecfd-43e8-a0a8-b5bfc49014cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:58.225108 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee75ffa-ecfd-43e8-a0a8-b5bfc49014cf admin admin] PATH_INFO: `/v3/projects/67d8fefaf89c436ca32731f9e1c45213` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:58.226457 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee75ffa-ecfd-43e8-a0a8-b5bfc49014cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=67d8fefaf89c436ca32731f9e1c45213)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:58.228525 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee75ffa-ecfd-43e8-a0a8-b5bfc49014cf admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:58.229787 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1327/2642] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:58.232830 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0a325-1a91-4bcb-b7ac-fa5dda6a6450 service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:58.234221 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f1c0a325-1a91-4bcb-b7ac-fa5dda6a6450 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:58.252526 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0a325-1a91-4bcb-b7ac-fa5dda6a6450 service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:58.257903 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ba647-b227-4286-858b-7e73b3429091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:58.258685 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ba647-b227-4286-858b-7e73b3429091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:58.259126 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ba647-b227-4286-858b-7e73b3429091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:58.259509 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ba647-b227-4286-858b-7e73b3429091 admin admin] PATH_INFO: `/v3/users/ddf231e3d2f944a0aa1adc87579da2d4` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:58.260800 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ba647-b227-4286-858b-7e73b3429091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddf231e3d2f944a0aa1adc87579da2d4)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:58.263259 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ba647-b227-4286-858b-7e73b3429091 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:58.319671 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3ee75ffa-ecfd-43e8-a0a8-b5bfc49014cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67d8fefaf89c436ca32731f9e1c45213', 'request_id': 'req-3ee75ffa-ecfd-43e8-a0a8-b5bfc49014cf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:58.327461 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-2f0ba647-b227-4286-858b-7e73b3429091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddf231e3d2f944a0aa1adc87579da2d4'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:58.328883 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3ee75ffa-ecfd-43e8-a0a8-b5bfc49014cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67d8fefaf89c436ca32731f9e1c45213', 'request_id': 'req-3ee75ffa-ecfd-43e8-a0a8-b5bfc49014cf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:58.335476 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-2f0ba647-b227-4286-858b-7e73b3429091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddf231e3d2f944a0aa1adc87579da2d4'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:58.336292 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3ee75ffa-ecfd-43e8-a0a8-b5bfc49014cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67d8fefaf89c436ca32731f9e1c45213', 'request_id': 'req-3ee75ffa-ecfd-43e8-a0a8-b5bfc49014cf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:58.345269 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-2f0ba647-b227-4286-858b-7e73b3429091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddf231e3d2f944a0aa1adc87579da2d4'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:58.356049 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3ee75ffa-ecfd-43e8-a0a8-b5bfc49014cf admin admin] The token cache is being invalidate because project 67d8fefaf89c436ca32731f9e1c45213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:00:58.356534 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3ee75ffa-ecfd-43e8-a0a8-b5bfc49014cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:58.358703 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3ee75ffa-ecfd-43e8-a0a8-b5bfc49014cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:58.362460 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-2f0ba647-b227-4286-858b-7e73b3429091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddf231e3d2f944a0aa1adc87579da2d4'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:58.363039 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1316/2643] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:00:58 2022] DELETE /identity/v3/projects/67d8fefaf89c436ca32731f9e1c45213 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:58.365924 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee75ffa-ecfd-43e8-a0a8-b5bfc49014cf admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:58.366604 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-2f0ba647-b227-4286-858b-7e73b3429091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddf231e3d2f944a0aa1adc87579da2d4'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:58.366747 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3ee75ffa-ecfd-43e8-a0a8-b5bfc49014cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:58.374082 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1328/2644] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:00:58 2022] DELETE /identity/v3/users/ddf231e3d2f944a0aa1adc87579da2d4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:58.375158 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ba647-b227-4286-858b-7e73b3429091 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:58.377179 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-2f0ba647-b227-4286-858b-7e73b3429091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:58.436795 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee75ffa-ecfd-43e8-a0a8-b5bfc49014cf admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:58.465418 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ba647-b227-4286-858b-7e73b3429091 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:58.471141 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dab029-79c8-4cd6-9d6f-4c73e4a4d6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:58.472178 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dab029-79c8-4cd6-9d6f-4c73e4a4d6ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:58.473360 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dab029-79c8-4cd6-9d6f-4c73e4a4d6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:58.473793 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dab029-79c8-4cd6-9d6f-4c73e4a4d6ab admin admin] PATH_INFO: `/v3/users/437b902e0a114036a1fcceb8fb0593e9` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:58.475167 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dab029-79c8-4cd6-9d6f-4c73e4a4d6ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=437b902e0a114036a1fcceb8fb0593e9)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:58.477465 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dab029-79c8-4cd6-9d6f-4c73e4a4d6ab admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:58.478839 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:58.507586 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f3d43-ebb3-4660-9b5d-3849a1180420 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:58.508243 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f3d43-ebb3-4660-9b5d-3849a1180420 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:58.508488 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f3d43-ebb3-4660-9b5d-3849a1180420 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:58.508751 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f3d43-ebb3-4660-9b5d-3849a1180420 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:58.512732 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-470f3d43-ebb3-4660-9b5d-3849a1180420 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:58.541281 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:58.577642 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-a0dab029-79c8-4cd6-9d6f-4c73e4a4d6ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '437b902e0a114036a1fcceb8fb0593e9'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:58.587603 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-a0dab029-79c8-4cd6-9d6f-4c73e4a4d6ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '437b902e0a114036a1fcceb8fb0593e9'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:58.600464 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-a0dab029-79c8-4cd6-9d6f-4c73e4a4d6ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '437b902e0a114036a1fcceb8fb0593e9'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:58.619689 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-a0dab029-79c8-4cd6-9d6f-4c73e4a4d6ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '437b902e0a114036a1fcceb8fb0593e9'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:58.620525 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-a0dab029-79c8-4cd6-9d6f-4c73e4a4d6ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '437b902e0a114036a1fcceb8fb0593e9'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:58.625351 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f3d43-ebb3-4660-9b5d-3849a1180420 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:58.626879 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f3d43-ebb3-4660-9b5d-3849a1180420 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:58.627951 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1329/2645] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:00:58 2022] DELETE /identity/v3/users/437b902e0a114036a1fcceb8fb0593e9 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:58.629109 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0d22d-d5a7-43e1-bfbd-e44230456914 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:58.629461 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0d22d-d5a7-43e1-bfbd-e44230456914 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:58.629736 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0d22d-d5a7-43e1-bfbd-e44230456914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:58.641346 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1317/2646] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:58.651269 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-98a0d22d-d5a7-43e1-bfbd-e44230456914 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:58.652644 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-98a0d22d-d5a7-43e1-bfbd-e44230456914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:58.741086 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1330/2647] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:58.753349 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f3d43-ebb3-4660-9b5d-3849a1180420 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:58.758718 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-470f3d43-ebb3-4660-9b5d-3849a1180420 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:58.847523 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f3d43-ebb3-4660-9b5d-3849a1180420 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:58.921080 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301ad17-0e17-42c2-9b25-bca699a781ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:58.928354 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301ad17-0e17-42c2-9b25-bca699a781ca service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:58.931176 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301ad17-0e17-42c2-9b25-bca699a781ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:58.931176 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301ad17-0e17-42c2-9b25-bca699a781ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:58.953662 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0d22d-d5a7-43e1-bfbd-e44230456914 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:58.955187 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301ad17-0e17-42c2-9b25-bca699a781ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:58.955530 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-98a0d22d-d5a7-43e1-bfbd-e44230456914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:58.957240 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301ad17-0e17-42c2-9b25-bca699a781ca service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:58.968756 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1318/2648] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:58.972478 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0d22d-d5a7-43e1-bfbd-e44230456914 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:58.990674 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11100f53-4869-43e3-ac93-a1604944a24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:58.991426 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11100f53-4869-43e3-ac93-a1604944a24b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:58.992644 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11100f53-4869-43e3-ac93-a1604944a24b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:58.993022 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11100f53-4869-43e3-ac93-a1604944a24b admin admin] PATH_INFO: `/v3/projects/e47d167a3de845bab83d0a74572e9f61` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:58.995085 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11100f53-4869-43e3-ac93-a1604944a24b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e47d167a3de845bab83d0a74572e9f61)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:59.011709 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11100f53-4869-43e3-ac93-a1604944a24b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:59.187095 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-11100f53-4869-43e3-ac93-a1604944a24b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e47d167a3de845bab83d0a74572e9f61', 'request_id': 'req-11100f53-4869-43e3-ac93-a1604944a24b'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:59.207233 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-11100f53-4869-43e3-ac93-a1604944a24b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e47d167a3de845bab83d0a74572e9f61', 'request_id': 'req-11100f53-4869-43e3-ac93-a1604944a24b'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:59.228650 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-11100f53-4869-43e3-ac93-a1604944a24b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e47d167a3de845bab83d0a74572e9f61', 'request_id': 'req-11100f53-4869-43e3-ac93-a1604944a24b'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:59.258585 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-11100f53-4869-43e3-ac93-a1604944a24b admin admin] The token cache is being invalidate because project e47d167a3de845bab83d0a74572e9f61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:00:59.258890 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-11100f53-4869-43e3-ac93-a1604944a24b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:59.262233 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-11100f53-4869-43e3-ac93-a1604944a24b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:59.265333 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1331/2649] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:00:58 2022] DELETE /identity/v3/projects/e47d167a3de845bab83d0a74572e9f61 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:59.270285 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a80f8-c393-4c56-82db-2c197b30def4 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:59.270669 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a80f8-c393-4c56-82db-2c197b30def4 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:59.271080 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a80f8-c393-4c56-82db-2c197b30def4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:59.312408 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c14a80f8-c393-4c56-82db-2c197b30def4 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:59.313887 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c14a80f8-c393-4c56-82db-2c197b30def4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:59.399688 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:59.428984 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1319/2650] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:59.437502 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c0c8a-d316-4081-896e-2d915644dc49 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:59.437791 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c0c8a-d316-4081-896e-2d915644dc49 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:59.438337 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c0c8a-d316-4081-896e-2d915644dc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:59.464001 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a80f8-c393-4c56-82db-2c197b30def4 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:59.465767 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c14a80f8-c393-4c56-82db-2c197b30def4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:59.490432 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a80f8-c393-4c56-82db-2c197b30def4 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:59.491113 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-492c0c8a-d316-4081-896e-2d915644dc49 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:59.492545 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-492c0c8a-d316-4081-896e-2d915644dc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:59.495511 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248f64e-01bc-4e0c-8388-22d5a28ef627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:59.496357 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248f64e-01bc-4e0c-8388-22d5a28ef627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:59.497325 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248f64e-01bc-4e0c-8388-22d5a28ef627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:59.497605 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248f64e-01bc-4e0c-8388-22d5a28ef627 admin admin] PATH_INFO: `/v3/projects/42b135dcbd17440bae52fae8b9d99a15` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:59.498989 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248f64e-01bc-4e0c-8388-22d5a28ef627 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42b135dcbd17440bae52fae8b9d99a15)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:59.501057 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248f64e-01bc-4e0c-8388-22d5a28ef627 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:59.505897 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1332/2651] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:59.513430 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c0c8a-d316-4081-896e-2d915644dc49 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:59.523859 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c0c8a-d316-4081-896e-2d915644dc49 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:59.528953 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bea3a2-6440-4c5d-8b0a-b6bc1910279f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:59.529334 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bea3a2-6440-4c5d-8b0a-b6bc1910279f admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:59.529613 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bea3a2-6440-4c5d-8b0a-b6bc1910279f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:59.529929 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bea3a2-6440-4c5d-8b0a-b6bc1910279f admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:59.530601 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bea3a2-6440-4c5d-8b0a-b6bc1910279f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:00:59.530906 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bea3a2-6440-4c5d-8b0a-b6bc1910279f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:59.532563 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bea3a2-6440-4c5d-8b0a-b6bc1910279f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:59.549374 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1333/2652] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 01:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:00:59.553607 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bea3a2-6440-4c5d-8b0a-b6bc1910279f admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:59.560236 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:59.563185 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9248f64e-01bc-4e0c-8388-22d5a28ef627 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42b135dcbd17440bae52fae8b9d99a15', 'request_id': 'req-9248f64e-01bc-4e0c-8388-22d5a28ef627'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:59.566180 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bea3a2-6440-4c5d-8b0a-b6bc1910279f admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:59.570077 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9248f64e-01bc-4e0c-8388-22d5a28ef627 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42b135dcbd17440bae52fae8b9d99a15', 'request_id': 'req-9248f64e-01bc-4e0c-8388-22d5a28ef627'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:59.580761 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9248f64e-01bc-4e0c-8388-22d5a28ef627 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42b135dcbd17440bae52fae8b9d99a15', 'request_id': 'req-9248f64e-01bc-4e0c-8388-22d5a28ef627'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:59.602298 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9248f64e-01bc-4e0c-8388-22d5a28ef627 admin admin] The token cache is being invalidate because project 42b135dcbd17440bae52fae8b9d99a15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:00:59.602598 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9248f64e-01bc-4e0c-8388-22d5a28ef627 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:59.603346 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9248f64e-01bc-4e0c-8388-22d5a28ef627 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:59.606146 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1320/2653] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:00:59 2022] DELETE /identity/v3/projects/42b135dcbd17440bae52fae8b9d99a15 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:59.612126 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb0d85-318d-454c-8318-86e4a45370da None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:59.612528 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb0d85-318d-454c-8318-86e4a45370da None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:59.612899 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb0d85-318d-454c-8318-86e4a45370da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:59.644660 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f7fb0d85-318d-454c-8318-86e4a45370da None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:59.646074 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f7fb0d85-318d-454c-8318-86e4a45370da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:59.657192 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b812b3-4f08-437a-a6e6-ffb5ca47be76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:59.657675 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b812b3-4f08-437a-a6e6-ffb5ca47be76 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:59.658372 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b812b3-4f08-437a-a6e6-ffb5ca47be76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:59.658372 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b812b3-4f08-437a-a6e6-ffb5ca47be76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:59.658853 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b812b3-4f08-437a-a6e6-ffb5ca47be76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:59.660754 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b812b3-4f08-437a-a6e6-ffb5ca47be76 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:59.692932 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1334/2654] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:00:59 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:00:59.697025 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b812b3-4f08-437a-a6e6-ffb5ca47be76 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:59.698751 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-70b812b3-4f08-437a-a6e6-ffb5ca47be76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:59.711293 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1321/2655] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:59.719585 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbfcef-06b5-4898-bcd0-fd4f913ce8e7 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:59.720002 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbfcef-06b5-4898-bcd0-fd4f913ce8e7 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:59.720119 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbfcef-06b5-4898-bcd0-fd4f913ce8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:59.742382 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-36bbfcef-06b5-4898-bcd0-fd4f913ce8e7 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:59.744172 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-36bbfcef-06b5-4898-bcd0-fd4f913ce8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:59.767033 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b812b3-4f08-437a-a6e6-ffb5ca47be76 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:59.771832 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac12a1-afad-4f39-87fe-801416d2ec73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:59.772600 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac12a1-afad-4f39-87fe-801416d2ec73 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:59.772797 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac12a1-afad-4f39-87fe-801416d2ec73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:59.773081 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac12a1-afad-4f39-87fe-801416d2ec73 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:59.773746 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac12a1-afad-4f39-87fe-801416d2ec73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:59.775970 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac12a1-afad-4f39-87fe-801416d2ec73 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:59.802413 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1335/2656] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:00:59 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:00:59.803518 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac12a1-afad-4f39-87fe-801416d2ec73 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:59.813651 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1322/2657] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:00:59.814242 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac12a1-afad-4f39-87fe-801416d2ec73 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:59.817743 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbfcef-06b5-4898-bcd0-fd4f913ce8e7 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:59.819611 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674ab9a-e077-40f2-a9b0-7615b8ae46bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:59.820216 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674ab9a-e077-40f2-a9b0-7615b8ae46bf admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:59.820495 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674ab9a-e077-40f2-a9b0-7615b8ae46bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:59.820764 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674ab9a-e077-40f2-a9b0-7615b8ae46bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:59.821405 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6674ab9a-e077-40f2-a9b0-7615b8ae46bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:59.823111 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6674ab9a-e077-40f2-a9b0-7615b8ae46bf admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:59.829826 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbfcef-06b5-4898-bcd0-fd4f913ce8e7 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:59.834317 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1336/2658] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:00:59.841360 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674ab9a-e077-40f2-a9b0-7615b8ae46bf admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:59.841632 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729cdb1-1f26-4c4e-a5e5-ccbd6b4259e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:59.841632 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729cdb1-1f26-4c4e-a5e5-ccbd6b4259e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:59.841632 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729cdb1-1f26-4c4e-a5e5-ccbd6b4259e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:59.841632 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729cdb1-1f26-4c4e-a5e5-ccbd6b4259e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:59.842063 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e729cdb1-1f26-4c4e-a5e5-ccbd6b4259e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:00:59.842063 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e729cdb1-1f26-4c4e-a5e5-ccbd6b4259e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:59.843768 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e729cdb1-1f26-4c4e-a5e5-ccbd6b4259e5 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:59.849092 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674ab9a-e077-40f2-a9b0-7615b8ae46bf admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:59.851336 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:59.854473 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957fb9b-216a-4ac5-9e9c-c388488a8b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:59.855051 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957fb9b-216a-4ac5-9e9c-c388488a8b84 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:59.855334 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957fb9b-216a-4ac5-9e9c-c388488a8b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:59.855610 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957fb9b-216a-4ac5-9e9c-c388488a8b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:59.856783 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957fb9b-216a-4ac5-9e9c-c388488a8b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:59.861384 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1323/2659] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 01:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:00:59.861562 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957fb9b-216a-4ac5-9e9c-c388488a8b84 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:59.862657 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729cdb1-1f26-4c4e-a5e5-ccbd6b4259e5 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:59.870278 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1337/2660] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:00:59.875865 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957fb9b-216a-4ac5-9e9c-c388488a8b84 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:59.876524 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729cdb1-1f26-4c4e-a5e5-ccbd6b4259e5 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:59.881223 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6070ec-cbe8-4915-9476-80f6c104b924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:59.881825 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6070ec-cbe8-4915-9476-80f6c104b924 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:59.882133 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6070ec-cbe8-4915-9476-80f6c104b924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:59.882412 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6070ec-cbe8-4915-9476-80f6c104b924 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:59.883036 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6070ec-cbe8-4915-9476-80f6c104b924 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:59.885223 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6070ec-cbe8-4915-9476-80f6c104b924 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:59.888092 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957fb9b-216a-4ac5-9e9c-c388488a8b84 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:59.892927 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2dc2fd-5b8a-4283-9223-133c080ee741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:59.893803 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2dc2fd-5b8a-4283-9223-133c080ee741 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:59.894258 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2dc2fd-5b8a-4283-9223-133c080ee741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:59.894615 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2dc2fd-5b8a-4283-9223-133c080ee741 admin admin] PATH_INFO: `/v3/projects/f1467f97a2dc4771b885539c4d55b45e/users/f80f2682b2894a5180660d09f0bbf9ba/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:59.910575 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2dc2fd-5b8a-4283-9223-133c080ee741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1467f97a2dc4771b885539c4d55b45e, user_id=f80f2682b2894a5180660d09f0bbf9ba, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:59.913585 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2dc2fd-5b8a-4283-9223-133c080ee741 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:59.922966 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1324/2661] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:00:59 2022] POST /identity/v3/projects => generated 357 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:00:59.927046 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6070ec-cbe8-4915-9476-80f6c104b924 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:59.928955 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1338/2662] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:00:59 2022] PUT /identity/v3/projects/f1467f97a2dc4771b885539c4d55b45e/users/f80f2682b2894a5180660d09f0bbf9ba/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:00:59.940907 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca8dfe-c724-44ab-aaa9-9b0f7b2ed377 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:59.941197 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca8dfe-c724-44ab-aaa9-9b0f7b2ed377 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:59.941541 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca8dfe-c724-44ab-aaa9-9b0f7b2ed377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:59.970960 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-ffca8dfe-c724-44ab-aaa9-9b0f7b2ed377 None None] MFA Rules not processed for user `f80f2682b2894a5180660d09f0bbf9ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:59.972063 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ffca8dfe-c724-44ab-aaa9-9b0f7b2ed377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:59.994268 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:59.994805 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6070ec-cbe8-4915-9476-80f6c104b924 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:00.001611 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1df25-9d35-4f59-8740-0d4dcfc8cc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:00.002269 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1df25-9d35-4f59-8740-0d4dcfc8cc9f admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:00.002562 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1df25-9d35-4f59-8740-0d4dcfc8cc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:00.002806 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1df25-9d35-4f59-8740-0d4dcfc8cc9f admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:00.003440 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1df25-9d35-4f59-8740-0d4dcfc8cc9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:00.005414 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1df25-9d35-4f59-8740-0d4dcfc8cc9f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:00.032071 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1325/2663] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:00:59 2022] POST /identity/v3/users => generated 279 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:01:00.033154 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1df25-9d35-4f59-8740-0d4dcfc8cc9f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:00.043864 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1df25-9d35-4f59-8740-0d4dcfc8cc9f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:00.049010 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3eac5-d5e2-42ab-ba29-57bb7e47eb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:00.049636 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3eac5-d5e2-42ab-ba29-57bb7e47eb55 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:00.050085 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3eac5-d5e2-42ab-ba29-57bb7e47eb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:00.050359 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3eac5-d5e2-42ab-ba29-57bb7e47eb55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:00.051016 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb3eac5-d5e2-42ab-ba29-57bb7e47eb55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:00.051157 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1339/2664] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:00:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:01:00.052634 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb3eac5-d5e2-42ab-ba29-57bb7e47eb55 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:00.055543 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca8dfe-c724-44ab-aaa9-9b0f7b2ed377 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:00.066003 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1326/2665] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:01:00.066540 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca8dfe-c724-44ab-aaa9-9b0f7b2ed377 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:00.066981 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3eac5-d5e2-42ab-ba29-57bb7e47eb55 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:00.071268 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe2863-e253-43c5-ac92-5e3f0107d65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:00.071909 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe2863-e253-43c5-ac92-5e3f0107d65d admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:00.072195 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe2863-e253-43c5-ac92-5e3f0107d65d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:00.072477 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe2863-e253-43c5-ac92-5e3f0107d65d admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:00.073411 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe2863-e253-43c5-ac92-5e3f0107d65d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:00.075422 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe2863-e253-43c5-ac92-5e3f0107d65d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:00.077999 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3eac5-d5e2-42ab-ba29-57bb7e47eb55 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:00.082787 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f4e02-9941-4f5d-be1b-a2f7c7f5c371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:00.083389 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f4e02-9941-4f5d-be1b-a2f7c7f5c371 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:00.083670 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f4e02-9941-4f5d-be1b-a2f7c7f5c371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:00.083943 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f4e02-9941-4f5d-be1b-a2f7c7f5c371 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:00.084585 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f4e02-9941-4f5d-be1b-a2f7c7f5c371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:00.086391 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f4e02-9941-4f5d-be1b-a2f7c7f5c371 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:00.102858 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1327/2666] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:01:00.108105 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f4e02-9941-4f5d-be1b-a2f7c7f5c371 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:00.117884 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1340/2667] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:01:00 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:01:00.120520 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe2863-e253-43c5-ac92-5e3f0107d65d admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:00.122872 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f4e02-9941-4f5d-be1b-a2f7c7f5c371 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:00.202463 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef426368-128b-4c02-8156-a12ebe4ca2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:00.203147 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef426368-128b-4c02-8156-a12ebe4ca2e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:00.203416 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef426368-128b-4c02-8156-a12ebe4ca2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:00.203704 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef426368-128b-4c02-8156-a12ebe4ca2e9 admin admin] PATH_INFO: `/v3/projects/5e207ee3176849e2b4c373cd988d0162/users/45ab203af5da42699bbe0c9658411a9f/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:00.220186 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe2863-e253-43c5-ac92-5e3f0107d65d admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:00.226641 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc275c-afe6-4e21-be15-829b172b9cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:00.227386 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc275c-afe6-4e21-be15-829b172b9cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:00.227724 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc275c-afe6-4e21-be15-829b172b9cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:00.228067 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc275c-afe6-4e21-be15-829b172b9cd6 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:00.228394 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef426368-128b-4c02-8156-a12ebe4ca2e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e207ee3176849e2b4c373cd988d0162, user_id=45ab203af5da42699bbe0c9658411a9f, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:00.228831 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc275c-afe6-4e21-be15-829b172b9cd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:00.231664 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc275c-afe6-4e21-be15-829b172b9cd6 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:00.233324 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef426368-128b-4c02-8156-a12ebe4ca2e9 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:00.253424 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1328/2668] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:00 2022] PUT /identity/v3/projects/5e207ee3176849e2b4c373cd988d0162/users/45ab203af5da42699bbe0c9658411a9f/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:00.266556 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb00efd-7fe9-42de-8f15-e4aa1d394253 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:00.266929 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb00efd-7fe9-42de-8f15-e4aa1d394253 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:00.267266 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb00efd-7fe9-42de-8f15-e4aa1d394253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:00.270959 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1341/2669] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:01:00 2022] POST /identity/v3/users => generated 299 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:00.275073 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc275c-afe6-4e21-be15-829b172b9cd6 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:00.287082 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc275c-afe6-4e21-be15-829b172b9cd6 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:00.310415 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-ccb00efd-7fe9-42de-8f15-e4aa1d394253 None None] MFA Rules not processed for user `45ab203af5da42699bbe0c9658411a9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:00.312205 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ccb00efd-7fe9-42de-8f15-e4aa1d394253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:00.333576 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:00.371638 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c521d9-c929-42ab-b3e1-551581ff10a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:00.372576 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c521d9-c929-42ab-b3e1-551581ff10a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:00.372930 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c521d9-c929-42ab-b3e1-551581ff10a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:00.373271 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c521d9-c929-42ab-b3e1-551581ff10a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:00.374038 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c521d9-c929-42ab-b3e1-551581ff10a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:00.375863 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c521d9-c929-42ab-b3e1-551581ff10a5 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:00.394004 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1342/2670] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:00.394989 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c521d9-c929-42ab-b3e1-551581ff10a5 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:00.411691 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c521d9-c929-42ab-b3e1-551581ff10a5 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:00.416702 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75b854-edcf-4d39-9106-d9cb976074c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:00.417394 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75b854-edcf-4d39-9106-d9cb976074c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:00.418028 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75b854-edcf-4d39-9106-d9cb976074c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:00.418581 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75b854-edcf-4d39-9106-d9cb976074c3 admin admin] PATH_INFO: `/v3/projects/b811193ad88d4813818bd7ecd7abdb91/users/8102ba891a88425bb2e426983e4aa841/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:00.436492 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75b854-edcf-4d39-9106-d9cb976074c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b811193ad88d4813818bd7ecd7abdb91, user_id=8102ba891a88425bb2e426983e4aa841, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:00.437692 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1329/2671] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:00 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:00.440576 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75b854-edcf-4d39-9106-d9cb976074c3 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:00.442097 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb00efd-7fe9-42de-8f15-e4aa1d394253 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:00.454696 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb00efd-7fe9-42de-8f15-e4aa1d394253 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:00.456779 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1343/2672] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:00 2022] PUT /identity/v3/projects/b811193ad88d4813818bd7ecd7abdb91/users/8102ba891a88425bb2e426983e4aa841/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:01:00.461787 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75b854-edcf-4d39-9106-d9cb976074c3 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:00.466830 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:00.546535 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e8160-32d7-47dd-9e0f-86ccd761a9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:00.547166 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e8160-32d7-47dd-9e0f-86ccd761a9f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:00.547447 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e8160-32d7-47dd-9e0f-86ccd761a9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:00.547766 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e8160-32d7-47dd-9e0f-86ccd761a9f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:00.548441 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e8160-32d7-47dd-9e0f-86ccd761a9f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:00.550405 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e8160-32d7-47dd-9e0f-86ccd761a9f7 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:00.550579 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75b854-edcf-4d39-9106-d9cb976074c3 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:00.555563 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da7219-ff72-42f7-a6ea-b73d632b574b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:00.556496 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da7219-ff72-42f7-a6ea-b73d632b574b admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:00.556774 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da7219-ff72-42f7-a6ea-b73d632b574b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:00.557047 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da7219-ff72-42f7-a6ea-b73d632b574b admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:00.557932 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da7219-ff72-42f7-a6ea-b73d632b574b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:00.559927 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da7219-ff72-42f7-a6ea-b73d632b574b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:00.573872 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1344/2673] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:00.578039 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da7219-ff72-42f7-a6ea-b73d632b574b admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:00.580006 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1330/2674] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:01:00 2022] POST /identity/v3/projects => generated 355 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:01:00.584043 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e8160-32d7-47dd-9e0f-86ccd761a9f7 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:00.589141 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da7219-ff72-42f7-a6ea-b73d632b574b admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:00.649344 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a51b05-65a3-4339-9288-c311dfb863b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:00.649918 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e8160-32d7-47dd-9e0f-86ccd761a9f7 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:00.650122 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a51b05-65a3-4339-9288-c311dfb863b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:00.650476 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a51b05-65a3-4339-9288-c311dfb863b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:00.650752 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a51b05-65a3-4339-9288-c311dfb863b1 admin admin] PATH_INFO: `/v3/projects/b811193ad88d4813818bd7ecd7abdb91/users/8102ba891a88425bb2e426983e4aa841/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:00.652875 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a51b05-65a3-4339-9288-c311dfb863b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b811193ad88d4813818bd7ecd7abdb91, user_id=8102ba891a88425bb2e426983e4aa841, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:00.655703 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a51b05-65a3-4339-9288-c311dfb863b1 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:00.656910 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097cce9-a1aa-4ab6-a471-e73e18ae2319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:00.657820 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097cce9-a1aa-4ab6-a471-e73e18ae2319 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:00.658327 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097cce9-a1aa-4ab6-a471-e73e18ae2319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:00.658547 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097cce9-a1aa-4ab6-a471-e73e18ae2319 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:00.659191 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097cce9-a1aa-4ab6-a471-e73e18ae2319 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:00.661167 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097cce9-a1aa-4ab6-a471-e73e18ae2319 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:00.668914 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1345/2675] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:00 2022] PUT /identity/v3/projects/b811193ad88d4813818bd7ecd7abdb91/users/8102ba891a88425bb2e426983e4aa841/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:01:00.679208 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318f627-5d22-4060-8790-00961fd07b5c None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:00.679496 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318f627-5d22-4060-8790-00961fd07b5c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:00.679770 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318f627-5d22-4060-8790-00961fd07b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:00.687207 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1331/2676] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:01:00 2022] POST /identity/v3/users => generated 284 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:01:00.689799 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097cce9-a1aa-4ab6-a471-e73e18ae2319 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:00.699821 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097cce9-a1aa-4ab6-a471-e73e18ae2319 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:00.709241 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-8318f627-5d22-4060-8790-00961fd07b5c None None] MFA Rules not processed for user `8102ba891a88425bb2e426983e4aa841`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:00.710499 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8318f627-5d22-4060-8790-00961fd07b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:00.732883 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:00.761879 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753937f-0ab0-48e0-b3ec-4a49ac757aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:00.762978 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753937f-0ab0-48e0-b3ec-4a49ac757aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:00.763253 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753937f-0ab0-48e0-b3ec-4a49ac757aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:00.763532 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753937f-0ab0-48e0-b3ec-4a49ac757aa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:00.764179 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753937f-0ab0-48e0-b3ec-4a49ac757aa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:00.765816 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753937f-0ab0-48e0-b3ec-4a49ac757aa3 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:00.777242 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1332/2677] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:01:00.781357 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1346/2678] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:01:00.781580 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753937f-0ab0-48e0-b3ec-4a49ac757aa3 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:00.792072 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753937f-0ab0-48e0-b3ec-4a49ac757aa3 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:00.792664 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318f627-5d22-4060-8790-00961fd07b5c None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:00.794157 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8318f627-5d22-4060-8790-00961fd07b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:00.796950 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b3e68-b9a2-4a1b-9a38-ea2347a23925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:00.797599 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b3e68-b9a2-4a1b-9a38-ea2347a23925 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:00.797874 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b3e68-b9a2-4a1b-9a38-ea2347a23925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:00.798177 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b3e68-b9a2-4a1b-9a38-ea2347a23925 admin admin] PATH_INFO: `/v3/projects/9804cee0c18049098ddbd5a5fcfa7aea/users/6f11549356ee45f38032235291ac4af3/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:00.814115 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b3e68-b9a2-4a1b-9a38-ea2347a23925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9804cee0c18049098ddbd5a5fcfa7aea, user_id=6f11549356ee45f38032235291ac4af3, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:00.816911 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b3e68-b9a2-4a1b-9a38-ea2347a23925 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:00.818725 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:00.832467 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1333/2679] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:00 2022] PUT /identity/v3/projects/9804cee0c18049098ddbd5a5fcfa7aea/users/6f11549356ee45f38032235291ac4af3/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:01:00.836439 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b3e68-b9a2-4a1b-9a38-ea2347a23925 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:00.861974 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318f627-5d22-4060-8790-00961fd07b5c None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:00.899946 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b3e68-b9a2-4a1b-9a38-ea2347a23925 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:00.905215 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1723d-e886-4053-85bf-1197f9a8c829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:00.905877 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1723d-e886-4053-85bf-1197f9a8c829 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:00.906169 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1723d-e886-4053-85bf-1197f9a8c829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:00.906426 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1723d-e886-4053-85bf-1197f9a8c829 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:00.907080 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1723d-e886-4053-85bf-1197f9a8c829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:00.908735 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1723d-e886-4053-85bf-1197f9a8c829 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:00.918690 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e7bb1-82a0-4030-b833-8d5f359275b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:00.919294 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e7bb1-82a0-4030-b833-8d5f359275b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:00.919574 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e7bb1-82a0-4030-b833-8d5f359275b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:00.919724 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1334/2680] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:01:00.919841 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e7bb1-82a0-4030-b833-8d5f359275b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:00.923803 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1723d-e886-4053-85bf-1197f9a8c829 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:00.933155 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1723d-e886-4053-85bf-1197f9a8c829 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:00.938060 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4cb06-2afd-4cac-bfb1-17b6da9c74fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:00.938784 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4cb06-2afd-4cac-bfb1-17b6da9c74fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:00.939066 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4cb06-2afd-4cac-bfb1-17b6da9c74fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:00.939443 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4cb06-2afd-4cac-bfb1-17b6da9c74fb admin admin] PATH_INFO: `/v3/projects/9804cee0c18049098ddbd5a5fcfa7aea/users/6f11549356ee45f38032235291ac4af3/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:00.941571 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4cb06-2afd-4cac-bfb1-17b6da9c74fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9804cee0c18049098ddbd5a5fcfa7aea, user_id=6f11549356ee45f38032235291ac4af3, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:00.945005 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4cb06-2afd-4cac-bfb1-17b6da9c74fb admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:00.957691 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1335/2681] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:00 2022] PUT /identity/v3/projects/9804cee0c18049098ddbd5a5fcfa7aea/users/6f11549356ee45f38032235291ac4af3/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:01:00.968132 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54824780-6e08-4cf3-a12f-4b721cac6826 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:00.968423 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54824780-6e08-4cf3-a12f-4b721cac6826 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:00.968695 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54824780-6e08-4cf3-a12f-4b721cac6826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:00.985478 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e7bb1-82a0-4030-b833-8d5f359275b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:00.986957 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e7bb1-82a0-4030-b833-8d5f359275b5 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:01.003700 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1347/2682] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:01:01.005265 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-54824780-6e08-4cf3-a12f-4b721cac6826 None None] MFA Rules not processed for user `6f11549356ee45f38032235291ac4af3`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:01.006572 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-54824780-6e08-4cf3-a12f-4b721cac6826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:01.081585 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1336/2683] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:00 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:01:01.097205 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e7bb1-82a0-4030-b833-8d5f359275b5 service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:01.109163 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e7bb1-82a0-4030-b833-8d5f359275b5 service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:01.164889 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238ee99-4d86-45b2-b72d-bc1fa446291b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:01.165503 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238ee99-4d86-45b2-b72d-bc1fa446291b service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:01.165779 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238ee99-4d86-45b2-b72d-bc1fa446291b service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:01.166166 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238ee99-4d86-45b2-b72d-bc1fa446291b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:01.176471 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238ee99-4d86-45b2-b72d-bc1fa446291b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:01.178357 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238ee99-4d86-45b2-b72d-bc1fa446291b service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:01.190245 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1348/2684] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:01 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:01.300248 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54824780-6e08-4cf3-a12f-4b721cac6826 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:01.313994 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54824780-6e08-4cf3-a12f-4b721cac6826 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:01.319297 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfcc0f-a708-4e2a-9fca-48db92621624 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:01.319941 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfcc0f-a708-4e2a-9fca-48db92621624 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:01.320222 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfcc0f-a708-4e2a-9fca-48db92621624 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:01.320494 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfcc0f-a708-4e2a-9fca-48db92621624 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:01.330220 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:01.407646 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfcc0f-a708-4e2a-9fca-48db92621624 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:01.409310 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfcc0f-a708-4e2a-9fca-48db92621624 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:01.420526 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1337/2685] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:01 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:01.858712 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238ee99-4d86-45b2-b72d-bc1fa446291b service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:01.900743 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:01.940715 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238ee99-4d86-45b2-b72d-bc1fa446291b service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:01.949763 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c268cf-205f-4155-bc3b-7336609782b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:01.950875 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c268cf-205f-4155-bc3b-7336609782b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:01.951207 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c268cf-205f-4155-bc3b-7336609782b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:01.951447 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c268cf-205f-4155-bc3b-7336609782b6 admin admin] PATH_INFO: `/v3/users/f80f2682b2894a5180660d09f0bbf9ba` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:01.953095 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c268cf-205f-4155-bc3b-7336609782b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f80f2682b2894a5180660d09f0bbf9ba)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:01.955940 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c268cf-205f-4155-bc3b-7336609782b6 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:02.031635 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-62c268cf-205f-4155-bc3b-7336609782b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f80f2682b2894a5180660d09f0bbf9ba'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:02.040643 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-62c268cf-205f-4155-bc3b-7336609782b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f80f2682b2894a5180660d09f0bbf9ba'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:02.051668 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-62c268cf-205f-4155-bc3b-7336609782b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f80f2682b2894a5180660d09f0bbf9ba'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:02.065938 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-62c268cf-205f-4155-bc3b-7336609782b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f80f2682b2894a5180660d09f0bbf9ba'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:02.066673 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-62c268cf-205f-4155-bc3b-7336609782b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f80f2682b2894a5180660d09f0bbf9ba'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:02.075552 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1349/2686] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:01:01 2022] DELETE /identity/v3/users/f80f2682b2894a5180660d09f0bbf9ba => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:02.081948 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64450be-ea51-4288-ae7e-8c0b63ac715b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:02.081948 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64450be-ea51-4288-ae7e-8c0b63ac715b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:02.081948 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64450be-ea51-4288-ae7e-8c0b63ac715b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:02.107252 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b64450be-ea51-4288-ae7e-8c0b63ac715b None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:02.109023 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b64450be-ea51-4288-ae7e-8c0b63ac715b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:02.191766 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1338/2687] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:02.203738 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c268cf-205f-4155-bc3b-7336609782b6 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:02.205692 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-62c268cf-205f-4155-bc3b-7336609782b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:02.292005 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c268cf-205f-4155-bc3b-7336609782b6 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:02.295812 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aee6e9-7a59-443b-a274-be0982bc4c33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:02.296421 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aee6e9-7a59-443b-a274-be0982bc4c33 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:02.296699 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aee6e9-7a59-443b-a274-be0982bc4c33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:02.296971 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aee6e9-7a59-443b-a274-be0982bc4c33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:02.306957 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aee6e9-7a59-443b-a274-be0982bc4c33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:02.308676 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aee6e9-7a59-443b-a274-be0982bc4c33 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:02.319785 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1350/2688] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:02.654893 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64450be-ea51-4288-ae7e-8c0b63ac715b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:02.656405 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b64450be-ea51-4288-ae7e-8c0b63ac715b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:02.674306 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64450be-ea51-4288-ae7e-8c0b63ac715b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:02.685247 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a5799-8a8e-4019-ad5d-cdf8beb27a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:02.686072 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a5799-8a8e-4019-ad5d-cdf8beb27a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:02.686969 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a5799-8a8e-4019-ad5d-cdf8beb27a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:02.686969 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a5799-8a8e-4019-ad5d-cdf8beb27a24 admin admin] PATH_INFO: `/v3/projects/f1467f97a2dc4771b885539c4d55b45e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:02.689140 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a5799-8a8e-4019-ad5d-cdf8beb27a24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1467f97a2dc4771b885539c4d55b45e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:02.691323 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a5799-8a8e-4019-ad5d-cdf8beb27a24 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:02.753821 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c75a5799-8a8e-4019-ad5d-cdf8beb27a24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1467f97a2dc4771b885539c4d55b45e', 'request_id': 'req-c75a5799-8a8e-4019-ad5d-cdf8beb27a24'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:02.760672 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c75a5799-8a8e-4019-ad5d-cdf8beb27a24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1467f97a2dc4771b885539c4d55b45e', 'request_id': 'req-c75a5799-8a8e-4019-ad5d-cdf8beb27a24'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:02.769141 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c75a5799-8a8e-4019-ad5d-cdf8beb27a24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1467f97a2dc4771b885539c4d55b45e', 'request_id': 'req-c75a5799-8a8e-4019-ad5d-cdf8beb27a24'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:02.785360 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c75a5799-8a8e-4019-ad5d-cdf8beb27a24 admin admin] The token cache is being invalidate because project f1467f97a2dc4771b885539c4d55b45e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:01:02.785552 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c75a5799-8a8e-4019-ad5d-cdf8beb27a24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:02.786759 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c75a5799-8a8e-4019-ad5d-cdf8beb27a24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:02.788899 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1339/2689] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:01:02 2022] DELETE /identity/v3/projects/f1467f97a2dc4771b885539c4d55b45e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:02.793097 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aee6e9-7a59-443b-a274-be0982bc4c33 service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:02.805971 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aee6e9-7a59-443b-a274-be0982bc4c33 service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:02.872434 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:02.886026 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f55f2-a378-4c37-a7cd-c4b0cb460e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:02.887178 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f55f2-a378-4c37-a7cd-c4b0cb460e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:02.887515 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f55f2-a378-4c37-a7cd-c4b0cb460e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:02.887791 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f55f2-a378-4c37-a7cd-c4b0cb460e6d admin admin] PATH_INFO: `/v3/users/8102ba891a88425bb2e426983e4aa841` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:02.888912 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f55f2-a378-4c37-a7cd-c4b0cb460e6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8102ba891a88425bb2e426983e4aa841)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:02.890926 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f55f2-a378-4c37-a7cd-c4b0cb460e6d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:02.940623 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-151f55f2-a378-4c37-a7cd-c4b0cb460e6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8102ba891a88425bb2e426983e4aa841'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:02.947273 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-151f55f2-a378-4c37-a7cd-c4b0cb460e6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8102ba891a88425bb2e426983e4aa841'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:02.955795 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-151f55f2-a378-4c37-a7cd-c4b0cb460e6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8102ba891a88425bb2e426983e4aa841'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:02.968253 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-151f55f2-a378-4c37-a7cd-c4b0cb460e6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8102ba891a88425bb2e426983e4aa841'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:02.968921 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-151f55f2-a378-4c37-a7cd-c4b0cb460e6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8102ba891a88425bb2e426983e4aa841'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:02.975132 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1351/2690] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:01:02 2022] DELETE /identity/v3/users/8102ba891a88425bb2e426983e4aa841 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:01:03.275286 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a5799-8a8e-4019-ad5d-cdf8beb27a24 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:03.276943 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c75a5799-8a8e-4019-ad5d-cdf8beb27a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:03.292081 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a5799-8a8e-4019-ad5d-cdf8beb27a24 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:03.325642 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:03.353495 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f9bc3-a646-4868-9df6-9c1d27dba7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:03.354512 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f9bc3-a646-4868-9df6-9c1d27dba7c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:03.355012 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f9bc3-a646-4868-9df6-9c1d27dba7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:03.355502 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f9bc3-a646-4868-9df6-9c1d27dba7c0 admin admin] PATH_INFO: `/v3/projects/b811193ad88d4813818bd7ecd7abdb91` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:03.357254 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f9bc3-a646-4868-9df6-9c1d27dba7c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b811193ad88d4813818bd7ecd7abdb91)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:03.359313 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f9bc3-a646-4868-9df6-9c1d27dba7c0 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:03.411429 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ac9f9bc3-a646-4868-9df6-9c1d27dba7c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b811193ad88d4813818bd7ecd7abdb91', 'request_id': 'req-ac9f9bc3-a646-4868-9df6-9c1d27dba7c0'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:03.417338 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ac9f9bc3-a646-4868-9df6-9c1d27dba7c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b811193ad88d4813818bd7ecd7abdb91', 'request_id': 'req-ac9f9bc3-a646-4868-9df6-9c1d27dba7c0'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:03.423956 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ac9f9bc3-a646-4868-9df6-9c1d27dba7c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b811193ad88d4813818bd7ecd7abdb91', 'request_id': 'req-ac9f9bc3-a646-4868-9df6-9c1d27dba7c0'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:03.438140 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ac9f9bc3-a646-4868-9df6-9c1d27dba7c0 admin admin] The token cache is being invalidate because project b811193ad88d4813818bd7ecd7abdb91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:01:03.438439 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ac9f9bc3-a646-4868-9df6-9c1d27dba7c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:03.439066 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ac9f9bc3-a646-4868-9df6-9c1d27dba7c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:03.440557 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1340/2691] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:01:03 2022] DELETE /identity/v3/projects/b811193ad88d4813818bd7ecd7abdb91 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:03.445644 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3814b41-2337-45b9-a53d-e1c26bf7207f None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:03.446026 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3814b41-2337-45b9-a53d-e1c26bf7207f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:03.446318 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3814b41-2337-45b9-a53d-e1c26bf7207f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:03.466522 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-a3814b41-2337-45b9-a53d-e1c26bf7207f None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:03.467829 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a3814b41-2337-45b9-a53d-e1c26bf7207f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:03.536803 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1352/2692] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:03.548404 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b678c7-469d-4cce-a0a9-5ee57bb7a912 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:03.548710 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b678c7-469d-4cce-a0a9-5ee57bb7a912 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:03.548976 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b678c7-469d-4cce-a0a9-5ee57bb7a912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:03.571284 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c1b678c7-469d-4cce-a0a9-5ee57bb7a912 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:03.572460 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c1b678c7-469d-4cce-a0a9-5ee57bb7a912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:03.580952 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1341/2693] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:03.585304 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3814b41-2337-45b9-a53d-e1c26bf7207f None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:03.595682 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3814b41-2337-45b9-a53d-e1c26bf7207f None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:03.600834 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f34e6-34a2-4bfc-9b4c-228fa272eabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:03.601459 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f34e6-34a2-4bfc-9b4c-228fa272eabe admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:03.601956 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f34e6-34a2-4bfc-9b4c-228fa272eabe admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:03.602292 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f34e6-34a2-4bfc-9b4c-228fa272eabe admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:03.603000 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f34e6-34a2-4bfc-9b4c-228fa272eabe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:01:03.603366 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f34e6-34a2-4bfc-9b4c-228fa272eabe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:03.605046 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f34e6-34a2-4bfc-9b4c-228fa272eabe admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:03.618299 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1353/2694] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 01:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:01:03.623118 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b678c7-469d-4cce-a0a9-5ee57bb7a912 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:03.632530 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b678c7-469d-4cce-a0a9-5ee57bb7a912 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:03.637466 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee415229-918a-457d-b102-72ff17664675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:03.638092 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee415229-918a-457d-b102-72ff17664675 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:03.638371 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee415229-918a-457d-b102-72ff17664675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:03.638640 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee415229-918a-457d-b102-72ff17664675 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:03.639303 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee415229-918a-457d-b102-72ff17664675 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:03.641208 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee415229-918a-457d-b102-72ff17664675 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:03.671174 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1342/2695] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:01:03 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:03.675622 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f34e6-34a2-4bfc-9b4c-228fa272eabe admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:03.685953 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f34e6-34a2-4bfc-9b4c-228fa272eabe admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:03.741246 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:03.749729 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cae6bf-c863-4094-9b0a-90a20d8156fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:03.750726 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cae6bf-c863-4094-9b0a-90a20d8156fa admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:03.751166 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cae6bf-c863-4094-9b0a-90a20d8156fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:03.751477 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cae6bf-c863-4094-9b0a-90a20d8156fa admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:03.752157 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cae6bf-c863-4094-9b0a-90a20d8156fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:03.754792 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cae6bf-c863-4094-9b0a-90a20d8156fa admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:03.778335 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1354/2696] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:01:03 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:03.782681 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee415229-918a-457d-b102-72ff17664675 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:03.794317 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee415229-918a-457d-b102-72ff17664675 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:03.798997 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932ace9-2073-4f3a-b015-a79d73c5c605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:03.799604 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932ace9-2073-4f3a-b015-a79d73c5c605 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:03.799885 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932ace9-2073-4f3a-b015-a79d73c5c605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:03.800157 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932ace9-2073-4f3a-b015-a79d73c5c605 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:03.800805 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c932ace9-2073-4f3a-b015-a79d73c5c605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:03.802468 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c932ace9-2073-4f3a-b015-a79d73c5c605 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:03.813027 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1343/2697] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:03.817205 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cae6bf-c863-4094-9b0a-90a20d8156fa admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:03.830410 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cae6bf-c863-4094-9b0a-90a20d8156fa admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:03.836604 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f92d7-43e7-4032-a285-c94c70551c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:03.838019 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f92d7-43e7-4032-a285-c94c70551c45 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:03.838019 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f92d7-43e7-4032-a285-c94c70551c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:03.838019 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f92d7-43e7-4032-a285-c94c70551c45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:03.838548 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f92d7-43e7-4032-a285-c94c70551c45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:03.841441 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f92d7-43e7-4032-a285-c94c70551c45 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:03.853262 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1355/2698] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:01:03.858203 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932ace9-2073-4f3a-b015-a79d73c5c605 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:03.873696 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932ace9-2073-4f3a-b015-a79d73c5c605 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:03.879025 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e8541-cc44-403d-bc9d-af6d2787c69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:03.879842 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e8541-cc44-403d-bc9d-af6d2787c69d admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:03.880088 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e8541-cc44-403d-bc9d-af6d2787c69d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:03.880386 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e8541-cc44-403d-bc9d-af6d2787c69d admin admin] PATH_INFO: `/v3/projects/e70a140bd0ee4cee967d0c367a38f789/users/d847c937abc146a5b455b297d20c609a/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:03.904738 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e8541-cc44-403d-bc9d-af6d2787c69d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e70a140bd0ee4cee967d0c367a38f789, user_id=d847c937abc146a5b455b297d20c609a, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:03.907793 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e8541-cc44-403d-bc9d-af6d2787c69d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:03.927748 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1344/2699] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:03 2022] PUT /identity/v3/projects/e70a140bd0ee4cee967d0c367a38f789/users/d847c937abc146a5b455b297d20c609a/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:03.939044 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba5fd8-0385-4c86-8582-3de94e716945 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:03.939553 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba5fd8-0385-4c86-8582-3de94e716945 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:03.940138 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba5fd8-0385-4c86-8582-3de94e716945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:03.971690 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-8aba5fd8-0385-4c86-8582-3de94e716945 None None] MFA Rules not processed for user `d847c937abc146a5b455b297d20c609a`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:03.973653 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8aba5fd8-0385-4c86-8582-3de94e716945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:04.029502 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e8541-cc44-403d-bc9d-af6d2787c69d admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:04.031768 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a07e8541-cc44-403d-bc9d-af6d2787c69d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:04.061899 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1356/2700] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:04.065298 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba5fd8-0385-4c86-8582-3de94e716945 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:04.128297 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e8541-cc44-403d-bc9d-af6d2787c69d admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:04.133431 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53394f9e-5805-40b5-9415-99228016ecbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:04.134207 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53394f9e-5805-40b5-9415-99228016ecbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:04.134583 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53394f9e-5805-40b5-9415-99228016ecbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:04.134959 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53394f9e-5805-40b5-9415-99228016ecbc admin admin] PATH_INFO: `/v3/users/68d4d96a66ae44f188aef1ec4cda3cc2` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:04.136343 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53394f9e-5805-40b5-9415-99228016ecbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=68d4d96a66ae44f188aef1ec4cda3cc2)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:04.138628 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53394f9e-5805-40b5-9415-99228016ecbc admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:04.140248 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba5fd8-0385-4c86-8582-3de94e716945 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:04.140592 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:04.146059 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d7161-4995-4039-bf79-566875953a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:04.146738 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d7161-4995-4039-bf79-566875953a2e admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:04.147107 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d7161-4995-4039-bf79-566875953a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:04.147411 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d7161-4995-4039-bf79-566875953a2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:04.148236 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d7161-4995-4039-bf79-566875953a2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:04.150185 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d7161-4995-4039-bf79-566875953a2e admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:04.183861 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1357/2701] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:01:04 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:01:04.187932 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d7161-4995-4039-bf79-566875953a2e admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:04.217203 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-53394f9e-5805-40b5-9415-99228016ecbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68d4d96a66ae44f188aef1ec4cda3cc2'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:04.234215 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-53394f9e-5805-40b5-9415-99228016ecbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68d4d96a66ae44f188aef1ec4cda3cc2'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:04.246054 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-53394f9e-5805-40b5-9415-99228016ecbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68d4d96a66ae44f188aef1ec4cda3cc2'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:04.264653 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-53394f9e-5805-40b5-9415-99228016ecbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68d4d96a66ae44f188aef1ec4cda3cc2'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:04.264883 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:04.266411 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-53394f9e-5805-40b5-9415-99228016ecbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68d4d96a66ae44f188aef1ec4cda3cc2'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:04.276148 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1345/2702] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:01:04 2022] DELETE /identity/v3/users/68d4d96a66ae44f188aef1ec4cda3cc2 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:01:04.279723 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a60e4-b991-43a3-a284-08baab3f0163 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:04.280165 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a60e4-b991-43a3-a284-08baab3f0163 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:04.280558 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a60e4-b991-43a3-a284-08baab3f0163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:04.297965 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d7161-4995-4039-bf79-566875953a2e admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:04.303807 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-852a60e4-b991-43a3-a284-08baab3f0163 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:04.305271 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-852a60e4-b991-43a3-a284-08baab3f0163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:04.376281 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1346/2703] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:01:04.381488 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f1fae-38ba-4e9d-b7b3-9af4c00ada00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:04.382145 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f1fae-38ba-4e9d-b7b3-9af4c00ada00 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:04.382449 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f1fae-38ba-4e9d-b7b3-9af4c00ada00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:04.382723 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f1fae-38ba-4e9d-b7b3-9af4c00ada00 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:04.383358 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f1fae-38ba-4e9d-b7b3-9af4c00ada00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:04.385656 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f1fae-38ba-4e9d-b7b3-9af4c00ada00 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:04.386360 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a60e4-b991-43a3-a284-08baab3f0163 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:04.387900 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-852a60e4-b991-43a3-a284-08baab3f0163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:04.408045 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1358/2704] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:01:04 2022] POST /identity/v3/users => generated 297 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:01:04.412000 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f1fae-38ba-4e9d-b7b3-9af4c00ada00 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:04.413624 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-461f1fae-38ba-4e9d-b7b3-9af4c00ada00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:04.425387 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f1fae-38ba-4e9d-b7b3-9af4c00ada00 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:04.430119 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c9324-8141-4f3e-96ec-4c1dd90b108b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:04.430713 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c9324-8141-4f3e-96ec-4c1dd90b108b admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:04.430988 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c9324-8141-4f3e-96ec-4c1dd90b108b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:04.431256 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c9324-8141-4f3e-96ec-4c1dd90b108b admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:04.431887 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c9324-8141-4f3e-96ec-4c1dd90b108b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:04.433591 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c9324-8141-4f3e-96ec-4c1dd90b108b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:04.443760 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1359/2705] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:01:04.447932 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c9324-8141-4f3e-96ec-4c1dd90b108b admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:04.448700 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a60e4-b991-43a3-a284-08baab3f0163 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:04.452358 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1b6a9-55f2-46a1-8048-ff1f8329d8d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:04.452961 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1b6a9-55f2-46a1-8048-ff1f8329d8d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:04.453237 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1b6a9-55f2-46a1-8048-ff1f8329d8d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:04.453502 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1b6a9-55f2-46a1-8048-ff1f8329d8d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:04.457492 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c9324-8141-4f3e-96ec-4c1dd90b108b admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:04.462220 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0205d95-7177-4c5a-946f-e56c5064aa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:04.462568 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1b6a9-55f2-46a1-8048-ff1f8329d8d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:04.462850 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0205d95-7177-4c5a-946f-e56c5064aa92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:04.463129 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0205d95-7177-4c5a-946f-e56c5064aa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:04.463401 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0205d95-7177-4c5a-946f-e56c5064aa92 admin admin] PATH_INFO: `/v3/projects/25734644ed1d426ab2fca6fddf937469/users/c4c7a922b6ac4248925f857723b025a2/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:04.464014 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1b6a9-55f2-46a1-8048-ff1f8329d8d9 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:04.473980 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1347/2706] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:01:04.478328 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0205d95-7177-4c5a-946f-e56c5064aa92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25734644ed1d426ab2fca6fddf937469, user_id=c4c7a922b6ac4248925f857723b025a2, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:04.481307 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0205d95-7177-4c5a-946f-e56c5064aa92 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:04.495751 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1360/2707] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:04 2022] PUT /identity/v3/projects/25734644ed1d426ab2fca6fddf937469/users/c4c7a922b6ac4248925f857723b025a2/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:04.500017 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1b6a9-55f2-46a1-8048-ff1f8329d8d9 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:04.509856 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1b6a9-55f2-46a1-8048-ff1f8329d8d9 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:04.531166 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:04.578569 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48544d-66a2-4c56-aa82-cfc6f650ffa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:04.579310 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48544d-66a2-4c56-aa82-cfc6f650ffa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:04.579681 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48544d-66a2-4c56-aa82-cfc6f650ffa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:04.580026 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48544d-66a2-4c56-aa82-cfc6f650ffa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:04.580744 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48544d-66a2-4c56-aa82-cfc6f650ffa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:04.582471 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48544d-66a2-4c56-aa82-cfc6f650ffa8 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:04.594054 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1348/2708] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:04.598297 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0205d95-7177-4c5a-946f-e56c5064aa92 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:04.614875 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0205d95-7177-4c5a-946f-e56c5064aa92 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:04.620571 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb5f4e-e2ea-48da-b020-94b85cb99b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:04.622012 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb5f4e-e2ea-48da-b020-94b85cb99b50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:04.622406 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb5f4e-e2ea-48da-b020-94b85cb99b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:04.622578 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb5f4e-e2ea-48da-b020-94b85cb99b50 admin admin] PATH_INFO: `/v3/projects/25734644ed1d426ab2fca6fddf937469/users/c4c7a922b6ac4248925f857723b025a2/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:04.625497 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb5f4e-e2ea-48da-b020-94b85cb99b50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25734644ed1d426ab2fca6fddf937469, user_id=c4c7a922b6ac4248925f857723b025a2, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:04.629582 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb5f4e-e2ea-48da-b020-94b85cb99b50 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:04.643925 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1361/2709] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:04 2022] PUT /identity/v3/projects/25734644ed1d426ab2fca6fddf937469/users/c4c7a922b6ac4248925f857723b025a2/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:01:04.655286 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3ad73-a2f7-4930-b611-a514e1ea4106 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:04.655677 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3ad73-a2f7-4930-b611-a514e1ea4106 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:04.655842 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3ad73-a2f7-4930-b611-a514e1ea4106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:04.687013 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a9d3ad73-a2f7-4930-b611-a514e1ea4106 None None] MFA Rules not processed for user `c4c7a922b6ac4248925f857723b025a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:04.688242 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a9d3ad73-a2f7-4930-b611-a514e1ea4106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:04.770413 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1349/2710] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:04.783689 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb5f4e-e2ea-48da-b020-94b85cb99b50 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:04.785520 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-68fb5f4e-e2ea-48da-b020-94b85cb99b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:04.787276 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3ad73-a2f7-4930-b611-a514e1ea4106 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:04.788734 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a9d3ad73-a2f7-4930-b611-a514e1ea4106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:04.857386 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb5f4e-e2ea-48da-b020-94b85cb99b50 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:04.861081 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103007db-9208-4a09-9980-86b72eaf2a11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:04.861693 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103007db-9208-4a09-9980-86b72eaf2a11 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:04.862021 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103007db-9208-4a09-9980-86b72eaf2a11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:04.862345 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103007db-9208-4a09-9980-86b72eaf2a11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:04.867338 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3ad73-a2f7-4930-b611-a514e1ea4106 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:04.871897 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103007db-9208-4a09-9980-86b72eaf2a11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:04.873378 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103007db-9208-4a09-9980-86b72eaf2a11 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:04.876110 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac4b8c-2d76-40dd-a811-6e1e6ea33a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:04.876760 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac4b8c-2d76-40dd-a811-6e1e6ea33a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:04.877039 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac4b8c-2d76-40dd-a811-6e1e6ea33a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:04.877310 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac4b8c-2d76-40dd-a811-6e1e6ea33a42 admin admin] PATH_INFO: `/v3/projects/10e32a8671fb41e0b424cb5b6e903fa0` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:04.878488 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac4b8c-2d76-40dd-a811-6e1e6ea33a42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10e32a8671fb41e0b424cb5b6e903fa0)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:04.880572 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac4b8c-2d76-40dd-a811-6e1e6ea33a42 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:04.883649 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1362/2711] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:04 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:04.927334 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:04.930527 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-92ac4b8c-2d76-40dd-a811-6e1e6ea33a42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10e32a8671fb41e0b424cb5b6e903fa0', 'request_id': 'req-92ac4b8c-2d76-40dd-a811-6e1e6ea33a42'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:04.938274 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-92ac4b8c-2d76-40dd-a811-6e1e6ea33a42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10e32a8671fb41e0b424cb5b6e903fa0', 'request_id': 'req-92ac4b8c-2d76-40dd-a811-6e1e6ea33a42'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:04.943771 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-92ac4b8c-2d76-40dd-a811-6e1e6ea33a42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10e32a8671fb41e0b424cb5b6e903fa0', 'request_id': 'req-92ac4b8c-2d76-40dd-a811-6e1e6ea33a42'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:04.957968 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-92ac4b8c-2d76-40dd-a811-6e1e6ea33a42 admin admin] The token cache is being invalidate because project 10e32a8671fb41e0b424cb5b6e903fa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:01:04.958263 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-92ac4b8c-2d76-40dd-a811-6e1e6ea33a42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:04.958926 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-92ac4b8c-2d76-40dd-a811-6e1e6ea33a42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:04.960503 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1350/2712] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:01:04 2022] DELETE /identity/v3/projects/10e32a8671fb41e0b424cb5b6e903fa0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:01:04.964714 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103007db-9208-4a09-9980-86b72eaf2a11 service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:04.975853 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103007db-9208-4a09-9980-86b72eaf2a11 service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:05.016822 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:05.039002 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaeaf64-c89d-4a65-9fd3-3596701a2a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:05.039501 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaeaf64-c89d-4a65-9fd3-3596701a2a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:05.039717 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaeaf64-c89d-4a65-9fd3-3596701a2a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:05.039861 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaeaf64-c89d-4a65-9fd3-3596701a2a8b admin admin] PATH_INFO: `/v3/users/68531d362f624f0c83ff11ac4244ddac` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:05.041014 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaeaf64-c89d-4a65-9fd3-3596701a2a8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=68531d362f624f0c83ff11ac4244ddac)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:05.043120 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaeaf64-c89d-4a65-9fd3-3596701a2a8b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:05.103138 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ecaeaf64-c89d-4a65-9fd3-3596701a2a8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68531d362f624f0c83ff11ac4244ddac'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:05.113340 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ecaeaf64-c89d-4a65-9fd3-3596701a2a8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68531d362f624f0c83ff11ac4244ddac'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:05.123168 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ecaeaf64-c89d-4a65-9fd3-3596701a2a8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68531d362f624f0c83ff11ac4244ddac'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:05.140913 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ecaeaf64-c89d-4a65-9fd3-3596701a2a8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68531d362f624f0c83ff11ac4244ddac'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:05.141559 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ecaeaf64-c89d-4a65-9fd3-3596701a2a8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68531d362f624f0c83ff11ac4244ddac'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:05.147420 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1363/2713] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:01:04 2022] DELETE /identity/v3/users/68531d362f624f0c83ff11ac4244ddac => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:05.316213 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac4b8c-2d76-40dd-a811-6e1e6ea33a42 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:05.317657 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-92ac4b8c-2d76-40dd-a811-6e1e6ea33a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:05.334914 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac4b8c-2d76-40dd-a811-6e1e6ea33a42 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:05.406950 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a681a97-b28f-4343-b79e-ecac585c823c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:05.407714 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a681a97-b28f-4343-b79e-ecac585c823c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:05.408088 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a681a97-b28f-4343-b79e-ecac585c823c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:05.408461 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a681a97-b28f-4343-b79e-ecac585c823c admin admin] PATH_INFO: `/v3/users/d847c937abc146a5b455b297d20c609a` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:05.410135 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a681a97-b28f-4343-b79e-ecac585c823c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d847c937abc146a5b455b297d20c609a)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:05.412740 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a681a97-b28f-4343-b79e-ecac585c823c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:05.469116 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3a681a97-b28f-4343-b79e-ecac585c823c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd847c937abc146a5b455b297d20c609a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:05.485300 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaeaf64-c89d-4a65-9fd3-3596701a2a8b admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:05.490825 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ecaeaf64-c89d-4a65-9fd3-3596701a2a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:05.491095 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3a681a97-b28f-4343-b79e-ecac585c823c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd847c937abc146a5b455b297d20c609a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:05.502024 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaeaf64-c89d-4a65-9fd3-3596701a2a8b admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:05.504455 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3a681a97-b28f-4343-b79e-ecac585c823c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd847c937abc146a5b455b297d20c609a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:05.512803 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f9090-dc4d-47d1-a35a-1d3e60d4c175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:05.514010 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f9090-dc4d-47d1-a35a-1d3e60d4c175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:05.515022 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3a681a97-b28f-4343-b79e-ecac585c823c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd847c937abc146a5b455b297d20c609a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:05.515494 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f9090-dc4d-47d1-a35a-1d3e60d4c175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:05.515783 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3a681a97-b28f-4343-b79e-ecac585c823c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd847c937abc146a5b455b297d20c609a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:05.516261 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f9090-dc4d-47d1-a35a-1d3e60d4c175 admin admin] PATH_INFO: `/v3/projects/48b6ddde72b043af9f7cd96107960576` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:05.518341 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f9090-dc4d-47d1-a35a-1d3e60d4c175 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48b6ddde72b043af9f7cd96107960576)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:05.521745 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f9090-dc4d-47d1-a35a-1d3e60d4c175 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:05.525106 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1351/2714] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:01:05 2022] DELETE /identity/v3/users/d847c937abc146a5b455b297d20c609a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:05.529883 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720fea5-bb76-42c0-aefd-f49005b89a3d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:05.529883 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720fea5-bb76-42c0-aefd-f49005b89a3d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:05.529883 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720fea5-bb76-42c0-aefd-f49005b89a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:05.558707 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-d720fea5-bb76-42c0-aefd-f49005b89a3d None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:05.560088 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d720fea5-bb76-42c0-aefd-f49005b89a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:05.585857 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-805f9090-dc4d-47d1-a35a-1d3e60d4c175 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48b6ddde72b043af9f7cd96107960576', 'request_id': 'req-805f9090-dc4d-47d1-a35a-1d3e60d4c175'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:05.597969 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-805f9090-dc4d-47d1-a35a-1d3e60d4c175 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48b6ddde72b043af9f7cd96107960576', 'request_id': 'req-805f9090-dc4d-47d1-a35a-1d3e60d4c175'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:05.604576 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-805f9090-dc4d-47d1-a35a-1d3e60d4c175 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48b6ddde72b043af9f7cd96107960576', 'request_id': 'req-805f9090-dc4d-47d1-a35a-1d3e60d4c175'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:05.621589 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-805f9090-dc4d-47d1-a35a-1d3e60d4c175 admin admin] The token cache is being invalidate because project 48b6ddde72b043af9f7cd96107960576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:01:05.622255 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-805f9090-dc4d-47d1-a35a-1d3e60d4c175 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:05.623147 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-805f9090-dc4d-47d1-a35a-1d3e60d4c175 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:05.629658 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1364/2715] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:01:05 2022] DELETE /identity/v3/projects/48b6ddde72b043af9f7cd96107960576 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:01:05.631570 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25972d-7959-4d60-ba76-f6ef3e45c8af None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:05.631855 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25972d-7959-4d60-ba76-f6ef3e45c8af None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:05.632125 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25972d-7959-4d60-ba76-f6ef3e45c8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:05.634829 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:05.658963 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-3c25972d-7959-4d60-ba76-f6ef3e45c8af None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:05.660147 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3c25972d-7959-4d60-ba76-f6ef3e45c8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:05.661225 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1352/2716] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:05.672395 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720fea5-bb76-42c0-aefd-f49005b89a3d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:05.690515 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d720fea5-bb76-42c0-aefd-f49005b89a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:05.708350 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:05.754242 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1365/2717] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:05.764793 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd776f3-a8d0-481a-9318-d94957b6ab7f None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:05.765092 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd776f3-a8d0-481a-9318-d94957b6ab7f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:05.765368 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd776f3-a8d0-481a-9318-d94957b6ab7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:05.791522 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-8dd776f3-a8d0-481a-9318-d94957b6ab7f None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:05.792646 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720fea5-bb76-42c0-aefd-f49005b89a3d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:05.793523 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8dd776f3-a8d0-481a-9318-d94957b6ab7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:05.801974 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1366/2718] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:01:05.806100 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd776f3-a8d0-481a-9318-d94957b6ab7f None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:05.815631 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd776f3-a8d0-481a-9318-d94957b6ab7f None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:05.820417 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d95d9-93c9-4e4e-99ec-c6d2f17c20dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:05.821088 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d95d9-93c9-4e4e-99ec-c6d2f17c20dd admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:05.821419 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d95d9-93c9-4e4e-99ec-c6d2f17c20dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:05.821740 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d95d9-93c9-4e4e-99ec-c6d2f17c20dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:05.822683 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d95d9-93c9-4e4e-99ec-c6d2f17c20dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:01:05.823020 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d95d9-93c9-4e4e-99ec-c6d2f17c20dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:05.825266 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d95d9-93c9-4e4e-99ec-c6d2f17c20dd admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:05.839378 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1367/2719] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 01:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:01:05.844015 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d95d9-93c9-4e4e-99ec-c6d2f17c20dd admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:05.854499 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d95d9-93c9-4e4e-99ec-c6d2f17c20dd admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:05.860823 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbd894-8367-4fab-a755-e16507cea490 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:05.861341 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11a931-ada9-4a76-9092-3bd9639ffb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:05.861470 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbd894-8367-4fab-a755-e16507cea490 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:05.861708 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbd894-8367-4fab-a755-e16507cea490 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:05.862023 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbd894-8367-4fab-a755-e16507cea490 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:05.862761 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11a931-ada9-4a76-9092-3bd9639ffb4d admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:05.863308 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11a931-ada9-4a76-9092-3bd9639ffb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:05.863774 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11a931-ada9-4a76-9092-3bd9639ffb4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:05.864669 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11a931-ada9-4a76-9092-3bd9639ffb4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:05.866787 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11a931-ada9-4a76-9092-3bd9639ffb4d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:05.872176 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbd894-8367-4fab-a755-e16507cea490 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:05.874148 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbd894-8367-4fab-a755-e16507cea490 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:05.887326 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1353/2720] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:05.901115 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1368/2721] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:01:05 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:01:05.905393 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbd894-8367-4fab-a755-e16507cea490 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:05.916926 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbd894-8367-4fab-a755-e16507cea490 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:05.990794 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4850f61-aaa2-4f4b-a5a7-ac8e1ba4eb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:05.991424 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4850f61-aaa2-4f4b-a5a7-ac8e1ba4eb96 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:05.991800 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4850f61-aaa2-4f4b-a5a7-ac8e1ba4eb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:05.991957 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4850f61-aaa2-4f4b-a5a7-ac8e1ba4eb96 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:05.992640 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4850f61-aaa2-4f4b-a5a7-ac8e1ba4eb96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:05.994888 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4850f61-aaa2-4f4b-a5a7-ac8e1ba4eb96 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:06.025763 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1354/2722] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:01:05 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:06.030278 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11a931-ada9-4a76-9092-3bd9639ffb4d admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:06.050288 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11a931-ada9-4a76-9092-3bd9639ffb4d admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:06.056203 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8753a-3983-4298-b14f-3905b221212a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:06.056829 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8753a-3983-4298-b14f-3905b221212a admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:06.061509 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8753a-3983-4298-b14f-3905b221212a admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:06.061509 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8753a-3983-4298-b14f-3905b221212a admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:06.061509 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8753a-3983-4298-b14f-3905b221212a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:06.061509 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8753a-3983-4298-b14f-3905b221212a admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:06.088852 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1369/2723] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:06.090526 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4850f61-aaa2-4f4b-a5a7-ac8e1ba4eb96 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:06.100565 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4850f61-aaa2-4f4b-a5a7-ac8e1ba4eb96 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:06.105715 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c46503-4352-4f5d-9464-dd06606c82d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:06.106656 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c46503-4352-4f5d-9464-dd06606c82d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:06.106931 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c46503-4352-4f5d-9464-dd06606c82d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:06.107198 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c46503-4352-4f5d-9464-dd06606c82d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:06.107846 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c46503-4352-4f5d-9464-dd06606c82d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:06.109461 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c46503-4352-4f5d-9464-dd06606c82d1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:06.120399 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1355/2724] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:06.125579 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8753a-3983-4298-b14f-3905b221212a admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:06.136737 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8753a-3983-4298-b14f-3905b221212a admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:06.142085 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e79c3-842d-4d03-a949-814d887985b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:06.142750 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e79c3-842d-4d03-a949-814d887985b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:06.143026 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e79c3-842d-4d03-a949-814d887985b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:06.143299 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e79c3-842d-4d03-a949-814d887985b1 admin admin] PATH_INFO: `/v3/projects/ae9f824c28f24ae99f836667ece85dbf/users/723faddfa02b4915b6947e6fe88d9407/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:06.165390 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e79c3-842d-4d03-a949-814d887985b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae9f824c28f24ae99f836667ece85dbf, user_id=723faddfa02b4915b6947e6fe88d9407, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:06.167830 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e79c3-842d-4d03-a949-814d887985b1 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:06.188940 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1370/2725] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:06 2022] PUT /identity/v3/projects/ae9f824c28f24ae99f836667ece85dbf/users/723faddfa02b4915b6947e6fe88d9407/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:06.209898 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca39222-7f95-49b8-98a0-a780cf5477db None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:06.209898 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca39222-7f95-49b8-98a0-a780cf5477db None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:06.209898 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca39222-7f95-49b8-98a0-a780cf5477db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:06.212463 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e79c3-842d-4d03-a949-814d887985b1 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:06.215835 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3b0e79c3-842d-4d03-a949-814d887985b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:06.253405 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-6ca39222-7f95-49b8-98a0-a780cf5477db None None] MFA Rules not processed for user `723faddfa02b4915b6947e6fe88d9407`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:06.254707 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6ca39222-7f95-49b8-98a0-a780cf5477db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:06.278285 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:06.338272 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1356/2726] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:06.347912 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e79c3-842d-4d03-a949-814d887985b1 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:06.355733 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca39222-7f95-49b8-98a0-a780cf5477db None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:06.358450 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6ca39222-7f95-49b8-98a0-a780cf5477db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:06.359513 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced11ea7-e199-4d57-a439-8b8b9579a3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:06.360193 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced11ea7-e199-4d57-a439-8b8b9579a3b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:06.360486 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced11ea7-e199-4d57-a439-8b8b9579a3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:06.360776 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced11ea7-e199-4d57-a439-8b8b9579a3b3 admin admin] PATH_INFO: `/v3/projects/e70a140bd0ee4cee967d0c367a38f789` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:06.361953 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced11ea7-e199-4d57-a439-8b8b9579a3b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e70a140bd0ee4cee967d0c367a38f789)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:06.363904 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced11ea7-e199-4d57-a439-8b8b9579a3b3 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:06.414073 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ced11ea7-e199-4d57-a439-8b8b9579a3b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e70a140bd0ee4cee967d0c367a38f789', 'request_id': 'req-ced11ea7-e199-4d57-a439-8b8b9579a3b3'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:06.417117 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca39222-7f95-49b8-98a0-a780cf5477db None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:06.423788 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ced11ea7-e199-4d57-a439-8b8b9579a3b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e70a140bd0ee4cee967d0c367a38f789', 'request_id': 'req-ced11ea7-e199-4d57-a439-8b8b9579a3b3'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:06.430808 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ced11ea7-e199-4d57-a439-8b8b9579a3b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e70a140bd0ee4cee967d0c367a38f789', 'request_id': 'req-ced11ea7-e199-4d57-a439-8b8b9579a3b3'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:06.435901 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:06.444695 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ced11ea7-e199-4d57-a439-8b8b9579a3b3 admin admin] The token cache is being invalidate because project e70a140bd0ee4cee967d0c367a38f789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:01:06.445036 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ced11ea7-e199-4d57-a439-8b8b9579a3b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:06.446075 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ced11ea7-e199-4d57-a439-8b8b9579a3b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:06.451464 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1371/2727] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:01:06 2022] DELETE /identity/v3/projects/e70a140bd0ee4cee967d0c367a38f789 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:06.452422 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced11ea7-e199-4d57-a439-8b8b9579a3b3 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:06.453811 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ced11ea7-e199-4d57-a439-8b8b9579a3b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:06.476221 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f331f8-ffd9-4f6c-a636-bb5fe5ec4494 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:06.476833 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f331f8-ffd9-4f6c-a636-bb5fe5ec4494 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:06.477106 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f331f8-ffd9-4f6c-a636-bb5fe5ec4494 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:06.477373 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f331f8-ffd9-4f6c-a636-bb5fe5ec4494 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:06.479148 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b4f331f8-ffd9-4f6c-a636-bb5fe5ec4494 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:06.524578 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced11ea7-e199-4d57-a439-8b8b9579a3b3 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:06.534702 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b0257-68c7-4752-a496-8086b5e8087f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:06.534702 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b0257-68c7-4752-a496-8086b5e8087f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:06.534702 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b0257-68c7-4752-a496-8086b5e8087f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:06.534702 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b0257-68c7-4752-a496-8086b5e8087f admin admin] PATH_INFO: `/v3/users/c4c7a922b6ac4248925f857723b025a2` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:06.535284 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b0257-68c7-4752-a496-8086b5e8087f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4c7a922b6ac4248925f857723b025a2)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:06.535284 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b0257-68c7-4752-a496-8086b5e8087f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:06.550671 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f331f8-ffd9-4f6c-a636-bb5fe5ec4494 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:06.552155 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f331f8-ffd9-4f6c-a636-bb5fe5ec4494 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:06.562189 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1357/2728] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:06.582997 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f331f8-ffd9-4f6c-a636-bb5fe5ec4494 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:06.584519 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b4f331f8-ffd9-4f6c-a636-bb5fe5ec4494 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:06.589500 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6c8b0257-68c7-4752-a496-8086b5e8087f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4c7a922b6ac4248925f857723b025a2'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:06.596631 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6c8b0257-68c7-4752-a496-8086b5e8087f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4c7a922b6ac4248925f857723b025a2'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:06.598852 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f331f8-ffd9-4f6c-a636-bb5fe5ec4494 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:06.604063 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da3bb2-7c4b-474c-90bf-8e8956c7d7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:06.604755 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da3bb2-7c4b-474c-90bf-8e8956c7d7cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:06.604924 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6c8b0257-68c7-4752-a496-8086b5e8087f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4c7a922b6ac4248925f857723b025a2'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:06.605534 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da3bb2-7c4b-474c-90bf-8e8956c7d7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:06.606308 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da3bb2-7c4b-474c-90bf-8e8956c7d7cb admin admin] PATH_INFO: `/v3/users/723faddfa02b4915b6947e6fe88d9407` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:06.607654 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da3bb2-7c4b-474c-90bf-8e8956c7d7cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=723faddfa02b4915b6947e6fe88d9407)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:06.609644 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da3bb2-7c4b-474c-90bf-8e8956c7d7cb admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:06.620957 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6c8b0257-68c7-4752-a496-8086b5e8087f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4c7a922b6ac4248925f857723b025a2'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:06.621827 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6c8b0257-68c7-4752-a496-8086b5e8087f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4c7a922b6ac4248925f857723b025a2'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:06.628147 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1372/2729] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:01:06 2022] DELETE /identity/v3/users/c4c7a922b6ac4248925f857723b025a2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:01:06.640740 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:06.667740 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c3da3bb2-7c4b-474c-90bf-8e8956c7d7cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '723faddfa02b4915b6947e6fe88d9407'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:06.682495 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c3da3bb2-7c4b-474c-90bf-8e8956c7d7cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '723faddfa02b4915b6947e6fe88d9407'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:06.691431 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c3da3bb2-7c4b-474c-90bf-8e8956c7d7cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '723faddfa02b4915b6947e6fe88d9407'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:06.700253 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c3da3bb2-7c4b-474c-90bf-8e8956c7d7cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '723faddfa02b4915b6947e6fe88d9407'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:06.701060 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c3da3bb2-7c4b-474c-90bf-8e8956c7d7cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '723faddfa02b4915b6947e6fe88d9407'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:06.708356 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1358/2730] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:01:06 2022] DELETE /identity/v3/users/723faddfa02b4915b6947e6fe88d9407 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:01:06.713189 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7eb29-4a10-48e3-ae13-bc12651acf74 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:06.713473 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7eb29-4a10-48e3-ae13-bc12651acf74 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:06.713907 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7eb29-4a10-48e3-ae13-bc12651acf74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:06.736361 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-b0d7eb29-4a10-48e3-ae13-bc12651acf74 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:06.737731 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b0d7eb29-4a10-48e3-ae13-bc12651acf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:06.820953 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1373/2731] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:06.828979 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da3bb2-7c4b-474c-90bf-8e8956c7d7cb admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:06.830639 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c3da3bb2-7c4b-474c-90bf-8e8956c7d7cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:06.897599 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da3bb2-7c4b-474c-90bf-8e8956c7d7cb admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:06.901540 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1255d-267f-46c9-9d88-5050c0daf916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:06.902486 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1255d-267f-46c9-9d88-5050c0daf916 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:06.902772 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1255d-267f-46c9-9d88-5050c0daf916 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:06.903124 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1255d-267f-46c9-9d88-5050c0daf916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:06.912549 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1255d-267f-46c9-9d88-5050c0daf916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:06.914039 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1255d-267f-46c9-9d88-5050c0daf916 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:06.925100 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1359/2732] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:06.961606 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7eb29-4a10-48e3-ae13-bc12651acf74 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:06.963177 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b0d7eb29-4a10-48e3-ae13-bc12651acf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:06.975955 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7eb29-4a10-48e3-ae13-bc12651acf74 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:06.992339 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f0a0b-ffae-4128-9abc-cbc1085fb59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:06.993170 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f0a0b-ffae-4128-9abc-cbc1085fb59e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:06.993267 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f0a0b-ffae-4128-9abc-cbc1085fb59e admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:06.993566 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f0a0b-ffae-4128-9abc-cbc1085fb59e admin admin] PATH_INFO: `/v3/projects/25734644ed1d426ab2fca6fddf937469` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:06.995004 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f0a0b-ffae-4128-9abc-cbc1085fb59e admin admin] RBAC: Authorizing `identity:delete_project(project_id=25734644ed1d426ab2fca6fddf937469)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:06.997748 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f0a0b-ffae-4128-9abc-cbc1085fb59e admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:07.010446 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:07.054579 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-716f0a0b-ffae-4128-9abc-cbc1085fb59e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25734644ed1d426ab2fca6fddf937469', 'request_id': 'req-716f0a0b-ffae-4128-9abc-cbc1085fb59e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:07.062547 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-716f0a0b-ffae-4128-9abc-cbc1085fb59e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25734644ed1d426ab2fca6fddf937469', 'request_id': 'req-716f0a0b-ffae-4128-9abc-cbc1085fb59e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:07.069229 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-716f0a0b-ffae-4128-9abc-cbc1085fb59e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25734644ed1d426ab2fca6fddf937469', 'request_id': 'req-716f0a0b-ffae-4128-9abc-cbc1085fb59e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:07.084920 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-716f0a0b-ffae-4128-9abc-cbc1085fb59e admin admin] The token cache is being invalidate because project 25734644ed1d426ab2fca6fddf937469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:01:07.085224 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-716f0a0b-ffae-4128-9abc-cbc1085fb59e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:07.085921 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-716f0a0b-ffae-4128-9abc-cbc1085fb59e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:07.087442 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1374/2733] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:01:06 2022] DELETE /identity/v3/projects/25734644ed1d426ab2fca6fddf937469 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:07.094884 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0451dd-41fb-4c7d-befa-49402cae33e8 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.095593 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0451dd-41fb-4c7d-befa-49402cae33e8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.095851 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0451dd-41fb-4c7d-befa-49402cae33e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.134929 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-ec0451dd-41fb-4c7d-befa-49402cae33e8 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:07.136349 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ec0451dd-41fb-4c7d-befa-49402cae33e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:07.219605 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1360/2734] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:07.229064 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee48d1-0cec-40b2-9295-9af8ec66ce49 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.229350 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee48d1-0cec-40b2-9295-9af8ec66ce49 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.229616 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee48d1-0cec-40b2-9295-9af8ec66ce49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.253636 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-3aee48d1-0cec-40b2-9295-9af8ec66ce49 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:07.254964 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3aee48d1-0cec-40b2-9295-9af8ec66ce49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:07.263206 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1375/2735] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:07.267914 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0451dd-41fb-4c7d-befa-49402cae33e8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:07.279339 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0451dd-41fb-4c7d-befa-49402cae33e8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:07.284760 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee48d1-0cec-40b2-9295-9af8ec66ce49 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:07.284957 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32326e72-019b-44d6-ba05-ee6f0f75cb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:07.285357 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32326e72-019b-44d6-ba05-ee6f0f75cb3b admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.285676 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32326e72-019b-44d6-ba05-ee6f0f75cb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.286002 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32326e72-019b-44d6-ba05-ee6f0f75cb3b admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.286453 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3aee48d1-0cec-40b2-9295-9af8ec66ce49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:07.286720 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32326e72-019b-44d6-ba05-ee6f0f75cb3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:01:07.287056 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32326e72-019b-44d6-ba05-ee6f0f75cb3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:07.288718 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32326e72-019b-44d6-ba05-ee6f0f75cb3b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:07.301425 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee48d1-0cec-40b2-9295-9af8ec66ce49 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:07.305562 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1361/2736] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 01:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:01:07.311411 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899c586-f3b2-4c5b-bfd7-9cd12e45bb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:07.312007 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899c586-f3b2-4c5b-bfd7-9cd12e45bb75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.312328 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899c586-f3b2-4c5b-bfd7-9cd12e45bb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.312621 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899c586-f3b2-4c5b-bfd7-9cd12e45bb75 admin admin] PATH_INFO: `/v3/projects/ae9f824c28f24ae99f836667ece85dbf` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.314157 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899c586-f3b2-4c5b-bfd7-9cd12e45bb75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae9f824c28f24ae99f836667ece85dbf)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:07.314860 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32326e72-019b-44d6-ba05-ee6f0f75cb3b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:07.317181 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899c586-f3b2-4c5b-bfd7-9cd12e45bb75 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:07.326859 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32326e72-019b-44d6-ba05-ee6f0f75cb3b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:07.332382 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95143952-2f4e-493f-918f-e675355e77fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:07.333116 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95143952-2f4e-493f-918f-e675355e77fa admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.333521 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95143952-2f4e-493f-918f-e675355e77fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.333923 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95143952-2f4e-493f-918f-e675355e77fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.334641 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95143952-2f4e-493f-918f-e675355e77fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:07.336713 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95143952-2f4e-493f-918f-e675355e77fa admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:07.372037 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1362/2737] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:01:07 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:07.373190 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95143952-2f4e-493f-918f-e675355e77fa admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:07.376402 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-b899c586-f3b2-4c5b-bfd7-9cd12e45bb75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae9f824c28f24ae99f836667ece85dbf', 'request_id': 'req-b899c586-f3b2-4c5b-bfd7-9cd12e45bb75'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:07.384355 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-b899c586-f3b2-4c5b-bfd7-9cd12e45bb75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae9f824c28f24ae99f836667ece85dbf', 'request_id': 'req-b899c586-f3b2-4c5b-bfd7-9cd12e45bb75'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:07.387883 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:07.392705 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-b899c586-f3b2-4c5b-bfd7-9cd12e45bb75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae9f824c28f24ae99f836667ece85dbf', 'request_id': 'req-b899c586-f3b2-4c5b-bfd7-9cd12e45bb75'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:07.404794 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-b899c586-f3b2-4c5b-bfd7-9cd12e45bb75 admin admin] The token cache is being invalidate because project ae9f824c28f24ae99f836667ece85dbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:01:07.405111 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-b899c586-f3b2-4c5b-bfd7-9cd12e45bb75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:07.405769 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-b899c586-f3b2-4c5b-bfd7-9cd12e45bb75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:07.409908 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1376/2738] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:01:07 2022] DELETE /identity/v3/projects/ae9f824c28f24ae99f836667ece85dbf => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:01:07.413327 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43f25b-4e96-4180-83f5-579bd0b05e12 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.413803 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43f25b-4e96-4180-83f5-579bd0b05e12 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.414142 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43f25b-4e96-4180-83f5-579bd0b05e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.435246 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-6b43f25b-4e96-4180-83f5-579bd0b05e12 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:07.436471 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6b43f25b-4e96-4180-83f5-579bd0b05e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:07.450076 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95143952-2f4e-493f-918f-e675355e77fa admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:07.455261 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03434c58-5f46-49cc-b602-9d57c047ad2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:07.456085 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03434c58-5f46-49cc-b602-9d57c047ad2b admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.456368 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03434c58-5f46-49cc-b602-9d57c047ad2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.456639 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03434c58-5f46-49cc-b602-9d57c047ad2b admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.457286 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03434c58-5f46-49cc-b602-9d57c047ad2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:07.459253 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03434c58-5f46-49cc-b602-9d57c047ad2b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:07.484235 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1363/2739] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:01:07 2022] POST /identity/v3/users => generated 286 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:01:07.488302 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03434c58-5f46-49cc-b602-9d57c047ad2b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:07.490063 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-03434c58-5f46-49cc-b602-9d57c047ad2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:07.503111 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03434c58-5f46-49cc-b602-9d57c047ad2b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:07.503847 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1377/2740] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:01:07.507817 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dec015-888c-4bb2-b5af-5d20d658fe36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:07.508417 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dec015-888c-4bb2-b5af-5d20d658fe36 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.508694 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dec015-888c-4bb2-b5af-5d20d658fe36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.508964 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dec015-888c-4bb2-b5af-5d20d658fe36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.509614 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dec015-888c-4bb2-b5af-5d20d658fe36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:07.511306 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dec015-888c-4bb2-b5af-5d20d658fe36 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:07.512227 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131df5c-f64b-4494-87e8-10a8e0096fe7 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.512560 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131df5c-f64b-4494-87e8-10a8e0096fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.512969 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131df5c-f64b-4494-87e8-10a8e0096fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.529492 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1364/2741] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:07.531249 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dec015-888c-4bb2-b5af-5d20d658fe36 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:07.533103 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-6131df5c-f64b-4494-87e8-10a8e0096fe7 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:07.534368 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6131df5c-f64b-4494-87e8-10a8e0096fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:07.542165 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dec015-888c-4bb2-b5af-5d20d658fe36 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:07.543999 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1378/2742] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:07.546986 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafab8b-99d0-469a-b35e-3015f8b3763a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:07.547702 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafab8b-99d0-469a-b35e-3015f8b3763a admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.547978 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafab8b-99d0-469a-b35e-3015f8b3763a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.548243 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafab8b-99d0-469a-b35e-3015f8b3763a admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.548348 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131df5c-f64b-4494-87e8-10a8e0096fe7 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:07.548874 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fafab8b-99d0-469a-b35e-3015f8b3763a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:07.550525 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fafab8b-99d0-469a-b35e-3015f8b3763a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:07.557240 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131df5c-f64b-4494-87e8-10a8e0096fe7 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:07.561501 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1365/2743] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:07.565444 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc773ae-03a5-41f6-a92a-909238a8a542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:07.566137 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc773ae-03a5-41f6-a92a-909238a8a542 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.566412 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc773ae-03a5-41f6-a92a-909238a8a542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.566690 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc773ae-03a5-41f6-a92a-909238a8a542 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.566818 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafab8b-99d0-469a-b35e-3015f8b3763a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:07.567409 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc773ae-03a5-41f6-a92a-909238a8a542 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:01:07.567706 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc773ae-03a5-41f6-a92a-909238a8a542 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:07.569335 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc773ae-03a5-41f6-a92a-909238a8a542 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:07.572194 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:07.579646 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafab8b-99d0-469a-b35e-3015f8b3763a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:07.584965 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054927e-891d-46b2-931e-1ca7f40086d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:07.585628 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054927e-891d-46b2-931e-1ca7f40086d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.586054 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054927e-891d-46b2-931e-1ca7f40086d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.586202 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1379/2744] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 01:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:01:07.586343 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054927e-891d-46b2-931e-1ca7f40086d7 admin admin] PATH_INFO: `/v3/projects/cfa9b973f41d4f12bc68e43fa575cd92/users/dfc51f7d8f6a4801b73ea04c801ac01e/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.586944 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc773ae-03a5-41f6-a92a-909238a8a542 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:07.596770 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc773ae-03a5-41f6-a92a-909238a8a542 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:07.601331 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671803f-1876-41bb-8028-c71c300d4ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:07.601971 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671803f-1876-41bb-8028-c71c300d4ebc admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.602253 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671803f-1876-41bb-8028-c71c300d4ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.602530 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671803f-1876-41bb-8028-c71c300d4ebc admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.603159 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671803f-1876-41bb-8028-c71c300d4ebc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:07.605133 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671803f-1876-41bb-8028-c71c300d4ebc admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:07.611494 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5054927e-891d-46b2-931e-1ca7f40086d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa9b973f41d4f12bc68e43fa575cd92, user_id=dfc51f7d8f6a4801b73ea04c801ac01e, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:07.614534 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5054927e-891d-46b2-931e-1ca7f40086d7 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:07.632157 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1366/2745] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:07 2022] PUT /identity/v3/projects/cfa9b973f41d4f12bc68e43fa575cd92/users/dfc51f7d8f6a4801b73ea04c801ac01e/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:07.641156 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4ba75-39a7-4821-b1d3-ea2c99734417 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.641463 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4ba75-39a7-4821-b1d3-ea2c99734417 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.641734 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4ba75-39a7-4821-b1d3-ea2c99734417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.649423 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1380/2746] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:01:07 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:07.653731 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671803f-1876-41bb-8028-c71c300d4ebc admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:07.674774 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-dff4ba75-39a7-4821-b1d3-ea2c99734417 None None] MFA Rules not processed for user `dfc51f7d8f6a4801b73ea04c801ac01e`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:07.676416 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-dff4ba75-39a7-4821-b1d3-ea2c99734417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:07.725863 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671803f-1876-41bb-8028-c71c300d4ebc admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:07.731841 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715ad03-d4e3-4efa-8c7b-1f3912916c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:07.732529 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715ad03-d4e3-4efa-8c7b-1f3912916c32 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.732809 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715ad03-d4e3-4efa-8c7b-1f3912916c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.733079 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715ad03-d4e3-4efa-8c7b-1f3912916c32 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.733724 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715ad03-d4e3-4efa-8c7b-1f3912916c32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:07.735681 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715ad03-d4e3-4efa-8c7b-1f3912916c32 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:07.749463 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1367/2747] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:07.753900 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4ba75-39a7-4821-b1d3-ea2c99734417 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:07.764035 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1381/2748] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:01:07 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:01:07.766995 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4ba75-39a7-4821-b1d3-ea2c99734417 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:07.768127 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715ad03-d4e3-4efa-8c7b-1f3912916c32 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:07.772057 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e0d42-42dc-4527-8556-2a2af87a68f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:07.772806 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e0d42-42dc-4527-8556-2a2af87a68f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.773377 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e0d42-42dc-4527-8556-2a2af87a68f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.773659 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e0d42-42dc-4527-8556-2a2af87a68f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.774929 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e0d42-42dc-4527-8556-2a2af87a68f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:07.776960 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e0d42-42dc-4527-8556-2a2af87a68f9 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:07.778482 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715ad03-d4e3-4efa-8c7b-1f3912916c32 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:07.783062 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43e5f6-33b9-4a87-b9d5-233344accb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:07.783675 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43e5f6-33b9-4a87-b9d5-233344accb5b admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.783954 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43e5f6-33b9-4a87-b9d5-233344accb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.784226 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43e5f6-33b9-4a87-b9d5-233344accb5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.784859 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43e5f6-33b9-4a87-b9d5-233344accb5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:07.786557 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43e5f6-33b9-4a87-b9d5-233344accb5b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:07.801942 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1382/2749] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:01:07.805828 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43e5f6-33b9-4a87-b9d5-233344accb5b admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:07.813748 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1368/2750] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:01:07 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:07.815401 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e0d42-42dc-4527-8556-2a2af87a68f9 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:07.821986 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43e5f6-33b9-4a87-b9d5-233344accb5b admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:07.849130 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:07.894987 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe9362-e6ab-45e5-b767-aa0e02672d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:07.895740 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe9362-e6ab-45e5-b767-aa0e02672d76 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.896116 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe9362-e6ab-45e5-b767-aa0e02672d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.896442 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe9362-e6ab-45e5-b767-aa0e02672d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.897149 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe9362-e6ab-45e5-b767-aa0e02672d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:07.898780 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe9362-e6ab-45e5-b767-aa0e02672d76 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:07.900561 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e0d42-42dc-4527-8556-2a2af87a68f9 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:07.907154 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ec2e9-b2e6-4097-a5ac-580e0fff7516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:07.907812 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ec2e9-b2e6-4097-a5ac-580e0fff7516 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.908170 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ec2e9-b2e6-4097-a5ac-580e0fff7516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.908481 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ec2e9-b2e6-4097-a5ac-580e0fff7516 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.909155 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ec2e9-b2e6-4097-a5ac-580e0fff7516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:07.909435 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1383/2751] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:01:07.913289 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ec2e9-b2e6-4097-a5ac-580e0fff7516 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:07.915857 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe9362-e6ab-45e5-b767-aa0e02672d76 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:07.926029 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe9362-e6ab-45e5-b767-aa0e02672d76 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:07.930758 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473a14b-6816-4697-adcd-711dd3a1646d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:07.931420 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473a14b-6816-4697-adcd-711dd3a1646d admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.931745 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473a14b-6816-4697-adcd-711dd3a1646d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.932050 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473a14b-6816-4697-adcd-711dd3a1646d admin admin] PATH_INFO: `/v3/projects/fb2585e83e3b491e9778b7a05784cf1a/users/ea556832341448239b867f33e7053ef6/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.945768 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1369/2752] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:01:07 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:07.946850 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ec2e9-b2e6-4097-a5ac-580e0fff7516 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:07.950940 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473a14b-6816-4697-adcd-711dd3a1646d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb2585e83e3b491e9778b7a05784cf1a, user_id=ea556832341448239b867f33e7053ef6, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:07.953565 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473a14b-6816-4697-adcd-711dd3a1646d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:07.957154 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ec2e9-b2e6-4097-a5ac-580e0fff7516 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:07.962704 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667101f-201a-4757-b7e0-071396bd1305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:07.963299 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667101f-201a-4757-b7e0-071396bd1305 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.963573 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667101f-201a-4757-b7e0-071396bd1305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.963838 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667101f-201a-4757-b7e0-071396bd1305 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.964557 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7667101f-201a-4757-b7e0-071396bd1305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:07.966660 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7667101f-201a-4757-b7e0-071396bd1305 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:07.970692 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1384/2753] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:07 2022] PUT /identity/v3/projects/fb2585e83e3b491e9778b7a05784cf1a/users/ea556832341448239b867f33e7053ef6/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:01:07.972285 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c0e7d-ace5-45bf-b3ad-96024558884c None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.972570 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c0e7d-ace5-45bf-b3ad-96024558884c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.974199 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c0e7d-ace5-45bf-b3ad-96024558884c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.981521 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1370/2754] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:07.985444 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667101f-201a-4757-b7e0-071396bd1305 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:07.994692 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-e48c0e7d-ace5-45bf-b3ad-96024558884c None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:07.995067 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667101f-201a-4757-b7e0-071396bd1305 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:07.996111 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e48c0e7d-ace5-45bf-b3ad-96024558884c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:08.016840 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:08.055873 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab4d24-3ae0-4a69-bc5a-021e535bdce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:08.056540 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab4d24-3ae0-4a69-bc5a-021e535bdce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:08.056818 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab4d24-3ae0-4a69-bc5a-021e535bdce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:08.057141 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab4d24-3ae0-4a69-bc5a-021e535bdce6 admin admin] PATH_INFO: `/v3/projects/18129414d9cc40e1af2f6300e7a050f1/users/20b2c298f1334ffaa62b729b21d2ad4e/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:08.060488 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1385/2755] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:08.071021 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c0e7d-ace5-45bf-b3ad-96024558884c None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:08.072463 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e48c0e7d-ace5-45bf-b3ad-96024558884c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:08.074620 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab4d24-3ae0-4a69-bc5a-021e535bdce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18129414d9cc40e1af2f6300e7a050f1, user_id=20b2c298f1334ffaa62b729b21d2ad4e, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:08.077308 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab4d24-3ae0-4a69-bc5a-021e535bdce6 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:08.091736 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1371/2756] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:07 2022] PUT /identity/v3/projects/18129414d9cc40e1af2f6300e7a050f1/users/20b2c298f1334ffaa62b729b21d2ad4e/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:01:08.096075 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab4d24-3ae0-4a69-bc5a-021e535bdce6 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:08.140454 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c0e7d-ace5-45bf-b3ad-96024558884c None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:08.161165 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab4d24-3ae0-4a69-bc5a-021e535bdce6 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:08.167187 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e07f1-301c-41d3-9c38-3269abba8e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:08.167891 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e07f1-301c-41d3-9c38-3269abba8e32 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:08.168404 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e07f1-301c-41d3-9c38-3269abba8e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:08.168404 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e07f1-301c-41d3-9c38-3269abba8e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:08.168970 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e07f1-301c-41d3-9c38-3269abba8e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:08.170649 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e07f1-301c-41d3-9c38-3269abba8e32 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:08.181872 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1372/2757] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:01:08.186164 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e07f1-301c-41d3-9c38-3269abba8e32 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:08.197319 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b622e30-0303-4498-b708-49fcd90f1751 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:08.197319 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b622e30-0303-4498-b708-49fcd90f1751 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:08.197319 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b622e30-0303-4498-b708-49fcd90f1751 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:08.197319 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b622e30-0303-4498-b708-49fcd90f1751 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:08.197873 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e07f1-301c-41d3-9c38-3269abba8e32 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:08.202918 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ac225-36ec-4dec-a056-60afcb3129ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:08.204028 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ac225-36ec-4dec-a056-60afcb3129ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:08.204427 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ac225-36ec-4dec-a056-60afcb3129ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:08.204804 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ac225-36ec-4dec-a056-60afcb3129ba admin admin] PATH_INFO: `/v3/projects/18129414d9cc40e1af2f6300e7a050f1/users/20b2c298f1334ffaa62b729b21d2ad4e/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:08.208826 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210ac225-36ec-4dec-a056-60afcb3129ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=18129414d9cc40e1af2f6300e7a050f1, user_id=20b2c298f1334ffaa62b729b21d2ad4e, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:08.209300 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b622e30-0303-4498-b708-49fcd90f1751 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:08.211755 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b622e30-0303-4498-b708-49fcd90f1751 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:08.213650 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210ac225-36ec-4dec-a056-60afcb3129ba admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:08.224973 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1386/2758] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:08.228543 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1373/2759] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:08 2022] PUT /identity/v3/projects/18129414d9cc40e1af2f6300e7a050f1/users/20b2c298f1334ffaa62b729b21d2ad4e/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:01:08.247527 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4f470-b260-4035-8e8c-2b32410a0fed None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:08.247903 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4f470-b260-4035-8e8c-2b32410a0fed None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:08.248353 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4f470-b260-4035-8e8c-2b32410a0fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:08.280468 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-32a4f470-b260-4035-8e8c-2b32410a0fed None None] MFA Rules not processed for user `20b2c298f1334ffaa62b729b21d2ad4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:08.282994 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-32a4f470-b260-4035-8e8c-2b32410a0fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:08.364632 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1387/2760] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:08.376847 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ac225-36ec-4dec-a056-60afcb3129ba admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:08.378843 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-210ac225-36ec-4dec-a056-60afcb3129ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:08.397060 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:08.458254 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ac225-36ec-4dec-a056-60afcb3129ba admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:08.462012 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6eec9-b94a-49d8-95cc-d891fd91ec9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:08.462631 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6eec9-b94a-49d8-95cc-d891fd91ec9d service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:08.462931 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6eec9-b94a-49d8-95cc-d891fd91ec9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:08.463197 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6eec9-b94a-49d8-95cc-d891fd91ec9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:08.528970 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6eec9-b94a-49d8-95cc-d891fd91ec9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:08.534195 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6eec9-b94a-49d8-95cc-d891fd91ec9d service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:08.547196 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1374/2761] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:09.232326 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b7ca8-0136-479c-9c71-369c7b5f2f33 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:09.232839 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b7ca8-0136-479c-9c71-369c7b5f2f33 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:09.232958 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b7ca8-0136-479c-9c71-369c7b5f2f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:09.253179 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:09.262851 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-e14b7ca8-0136-479c-9c71-369c7b5f2f33 None None] MFA Rules not processed for user `ea556832341448239b867f33e7053ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:09.264214 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e14b7ca8-0136-479c-9c71-369c7b5f2f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:09.338232 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1388/2762] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:09.349368 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6eec9-b94a-49d8-95cc-d891fd91ec9d service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:09.351058 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-70c6eec9-b94a-49d8-95cc-d891fd91ec9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:09.366062 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6eec9-b94a-49d8-95cc-d891fd91ec9d service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:09.369954 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69765687-d2cc-4553-b87f-cc67ae3d83ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:09.370786 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69765687-d2cc-4553-b87f-cc67ae3d83ef service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:09.371469 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69765687-d2cc-4553-b87f-cc67ae3d83ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:09.372616 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69765687-d2cc-4553-b87f-cc67ae3d83ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:09.381695 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69765687-d2cc-4553-b87f-cc67ae3d83ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:09.383176 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69765687-d2cc-4553-b87f-cc67ae3d83ef service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:09.392982 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1375/2763] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:10.766917 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b4d3e-8712-48f9-9377-559d87a5efbc None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:10.767492 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b4d3e-8712-48f9-9377-559d87a5efbc None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:10.767492 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b4d3e-8712-48f9-9377-559d87a5efbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:10.787121 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-822b4d3e-8712-48f9-9377-559d87a5efbc None None] MFA Rules not processed for user `ea556832341448239b867f33e7053ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:10.788322 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-822b4d3e-8712-48f9-9377-559d87a5efbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:10.796226 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1389/2764] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:11.049222 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69765687-d2cc-4553-b87f-cc67ae3d83ef service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:11.107475 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69765687-d2cc-4553-b87f-cc67ae3d83ef service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:11.112406 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ad1ec-9b31-4e03-a7af-322696eeefac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:11.113008 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ad1ec-9b31-4e03-a7af-322696eeefac service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:11.113282 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ad1ec-9b31-4e03-a7af-322696eeefac service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:11.113561 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ad1ec-9b31-4e03-a7af-322696eeefac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:11.115668 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d96ad1ec-9b31-4e03-a7af-322696eeefac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:11.125967 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ad1ec-9b31-4e03-a7af-322696eeefac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:11.127442 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ad1ec-9b31-4e03-a7af-322696eeefac service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:11.135335 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1376/2765] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:11.230140 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b4d3e-8712-48f9-9377-559d87a5efbc None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:11.312920 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b4d3e-8712-48f9-9377-559d87a5efbc None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:11.318057 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99fc6c-8e5d-435a-98ca-458315f0fbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:11.318830 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99fc6c-8e5d-435a-98ca-458315f0fbf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:11.319232 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99fc6c-8e5d-435a-98ca-458315f0fbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:11.319583 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99fc6c-8e5d-435a-98ca-458315f0fbf7 admin admin] PATH_INFO: `/v3/users/dfc51f7d8f6a4801b73ea04c801ac01e` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:11.320876 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99fc6c-8e5d-435a-98ca-458315f0fbf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfc51f7d8f6a4801b73ea04c801ac01e)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:11.323083 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99fc6c-8e5d-435a-98ca-458315f0fbf7 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:11.395319 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ef99fc6c-8e5d-435a-98ca-458315f0fbf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfc51f7d8f6a4801b73ea04c801ac01e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:11.403303 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ef99fc6c-8e5d-435a-98ca-458315f0fbf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfc51f7d8f6a4801b73ea04c801ac01e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:11.411622 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ef99fc6c-8e5d-435a-98ca-458315f0fbf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfc51f7d8f6a4801b73ea04c801ac01e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:11.427714 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ef99fc6c-8e5d-435a-98ca-458315f0fbf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfc51f7d8f6a4801b73ea04c801ac01e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:11.428467 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ef99fc6c-8e5d-435a-98ca-458315f0fbf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfc51f7d8f6a4801b73ea04c801ac01e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:11.435443 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1390/2766] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:01:11 2022] DELETE /identity/v3/users/dfc51f7d8f6a4801b73ea04c801ac01e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:11.440319 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad5904-4dca-424f-9220-7f6725f291f6 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:11.440607 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad5904-4dca-424f-9220-7f6725f291f6 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:11.440879 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad5904-4dca-424f-9220-7f6725f291f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:11.472682 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-21ad5904-4dca-424f-9220-7f6725f291f6 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:11.475595 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-21ad5904-4dca-424f-9220-7f6725f291f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:11.537023 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:11.561605 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1377/2767] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:11.578333 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99fc6c-8e5d-435a-98ca-458315f0fbf7 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:11.579875 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ef99fc6c-8e5d-435a-98ca-458315f0fbf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:11.596551 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:11.661326 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99fc6c-8e5d-435a-98ca-458315f0fbf7 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:11.666294 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4255a-e734-405e-a153-8315d72a99e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:11.667096 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4255a-e734-405e-a153-8315d72a99e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:11.667215 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4255a-e734-405e-a153-8315d72a99e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:11.667565 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4255a-e734-405e-a153-8315d72a99e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:11.679917 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb4255a-e734-405e-a153-8315d72a99e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:11.681382 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb4255a-e734-405e-a153-8315d72a99e0 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:11.720995 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1391/2768] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:12.049347 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad5904-4dca-424f-9220-7f6725f291f6 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:12.050824 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-21ad5904-4dca-424f-9220-7f6725f291f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:12.063708 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad5904-4dca-424f-9220-7f6725f291f6 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:12.068656 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a855c-9240-43d0-a080-5698f8b33651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:12.069546 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a855c-9240-43d0-a080-5698f8b33651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:12.069828 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a855c-9240-43d0-a080-5698f8b33651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:12.070127 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a855c-9240-43d0-a080-5698f8b33651 admin admin] PATH_INFO: `/v3/projects/cfa9b973f41d4f12bc68e43fa575cd92` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:12.071459 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a855c-9240-43d0-a080-5698f8b33651 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfa9b973f41d4f12bc68e43fa575cd92)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:12.074108 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a855c-9240-43d0-a080-5698f8b33651 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:12.135599 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-aa7a855c-9240-43d0-a080-5698f8b33651 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfa9b973f41d4f12bc68e43fa575cd92', 'request_id': 'req-aa7a855c-9240-43d0-a080-5698f8b33651'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:12.145035 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-aa7a855c-9240-43d0-a080-5698f8b33651 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfa9b973f41d4f12bc68e43fa575cd92', 'request_id': 'req-aa7a855c-9240-43d0-a080-5698f8b33651'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:12.151726 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-aa7a855c-9240-43d0-a080-5698f8b33651 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfa9b973f41d4f12bc68e43fa575cd92', 'request_id': 'req-aa7a855c-9240-43d0-a080-5698f8b33651'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:12.165796 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-aa7a855c-9240-43d0-a080-5698f8b33651 admin admin] The token cache is being invalidate because project cfa9b973f41d4f12bc68e43fa575cd92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:01:12.166130 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-aa7a855c-9240-43d0-a080-5698f8b33651 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:12.166772 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-aa7a855c-9240-43d0-a080-5698f8b33651 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:12.168367 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1378/2769] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:01:12 2022] DELETE /identity/v3/projects/cfa9b973f41d4f12bc68e43fa575cd92 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:12.172440 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4255a-e734-405e-a153-8315d72a99e0 service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:12.184648 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4255a-e734-405e-a153-8315d72a99e0 service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:12.265281 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8028c3f-302c-4445-b62e-f70d8bad5117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:12.265973 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8028c3f-302c-4445-b62e-f70d8bad5117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:12.266247 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8028c3f-302c-4445-b62e-f70d8bad5117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:12.266537 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8028c3f-302c-4445-b62e-f70d8bad5117 admin admin] PATH_INFO: `/v3/users/20b2c298f1334ffaa62b729b21d2ad4e` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:12.267715 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8028c3f-302c-4445-b62e-f70d8bad5117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20b2c298f1334ffaa62b729b21d2ad4e)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:12.269754 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8028c3f-302c-4445-b62e-f70d8bad5117 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:12.328012 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-e8028c3f-302c-4445-b62e-f70d8bad5117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20b2c298f1334ffaa62b729b21d2ad4e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:12.336957 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-e8028c3f-302c-4445-b62e-f70d8bad5117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20b2c298f1334ffaa62b729b21d2ad4e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:12.346944 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-e8028c3f-302c-4445-b62e-f70d8bad5117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20b2c298f1334ffaa62b729b21d2ad4e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:12.366039 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-e8028c3f-302c-4445-b62e-f70d8bad5117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20b2c298f1334ffaa62b729b21d2ad4e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:12.366846 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-e8028c3f-302c-4445-b62e-f70d8bad5117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20b2c298f1334ffaa62b729b21d2ad4e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:12.373887 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1392/2770] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:01:12 2022] DELETE /identity/v3/users/20b2c298f1334ffaa62b729b21d2ad4e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:12.712047 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a855c-9240-43d0-a080-5698f8b33651 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:12.715125 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-aa7a855c-9240-43d0-a080-5698f8b33651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:12.737589 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a855c-9240-43d0-a080-5698f8b33651 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:12.822478 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f4dc2-636a-4363-9f93-04a91d139ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:12.823129 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f4dc2-636a-4363-9f93-04a91d139ac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:12.823407 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f4dc2-636a-4363-9f93-04a91d139ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:12.824631 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f4dc2-636a-4363-9f93-04a91d139ac6 admin admin] PATH_INFO: `/v3/projects/18129414d9cc40e1af2f6300e7a050f1` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:12.827714 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f4dc2-636a-4363-9f93-04a91d139ac6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18129414d9cc40e1af2f6300e7a050f1)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:12.831912 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f4dc2-636a-4363-9f93-04a91d139ac6 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:12.923642 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-214f4dc2-636a-4363-9f93-04a91d139ac6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18129414d9cc40e1af2f6300e7a050f1', 'request_id': 'req-214f4dc2-636a-4363-9f93-04a91d139ac6'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:12.931734 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-214f4dc2-636a-4363-9f93-04a91d139ac6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18129414d9cc40e1af2f6300e7a050f1', 'request_id': 'req-214f4dc2-636a-4363-9f93-04a91d139ac6'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:12.943089 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-214f4dc2-636a-4363-9f93-04a91d139ac6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18129414d9cc40e1af2f6300e7a050f1', 'request_id': 'req-214f4dc2-636a-4363-9f93-04a91d139ac6'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:12.961450 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-214f4dc2-636a-4363-9f93-04a91d139ac6 admin admin] The token cache is being invalidate because project 18129414d9cc40e1af2f6300e7a050f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:01:12.961864 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-214f4dc2-636a-4363-9f93-04a91d139ac6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:12.963727 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-214f4dc2-636a-4363-9f93-04a91d139ac6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:12.966691 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1379/2771] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:01:12 2022] DELETE /identity/v3/projects/18129414d9cc40e1af2f6300e7a050f1 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:12.971611 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c425e1-a4b8-47e0-a4f5-0a26e1e38577 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:12.972488 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c425e1-a4b8-47e0-a4f5-0a26e1e38577 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:12.972777 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c425e1-a4b8-47e0-a4f5-0a26e1e38577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:12.998638 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-d1c425e1-a4b8-47e0-a4f5-0a26e1e38577 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:13.000057 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d1c425e1-a4b8-47e0-a4f5-0a26e1e38577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:13.052894 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:13.102519 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1393/2772] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:13.104221 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c955f-1f22-43bd-8a47-3aedda7598fa None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:13.104719 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c955f-1f22-43bd-8a47-3aedda7598fa None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:13.104830 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c955f-1f22-43bd-8a47-3aedda7598fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:13.115838 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:13.131170 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-048c955f-1f22-43bd-8a47-3aedda7598fa None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:13.134190 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-048c955f-1f22-43bd-8a47-3aedda7598fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:13.149661 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1380/2773] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:01:13.154510 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c425e1-a4b8-47e0-a4f5-0a26e1e38577 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:13.165068 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c425e1-a4b8-47e0-a4f5-0a26e1e38577 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:13.175931 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21104a04-ffc9-41f9-942e-a15ec74cc5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:13.176572 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21104a04-ffc9-41f9-942e-a15ec74cc5d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:13.176814 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21104a04-ffc9-41f9-942e-a15ec74cc5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:13.181215 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21104a04-ffc9-41f9-942e-a15ec74cc5d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:13.181952 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21104a04-ffc9-41f9-942e-a15ec74cc5d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:01:13.182462 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21104a04-ffc9-41f9-942e-a15ec74cc5d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:13.184501 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21104a04-ffc9-41f9-942e-a15ec74cc5d7 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:13.207778 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1394/2774] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 01:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:01:13.212429 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c955f-1f22-43bd-8a47-3aedda7598fa None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:13.223769 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c955f-1f22-43bd-8a47-3aedda7598fa None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:13.231332 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49844ee-9ca1-46af-b833-4bb5157c252c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:13.232077 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49844ee-9ca1-46af-b833-4bb5157c252c admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:13.232676 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49844ee-9ca1-46af-b833-4bb5157c252c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:13.233152 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49844ee-9ca1-46af-b833-4bb5157c252c admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:13.233969 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49844ee-9ca1-46af-b833-4bb5157c252c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:13.236498 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49844ee-9ca1-46af-b833-4bb5157c252c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:13.271748 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1381/2775] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:01:13 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:13.276078 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21104a04-ffc9-41f9-942e-a15ec74cc5d7 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:13.287365 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21104a04-ffc9-41f9-942e-a15ec74cc5d7 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:13.350534 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68210e1c-04aa-4877-9b81-0c1f45c049b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:13.351205 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68210e1c-04aa-4877-9b81-0c1f45c049b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:13.351537 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68210e1c-04aa-4877-9b81-0c1f45c049b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:13.351924 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68210e1c-04aa-4877-9b81-0c1f45c049b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:13.352609 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68210e1c-04aa-4877-9b81-0c1f45c049b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:13.354780 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68210e1c-04aa-4877-9b81-0c1f45c049b1 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:13.380573 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1395/2776] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:01:13 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:01:13.385971 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49844ee-9ca1-46af-b833-4bb5157c252c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:13.399515 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49844ee-9ca1-46af-b833-4bb5157c252c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:13.404669 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b644a-b9dc-4e67-b88c-e771bf3dd3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:13.405324 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b644a-b9dc-4e67-b88c-e771bf3dd3ef admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:13.405604 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b644a-b9dc-4e67-b88c-e771bf3dd3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:13.405920 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b644a-b9dc-4e67-b88c-e771bf3dd3ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:13.406602 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b644a-b9dc-4e67-b88c-e771bf3dd3ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:13.408269 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b644a-b9dc-4e67-b88c-e771bf3dd3ef admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:13.419643 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1382/2777] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:01:13.423904 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68210e1c-04aa-4877-9b81-0c1f45c049b1 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:13.434867 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68210e1c-04aa-4877-9b81-0c1f45c049b1 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:13.440942 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb08c0-feb3-4725-a080-a4256613e609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:13.441630 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb08c0-feb3-4725-a080-a4256613e609 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:13.442288 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb08c0-feb3-4725-a080-a4256613e609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:13.442635 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb08c0-feb3-4725-a080-a4256613e609 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:13.443790 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb08c0-feb3-4725-a080-a4256613e609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:13.445604 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb08c0-feb3-4725-a080-a4256613e609 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:13.460376 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1396/2778] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:13.464962 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b644a-b9dc-4e67-b88c-e771bf3dd3ef admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:13.475526 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b644a-b9dc-4e67-b88c-e771bf3dd3ef admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:13.481944 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a830e0-e451-48ec-8fc0-55238d4060c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:13.482830 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a830e0-e451-48ec-8fc0-55238d4060c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:13.483513 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a830e0-e451-48ec-8fc0-55238d4060c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:13.484244 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a830e0-e451-48ec-8fc0-55238d4060c2 admin admin] PATH_INFO: `/v3/projects/5c0685292e6e4995adb05ad94eb139d5/users/0aabc9e5eaa94103bb88e425ed745854/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:13.505124 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a830e0-e451-48ec-8fc0-55238d4060c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c0685292e6e4995adb05ad94eb139d5, user_id=0aabc9e5eaa94103bb88e425ed745854, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:13.508868 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a830e0-e451-48ec-8fc0-55238d4060c2 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:13.533811 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1383/2779] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:13 2022] PUT /identity/v3/projects/5c0685292e6e4995adb05ad94eb139d5/users/0aabc9e5eaa94103bb88e425ed745854/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:13.539377 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87279fa2-85fe-4e2d-bf74-7d92517af576 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:13.539842 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87279fa2-85fe-4e2d-bf74-7d92517af576 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:13.540251 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87279fa2-85fe-4e2d-bf74-7d92517af576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:13.565674 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-87279fa2-85fe-4e2d-bf74-7d92517af576 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:13.567189 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-87279fa2-85fe-4e2d-bf74-7d92517af576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:13.641387 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1397/2780] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:13.649413 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a830e0-e451-48ec-8fc0-55238d4060c2 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:13.651181 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-81a830e0-e451-48ec-8fc0-55238d4060c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:13.724209 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a830e0-e451-48ec-8fc0-55238d4060c2 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:13.728218 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d226216-69aa-4b79-b49c-31b0bf45aaa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:13.728838 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d226216-69aa-4b79-b49c-31b0bf45aaa5 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:13.729117 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d226216-69aa-4b79-b49c-31b0bf45aaa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:13.729386 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d226216-69aa-4b79-b49c-31b0bf45aaa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:13.743705 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d226216-69aa-4b79-b49c-31b0bf45aaa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:13.745758 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d226216-69aa-4b79-b49c-31b0bf45aaa5 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:13.757506 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1384/2781] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:14.550270 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79556b1-5b97-415b-a705-313325788b0a None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:14.552152 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79556b1-5b97-415b-a705-313325788b0a None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:14.552429 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79556b1-5b97-415b-a705-313325788b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:14.588800 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-c79556b1-5b97-415b-a705-313325788b0a None None] MFA Rules not processed for user `0aabc9e5eaa94103bb88e425ed745854`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:14.590396 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c79556b1-5b97-415b-a705-313325788b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:14.639937 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:14.682789 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1398/2782] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:14.696609 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d226216-69aa-4b79-b49c-31b0bf45aaa5 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:14.698189 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0d226216-69aa-4b79-b49c-31b0bf45aaa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:14.761748 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d226216-69aa-4b79-b49c-31b0bf45aaa5 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:14.766182 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320e680-edf1-4fb1-956e-119bf154c03b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:14.766970 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320e680-edf1-4fb1-956e-119bf154c03b service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:14.767408 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320e680-edf1-4fb1-956e-119bf154c03b service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:14.767688 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320e680-edf1-4fb1-956e-119bf154c03b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:14.780069 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c320e680-edf1-4fb1-956e-119bf154c03b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:14.781538 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c320e680-edf1-4fb1-956e-119bf154c03b service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:14.793262 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1385/2783] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:16.287567 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a2ddb-a14a-4412-a33e-e57731b36145 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:16.288159 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a2ddb-a14a-4412-a33e-e57731b36145 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:16.288323 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a2ddb-a14a-4412-a33e-e57731b36145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:16.312629 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-529a2ddb-a14a-4412-a33e-e57731b36145 None None] MFA Rules not processed for user `0aabc9e5eaa94103bb88e425ed745854`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:16.314148 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-529a2ddb-a14a-4412-a33e-e57731b36145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:16.322470 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1399/2784] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:17.323736 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320e680-edf1-4fb1-956e-119bf154c03b service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:17.325869 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c320e680-edf1-4fb1-956e-119bf154c03b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:17.341775 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320e680-edf1-4fb1-956e-119bf154c03b service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:17.346736 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c91e87-b619-412e-81de-6a2c681a3316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:17.347403 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c91e87-b619-412e-81de-6a2c681a3316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:17.347679 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c91e87-b619-412e-81de-6a2c681a3316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:17.347950 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c91e87-b619-412e-81de-6a2c681a3316 admin admin] PATH_INFO: `/v3/users/45ab203af5da42699bbe0c9658411a9f` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:17.349120 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c91e87-b619-412e-81de-6a2c681a3316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45ab203af5da42699bbe0c9658411a9f)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:17.351226 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c91e87-b619-412e-81de-6a2c681a3316 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:17.396276 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:17.403118 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-26c91e87-b619-412e-81de-6a2c681a3316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45ab203af5da42699bbe0c9658411a9f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:17.417344 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-26c91e87-b619-412e-81de-6a2c681a3316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45ab203af5da42699bbe0c9658411a9f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:17.425232 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-26c91e87-b619-412e-81de-6a2c681a3316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45ab203af5da42699bbe0c9658411a9f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:17.434755 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-26c91e87-b619-412e-81de-6a2c681a3316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45ab203af5da42699bbe0c9658411a9f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:17.435497 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-26c91e87-b619-412e-81de-6a2c681a3316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45ab203af5da42699bbe0c9658411a9f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:17.442933 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1386/2785] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:01:17 2022] DELETE /identity/v3/users/45ab203af5da42699bbe0c9658411a9f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:17.447594 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d08197-a6c9-4dc3-b437-7899825ad9db None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:17.448074 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d08197-a6c9-4dc3-b437-7899825ad9db None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:17.448271 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d08197-a6c9-4dc3-b437-7899825ad9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:17.467997 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-e7d08197-a6c9-4dc3-b437-7899825ad9db None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:17.469124 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e7d08197-a6c9-4dc3-b437-7899825ad9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:17.611943 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1400/2786] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:17.629983 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c91e87-b619-412e-81de-6a2c681a3316 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:17.631742 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-26c91e87-b619-412e-81de-6a2c681a3316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:17.737770 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c91e87-b619-412e-81de-6a2c681a3316 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:17.742262 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77c10f-fee6-4836-a6cd-7067f80286e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:17.742946 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77c10f-fee6-4836-a6cd-7067f80286e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:17.743934 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77c10f-fee6-4836-a6cd-7067f80286e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:17.744940 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77c10f-fee6-4836-a6cd-7067f80286e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:17.755723 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77c10f-fee6-4836-a6cd-7067f80286e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:17.757711 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77c10f-fee6-4836-a6cd-7067f80286e9 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:17.768582 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1387/2787] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:18.232444 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d08197-a6c9-4dc3-b437-7899825ad9db None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:18.234397 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e7d08197-a6c9-4dc3-b437-7899825ad9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:18.247000 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d08197-a6c9-4dc3-b437-7899825ad9db None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:18.251664 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c373e74-8691-41ee-b485-3758027c16a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:18.252378 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c373e74-8691-41ee-b485-3758027c16a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:18.252664 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c373e74-8691-41ee-b485-3758027c16a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:18.252959 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c373e74-8691-41ee-b485-3758027c16a7 admin admin] PATH_INFO: `/v3/projects/5e207ee3176849e2b4c373cd988d0162` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:18.254189 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c373e74-8691-41ee-b485-3758027c16a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e207ee3176849e2b4c373cd988d0162)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:18.256172 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c373e74-8691-41ee-b485-3758027c16a7 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:18.304914 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3c373e74-8691-41ee-b485-3758027c16a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e207ee3176849e2b4c373cd988d0162', 'request_id': 'req-3c373e74-8691-41ee-b485-3758027c16a7'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:18.314706 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3c373e74-8691-41ee-b485-3758027c16a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e207ee3176849e2b4c373cd988d0162', 'request_id': 'req-3c373e74-8691-41ee-b485-3758027c16a7'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:18.322163 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3c373e74-8691-41ee-b485-3758027c16a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e207ee3176849e2b4c373cd988d0162', 'request_id': 'req-3c373e74-8691-41ee-b485-3758027c16a7'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:18.333310 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3c373e74-8691-41ee-b485-3758027c16a7 admin admin] The token cache is being invalidate because project 5e207ee3176849e2b4c373cd988d0162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:01:18.333599 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3c373e74-8691-41ee-b485-3758027c16a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:18.334346 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3c373e74-8691-41ee-b485-3758027c16a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:18.336059 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1401/2788] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:01:18 2022] DELETE /identity/v3/projects/5e207ee3176849e2b4c373cd988d0162 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:18.340249 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77c10f-fee6-4836-a6cd-7067f80286e9 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:18.350345 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77c10f-fee6-4836-a6cd-7067f80286e9 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:18.411485 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c719eb-d473-47b7-b249-559fd06b3132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:18.412107 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c719eb-d473-47b7-b249-559fd06b3132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:18.412383 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c719eb-d473-47b7-b249-559fd06b3132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:18.412656 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c719eb-d473-47b7-b249-559fd06b3132 admin admin] PATH_INFO: `/v3/users/6f11549356ee45f38032235291ac4af3` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:18.413801 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c719eb-d473-47b7-b249-559fd06b3132 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f11549356ee45f38032235291ac4af3)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:18.415771 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c719eb-d473-47b7-b249-559fd06b3132 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:18.462957 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f4c719eb-d473-47b7-b249-559fd06b3132 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f11549356ee45f38032235291ac4af3'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:18.476284 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:18.478148 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f4c719eb-d473-47b7-b249-559fd06b3132 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f11549356ee45f38032235291ac4af3'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:18.488180 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f4c719eb-d473-47b7-b249-559fd06b3132 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f11549356ee45f38032235291ac4af3'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:18.497124 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f4c719eb-d473-47b7-b249-559fd06b3132 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f11549356ee45f38032235291ac4af3'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:18.497987 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f4c719eb-d473-47b7-b249-559fd06b3132 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f11549356ee45f38032235291ac4af3'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:18.504487 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1388/2789] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:01:18 2022] DELETE /identity/v3/users/6f11549356ee45f38032235291ac4af3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:18.618820 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c373e74-8691-41ee-b485-3758027c16a7 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:18.620622 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3c373e74-8691-41ee-b485-3758027c16a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:18.687573 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:18.715728 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c373e74-8691-41ee-b485-3758027c16a7 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:18.790292 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec13563-3626-4934-a30e-ed01a995457a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:18.791022 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec13563-3626-4934-a30e-ed01a995457a service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:18.791300 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec13563-3626-4934-a30e-ed01a995457a service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:18.791566 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec13563-3626-4934-a30e-ed01a995457a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:18.794335 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6ec13563-3626-4934-a30e-ed01a995457a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:18.808801 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec13563-3626-4934-a30e-ed01a995457a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:18.810555 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec13563-3626-4934-a30e-ed01a995457a service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:18.822229 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1402/2790] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:18.824459 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c719eb-d473-47b7-b249-559fd06b3132 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:18.827701 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f4c719eb-d473-47b7-b249-559fd06b3132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:18.933252 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c719eb-d473-47b7-b249-559fd06b3132 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:18.938711 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6cf117-1f95-4559-a09a-53fe0932f90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:18.939349 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cf117-1f95-4559-a09a-53fe0932f90c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:18.939629 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cf117-1f95-4559-a09a-53fe0932f90c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:18.939896 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cf117-1f95-4559-a09a-53fe0932f90c admin admin] PATH_INFO: `/v3/projects/9804cee0c18049098ddbd5a5fcfa7aea` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:18.941027 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6cf117-1f95-4559-a09a-53fe0932f90c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9804cee0c18049098ddbd5a5fcfa7aea)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:18.943287 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6cf117-1f95-4559-a09a-53fe0932f90c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:19.000062 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1e6cf117-1f95-4559-a09a-53fe0932f90c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9804cee0c18049098ddbd5a5fcfa7aea', 'request_id': 'req-1e6cf117-1f95-4559-a09a-53fe0932f90c'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:19.005742 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1e6cf117-1f95-4559-a09a-53fe0932f90c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9804cee0c18049098ddbd5a5fcfa7aea', 'request_id': 'req-1e6cf117-1f95-4559-a09a-53fe0932f90c'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:19.012710 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1e6cf117-1f95-4559-a09a-53fe0932f90c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9804cee0c18049098ddbd5a5fcfa7aea', 'request_id': 'req-1e6cf117-1f95-4559-a09a-53fe0932f90c'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:19.033738 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1e6cf117-1f95-4559-a09a-53fe0932f90c admin admin] The token cache is being invalidate because project 9804cee0c18049098ddbd5a5fcfa7aea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:01:19.034211 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1e6cf117-1f95-4559-a09a-53fe0932f90c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:19.034955 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1e6cf117-1f95-4559-a09a-53fe0932f90c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:19.036604 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1389/2791] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:01:18 2022] DELETE /identity/v3/projects/9804cee0c18049098ddbd5a5fcfa7aea => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:19.041646 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bd249-9c77-429f-bd56-1bce2e46ea4b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:19.042171 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bd249-9c77-429f-bd56-1bce2e46ea4b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:19.042599 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bd249-9c77-429f-bd56-1bce2e46ea4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:19.064164 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-ad6bd249-9c77-429f-bd56-1bce2e46ea4b None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:19.066007 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ad6bd249-9c77-429f-bd56-1bce2e46ea4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:19.151924 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1403/2792] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:01:19.159992 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e2d72-a300-48a8-8849-0c3e553f5979 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:19.160277 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e2d72-a300-48a8-8849-0c3e553f5979 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:19.160552 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e2d72-a300-48a8-8849-0c3e553f5979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:19.196011 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f08e2d72-a300-48a8-8849-0c3e553f5979 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:19.197691 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f08e2d72-a300-48a8-8849-0c3e553f5979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:19.217404 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1390/2793] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:01:19.218601 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6bd249-9c77-429f-bd56-1bce2e46ea4b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:19.236785 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6bd249-9c77-429f-bd56-1bce2e46ea4b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:19.242104 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f57731-0e64-476f-94d8-d2a3071d5212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:19.242732 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f57731-0e64-476f-94d8-d2a3071d5212 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:19.243048 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f57731-0e64-476f-94d8-d2a3071d5212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:19.243274 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f57731-0e64-476f-94d8-d2a3071d5212 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:19.243928 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f57731-0e64-476f-94d8-d2a3071d5212 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:01:19.244233 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f57731-0e64-476f-94d8-d2a3071d5212 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:19.245911 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f57731-0e64-476f-94d8-d2a3071d5212 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:19.262055 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1404/2794] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 01:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:01:19.264436 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e2d72-a300-48a8-8849-0c3e553f5979 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:19.275035 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e2d72-a300-48a8-8849-0c3e553f5979 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:19.280623 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e4386-0a7d-490c-a80f-54494fb73d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:19.281236 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e4386-0a7d-490c-a80f-54494fb73d73 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:19.281658 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e4386-0a7d-490c-a80f-54494fb73d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:19.281988 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e4386-0a7d-490c-a80f-54494fb73d73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:19.282630 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e4386-0a7d-490c-a80f-54494fb73d73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:19.284561 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e4386-0a7d-490c-a80f-54494fb73d73 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:19.321891 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1391/2795] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:01:19 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:19.325765 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f57731-0e64-476f-94d8-d2a3071d5212 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:19.341342 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f57731-0e64-476f-94d8-d2a3071d5212 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:19.399557 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:19.406511 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d63e1-1866-4a72-a102-dd689a1b980e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:19.407253 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d63e1-1866-4a72-a102-dd689a1b980e admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:19.407531 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d63e1-1866-4a72-a102-dd689a1b980e admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:19.407803 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d63e1-1866-4a72-a102-dd689a1b980e admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:19.408449 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d63e1-1866-4a72-a102-dd689a1b980e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:19.410398 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d63e1-1866-4a72-a102-dd689a1b980e admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:19.432663 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1405/2796] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:01:19 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:19.437302 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e4386-0a7d-490c-a80f-54494fb73d73 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:19.448251 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e4386-0a7d-490c-a80f-54494fb73d73 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:19.454180 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a75f5-3b78-44ca-90ce-bba332d51d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:19.454943 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a75f5-3b78-44ca-90ce-bba332d51d7c admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:19.455183 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a75f5-3b78-44ca-90ce-bba332d51d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:19.455449 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a75f5-3b78-44ca-90ce-bba332d51d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:19.456103 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a75f5-3b78-44ca-90ce-bba332d51d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:19.457799 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a75f5-3b78-44ca-90ce-bba332d51d7c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:19.468542 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1392/2797] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:19.472660 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d63e1-1866-4a72-a102-dd689a1b980e admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:19.483137 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d63e1-1866-4a72-a102-dd689a1b980e admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:19.487885 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71203e67-3d55-4c31-9557-583908f3a90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:19.488475 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71203e67-3d55-4c31-9557-583908f3a90b admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:19.488753 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71203e67-3d55-4c31-9557-583908f3a90b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:19.489024 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71203e67-3d55-4c31-9557-583908f3a90b admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:19.489662 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71203e67-3d55-4c31-9557-583908f3a90b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:19.491529 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71203e67-3d55-4c31-9557-583908f3a90b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:19.502145 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1406/2798] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:19.507906 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a75f5-3b78-44ca-90ce-bba332d51d7c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:19.520183 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a75f5-3b78-44ca-90ce-bba332d51d7c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:19.528460 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c7b65-ea34-4249-9ee1-5f4b733230ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:19.529101 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c7b65-ea34-4249-9ee1-5f4b733230ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:19.529374 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c7b65-ea34-4249-9ee1-5f4b733230ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:19.529637 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c7b65-ea34-4249-9ee1-5f4b733230ea admin admin] PATH_INFO: `/v3/projects/e781579862804d3e9e6cb0254f3829ad/users/f8c7b99161a7461282d9ae5a8882b1de/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:19.545492 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c7b65-ea34-4249-9ee1-5f4b733230ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=e781579862804d3e9e6cb0254f3829ad, user_id=f8c7b99161a7461282d9ae5a8882b1de, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:19.548314 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c7b65-ea34-4249-9ee1-5f4b733230ea admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:19.563399 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1393/2799] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:19 2022] PUT /identity/v3/projects/e781579862804d3e9e6cb0254f3829ad/users/f8c7b99161a7461282d9ae5a8882b1de/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:19.575015 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ffae2-86bb-4b46-bec3-c13e410fa6ad None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:19.575373 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ffae2-86bb-4b46-bec3-c13e410fa6ad None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:19.575635 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ffae2-86bb-4b46-bec3-c13e410fa6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:19.607144 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-dc9ffae2-86bb-4b46-bec3-c13e410fa6ad None None] MFA Rules not processed for user `f8c7b99161a7461282d9ae5a8882b1de`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:19.608367 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-dc9ffae2-86bb-4b46-bec3-c13e410fa6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:19.680112 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1407/2800] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:19.684949 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c7b65-ea34-4249-9ee1-5f4b733230ea admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:19.695442 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:19.751988 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c7b65-ea34-4249-9ee1-5f4b733230ea admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:19.756968 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf64bf-6dbd-4ead-ada3-09e5b1b96610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:19.757577 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf64bf-6dbd-4ead-ada3-09e5b1b96610 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:19.757863 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf64bf-6dbd-4ead-ada3-09e5b1b96610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:19.758165 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf64bf-6dbd-4ead-ada3-09e5b1b96610 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:19.758827 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf64bf-6dbd-4ead-ada3-09e5b1b96610 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:19.760772 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf64bf-6dbd-4ead-ada3-09e5b1b96610 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:19.789885 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1394/2801] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:01:19 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:19.794850 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ffae2-86bb-4b46-bec3-c13e410fa6ad None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:19.805710 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ffae2-86bb-4b46-bec3-c13e410fa6ad None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:19.864073 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656fff5-4db8-4d9e-b8c0-926ac6a4c5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:19.864682 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656fff5-4db8-4d9e-b8c0-926ac6a4c5e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:19.864961 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656fff5-4db8-4d9e-b8c0-926ac6a4c5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:19.865965 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656fff5-4db8-4d9e-b8c0-926ac6a4c5e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:19.866608 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656fff5-4db8-4d9e-b8c0-926ac6a4c5e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:19.868767 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656fff5-4db8-4d9e-b8c0-926ac6a4c5e9 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:19.895954 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1408/2802] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:01:19 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:19.900480 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf64bf-6dbd-4ead-ada3-09e5b1b96610 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:19.911894 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf64bf-6dbd-4ead-ada3-09e5b1b96610 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:19.918598 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c1ec7-09fc-4955-af95-f6a15fd5b8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:19.919378 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c1ec7-09fc-4955-af95-f6a15fd5b8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:19.919668 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c1ec7-09fc-4955-af95-f6a15fd5b8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:19.919934 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c1ec7-09fc-4955-af95-f6a15fd5b8d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:19.920877 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c1ec7-09fc-4955-af95-f6a15fd5b8d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:19.922732 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c1ec7-09fc-4955-af95-f6a15fd5b8d8 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:19.939116 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1395/2803] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:19.943637 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656fff5-4db8-4d9e-b8c0-926ac6a4c5e9 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:19.954718 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656fff5-4db8-4d9e-b8c0-926ac6a4c5e9 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:19.959358 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776158e5-e652-4586-8979-32865dcc302d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:19.960010 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776158e5-e652-4586-8979-32865dcc302d admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:19.960300 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776158e5-e652-4586-8979-32865dcc302d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:19.960558 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776158e5-e652-4586-8979-32865dcc302d admin admin] PATH_INFO: `/v3/projects/aa1b3b0edeb04196993f21d7b12cf595/users/8fb189aabc744f8a8f1876697b6272d9/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:19.976893 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776158e5-e652-4586-8979-32865dcc302d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa1b3b0edeb04196993f21d7b12cf595, user_id=8fb189aabc744f8a8f1876697b6272d9, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:19.980436 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776158e5-e652-4586-8979-32865dcc302d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:19.998933 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1409/2804] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:19 2022] PUT /identity/v3/projects/aa1b3b0edeb04196993f21d7b12cf595/users/8fb189aabc744f8a8f1876697b6272d9/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:20.000231 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c1ec7-09fc-4955-af95-f6a15fd5b8d8 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:20.011699 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c1ec7-09fc-4955-af95-f6a15fd5b8d8 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:20.089679 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c531b63-719c-4dcf-9c50-8560c7c5dc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:20.090491 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c531b63-719c-4dcf-9c50-8560c7c5dc03 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:20.090836 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c531b63-719c-4dcf-9c50-8560c7c5dc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:20.091109 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c531b63-719c-4dcf-9c50-8560c7c5dc03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:20.091750 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c531b63-719c-4dcf-9c50-8560c7c5dc03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:20.093381 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c531b63-719c-4dcf-9c50-8560c7c5dc03 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:20.103479 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1396/2805] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:20.108060 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776158e5-e652-4586-8979-32865dcc302d admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:20.120286 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776158e5-e652-4586-8979-32865dcc302d admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:20.125553 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbc8e9-77d1-4322-b0de-65bfa2bfdac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:20.126849 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbc8e9-77d1-4322-b0de-65bfa2bfdac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:20.126849 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbc8e9-77d1-4322-b0de-65bfa2bfdac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:20.127062 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbc8e9-77d1-4322-b0de-65bfa2bfdac9 admin admin] PATH_INFO: `/v3/projects/aa1b3b0edeb04196993f21d7b12cf595/users/8fb189aabc744f8a8f1876697b6272d9/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:20.128977 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbc8e9-77d1-4322-b0de-65bfa2bfdac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa1b3b0edeb04196993f21d7b12cf595, user_id=8fb189aabc744f8a8f1876697b6272d9, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:20.131785 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbc8e9-77d1-4322-b0de-65bfa2bfdac9 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:20.145895 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1410/2806] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:20 2022] PUT /identity/v3/projects/aa1b3b0edeb04196993f21d7b12cf595/users/8fb189aabc744f8a8f1876697b6272d9/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:20.154490 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be073766-4b1f-4106-9f82-66d70d7922b7 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:20.154858 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be073766-4b1f-4106-9f82-66d70d7922b7 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:20.155200 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be073766-4b1f-4106-9f82-66d70d7922b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:20.213770 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-be073766-4b1f-4106-9f82-66d70d7922b7 None None] MFA Rules not processed for user `8fb189aabc744f8a8f1876697b6272d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:20.215509 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-be073766-4b1f-4106-9f82-66d70d7922b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:20.312643 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1397/2807] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:20.326689 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbc8e9-77d1-4322-b0de-65bfa2bfdac9 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:20.328893 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c0bbc8e9-77d1-4322-b0de-65bfa2bfdac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:20.355006 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:20.397506 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbc8e9-77d1-4322-b0de-65bfa2bfdac9 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:20.402018 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14483efd-7933-41d2-adde-88ea2c8dc42a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:20.402629 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14483efd-7933-41d2-adde-88ea2c8dc42a service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:20.402937 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14483efd-7933-41d2-adde-88ea2c8dc42a service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:20.403215 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14483efd-7933-41d2-adde-88ea2c8dc42a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:20.463814 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14483efd-7933-41d2-adde-88ea2c8dc42a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:20.465376 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14483efd-7933-41d2-adde-88ea2c8dc42a service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:20.474594 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1411/2808] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:01:21.858568 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be073766-4b1f-4106-9f82-66d70d7922b7 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:21.860074 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-be073766-4b1f-4106-9f82-66d70d7922b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:21.867605 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:21.874893 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be073766-4b1f-4106-9f82-66d70d7922b7 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:21.879187 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3e60f-e386-41ee-ab89-cab3308fd879 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:21.879904 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3e60f-e386-41ee-ab89-cab3308fd879 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:21.880250 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3e60f-e386-41ee-ab89-cab3308fd879 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:21.880586 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3e60f-e386-41ee-ab89-cab3308fd879 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:21.890654 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc3e60f-e386-41ee-ab89-cab3308fd879 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:21.892189 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc3e60f-e386-41ee-ab89-cab3308fd879 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:21.903055 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1398/2809] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:25.798772 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14483efd-7933-41d2-adde-88ea2c8dc42a service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:25.873816 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14483efd-7933-41d2-adde-88ea2c8dc42a service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:25.879636 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898753f7-89f4-4935-85bd-870d7a604ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:25.880263 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898753f7-89f4-4935-85bd-870d7a604ee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:25.880535 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898753f7-89f4-4935-85bd-870d7a604ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:25.880803 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898753f7-89f4-4935-85bd-870d7a604ee9 admin admin] PATH_INFO: `/v3/users/f8c7b99161a7461282d9ae5a8882b1de` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:25.882066 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898753f7-89f4-4935-85bd-870d7a604ee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8c7b99161a7461282d9ae5a8882b1de)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:25.884019 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898753f7-89f4-4935-85bd-870d7a604ee9 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:25.935642 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-898753f7-89f4-4935-85bd-870d7a604ee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8c7b99161a7461282d9ae5a8882b1de'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:25.943373 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-898753f7-89f4-4935-85bd-870d7a604ee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8c7b99161a7461282d9ae5a8882b1de'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:25.951351 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-898753f7-89f4-4935-85bd-870d7a604ee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8c7b99161a7461282d9ae5a8882b1de'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:25.959255 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:25.965228 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-898753f7-89f4-4935-85bd-870d7a604ee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8c7b99161a7461282d9ae5a8882b1de'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:25.966215 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-898753f7-89f4-4935-85bd-870d7a604ee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8c7b99161a7461282d9ae5a8882b1de'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:25.973423 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1412/2810] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:01:25 2022] DELETE /identity/v3/users/f8c7b99161a7461282d9ae5a8882b1de => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:25.978240 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46eec03-c60a-4397-9ede-fc524e2da468 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:25.978718 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46eec03-c60a-4397-9ede-fc524e2da468 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:25.978956 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46eec03-c60a-4397-9ede-fc524e2da468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:26.002149 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b46eec03-c60a-4397-9ede-fc524e2da468 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:26.003367 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b46eec03-c60a-4397-9ede-fc524e2da468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:26.073570 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1399/2811] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:01:26.083125 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898753f7-89f4-4935-85bd-870d7a604ee9 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:26.084588 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-898753f7-89f4-4935-85bd-870d7a604ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:26.141882 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898753f7-89f4-4935-85bd-870d7a604ee9 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:26.146531 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171760a-a568-47bd-8835-f7e9e7a9b43c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:26.147193 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171760a-a568-47bd-8835-f7e9e7a9b43c service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:26.147470 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171760a-a568-47bd-8835-f7e9e7a9b43c service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:26.147738 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171760a-a568-47bd-8835-f7e9e7a9b43c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:26.158260 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171760a-a568-47bd-8835-f7e9e7a9b43c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:26.159710 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171760a-a568-47bd-8835-f7e9e7a9b43c service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:26.169795 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1413/2812] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:26.607435 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46eec03-c60a-4397-9ede-fc524e2da468 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:26.609935 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b46eec03-c60a-4397-9ede-fc524e2da468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:26.623552 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46eec03-c60a-4397-9ede-fc524e2da468 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:26.628632 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c0844d-a403-4de3-ab22-8883bb4156df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:26.629442 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0844d-a403-4de3-ab22-8883bb4156df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:26.630509 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0844d-a403-4de3-ab22-8883bb4156df admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:26.630791 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0844d-a403-4de3-ab22-8883bb4156df admin admin] PATH_INFO: `/v3/projects/e781579862804d3e9e6cb0254f3829ad` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:26.631953 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c0844d-a403-4de3-ab22-8883bb4156df admin admin] RBAC: Authorizing `identity:delete_project(project_id=e781579862804d3e9e6cb0254f3829ad)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:26.634188 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c0844d-a403-4de3-ab22-8883bb4156df admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:26.697366 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171760a-a568-47bd-8835-f7e9e7a9b43c service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:26.699236 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d171760a-a568-47bd-8835-f7e9e7a9b43c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:26.723707 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171760a-a568-47bd-8835-f7e9e7a9b43c service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:26.725668 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-05c0844d-a403-4de3-ab22-8883bb4156df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e781579862804d3e9e6cb0254f3829ad', 'request_id': 'req-05c0844d-a403-4de3-ab22-8883bb4156df'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:26.733138 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-05c0844d-a403-4de3-ab22-8883bb4156df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e781579862804d3e9e6cb0254f3829ad', 'request_id': 'req-05c0844d-a403-4de3-ab22-8883bb4156df'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:26.741567 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-05c0844d-a403-4de3-ab22-8883bb4156df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e781579862804d3e9e6cb0254f3829ad', 'request_id': 'req-05c0844d-a403-4de3-ab22-8883bb4156df'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:26.757533 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-05c0844d-a403-4de3-ab22-8883bb4156df admin admin] The token cache is being invalidate because project e781579862804d3e9e6cb0254f3829ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:01:26.757866 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-05c0844d-a403-4de3-ab22-8883bb4156df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:26.758945 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-05c0844d-a403-4de3-ab22-8883bb4156df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:26.760575 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1400/2813] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:01:26 2022] DELETE /identity/v3/projects/e781579862804d3e9e6cb0254f3829ad => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:26.768539 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c0844d-a403-4de3-ab22-8883bb4156df admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:26.768539 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-05c0844d-a403-4de3-ab22-8883bb4156df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:26.788336 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634aa607-8735-41a8-a33f-6c0304da9672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:26.789015 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634aa607-8735-41a8-a33f-6c0304da9672 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:26.789297 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634aa607-8735-41a8-a33f-6c0304da9672 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:26.789565 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634aa607-8735-41a8-a33f-6c0304da9672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:26.791597 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-634aa607-8735-41a8-a33f-6c0304da9672 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:26.840707 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c0844d-a403-4de3-ab22-8883bb4156df admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:26.850306 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8ca00-23e2-4789-8029-d87a365f455a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:26.850961 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8ca00-23e2-4789-8029-d87a365f455a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:26.851236 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8ca00-23e2-4789-8029-d87a365f455a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:26.851512 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8ca00-23e2-4789-8029-d87a365f455a admin admin] PATH_INFO: `/v3/users/8fb189aabc744f8a8f1876697b6272d9` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:26.852758 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8ca00-23e2-4789-8029-d87a365f455a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fb189aabc744f8a8f1876697b6272d9)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:26.854916 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8ca00-23e2-4789-8029-d87a365f455a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:26.873394 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:26.876628 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634aa607-8735-41a8-a33f-6c0304da9672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:26.878214 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634aa607-8735-41a8-a33f-6c0304da9672 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:26.902280 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1414/2814] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:01:26.914071 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-21b8ca00-23e2-4789-8029-d87a365f455a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fb189aabc744f8a8f1876697b6272d9'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:26.926307 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-21b8ca00-23e2-4789-8029-d87a365f455a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fb189aabc744f8a8f1876697b6272d9'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:26.934360 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-21b8ca00-23e2-4789-8029-d87a365f455a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fb189aabc744f8a8f1876697b6272d9'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:26.945356 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-21b8ca00-23e2-4789-8029-d87a365f455a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fb189aabc744f8a8f1876697b6272d9'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:26.946228 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-21b8ca00-23e2-4789-8029-d87a365f455a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fb189aabc744f8a8f1876697b6272d9'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:26.956249 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1401/2815] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:01:26 2022] DELETE /identity/v3/users/8fb189aabc744f8a8f1876697b6272d9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:27.427625 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634aa607-8735-41a8-a33f-6c0304da9672 service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:27.457502 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634aa607-8735-41a8-a33f-6c0304da9672 service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:27.509310 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:27.526503 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67f583-38e9-4ca6-8df8-6a5a8833420b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:27.527149 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67f583-38e9-4ca6-8df8-6a5a8833420b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:27.527434 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67f583-38e9-4ca6-8df8-6a5a8833420b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:27.527703 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67f583-38e9-4ca6-8df8-6a5a8833420b admin admin] PATH_INFO: `/v3/projects/aa1b3b0edeb04196993f21d7b12cf595` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:27.528878 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff67f583-38e9-4ca6-8df8-6a5a8833420b admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa1b3b0edeb04196993f21d7b12cf595)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:27.537868 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff67f583-38e9-4ca6-8df8-6a5a8833420b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:27.586734 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ff67f583-38e9-4ca6-8df8-6a5a8833420b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa1b3b0edeb04196993f21d7b12cf595', 'request_id': 'req-ff67f583-38e9-4ca6-8df8-6a5a8833420b'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:27.603034 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ff67f583-38e9-4ca6-8df8-6a5a8833420b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa1b3b0edeb04196993f21d7b12cf595', 'request_id': 'req-ff67f583-38e9-4ca6-8df8-6a5a8833420b'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:27.610185 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ff67f583-38e9-4ca6-8df8-6a5a8833420b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa1b3b0edeb04196993f21d7b12cf595', 'request_id': 'req-ff67f583-38e9-4ca6-8df8-6a5a8833420b'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:27.620896 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ff67f583-38e9-4ca6-8df8-6a5a8833420b admin admin] The token cache is being invalidate because project aa1b3b0edeb04196993f21d7b12cf595 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:01:27.621389 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ff67f583-38e9-4ca6-8df8-6a5a8833420b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:27.622081 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ff67f583-38e9-4ca6-8df8-6a5a8833420b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:27.623686 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1415/2816] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:01:27 2022] DELETE /identity/v3/projects/aa1b3b0edeb04196993f21d7b12cf595 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:01:27.629719 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f66cb-c694-4718-8764-c778031d269c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:27.630268 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f66cb-c694-4718-8764-c778031d269c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:27.630268 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f66cb-c694-4718-8764-c778031d269c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:27.651137 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-cb7f66cb-c694-4718-8764-c778031d269c None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:27.652674 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-cb7f66cb-c694-4718-8764-c778031d269c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:27.719041 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1402/2817] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:27.728251 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0a3c5-9cc1-4b7e-9cd6-4c60efbeb98e None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:27.728615 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0a3c5-9cc1-4b7e-9cd6-4c60efbeb98e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:27.728918 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0a3c5-9cc1-4b7e-9cd6-4c60efbeb98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:27.749503 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-e5d0a3c5-9cc1-4b7e-9cd6-4c60efbeb98e None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:27.750945 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e5d0a3c5-9cc1-4b7e-9cd6-4c60efbeb98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:27.759513 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1416/2818] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:27.764329 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f66cb-c694-4718-8764-c778031d269c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:27.774035 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f66cb-c694-4718-8764-c778031d269c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:27.778790 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226c253-970a-4d7e-a130-850f4d60f0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:27.779395 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226c253-970a-4d7e-a130-850f4d60f0bb admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:27.779670 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226c253-970a-4d7e-a130-850f4d60f0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:27.779936 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226c253-970a-4d7e-a130-850f4d60f0bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:27.780584 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226c253-970a-4d7e-a130-850f4d60f0bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:01:27.780881 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226c253-970a-4d7e-a130-850f4d60f0bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:27.782534 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226c253-970a-4d7e-a130-850f4d60f0bb admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:27.795116 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1403/2819] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 01:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:01:27.799674 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0a3c5-9cc1-4b7e-9cd6-4c60efbeb98e None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:27.809598 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0a3c5-9cc1-4b7e-9cd6-4c60efbeb98e None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:27.814599 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2a37e-e2e0-43a8-9e96-cfd244d96979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:27.815198 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2a37e-e2e0-43a8-9e96-cfd244d96979 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:27.815479 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2a37e-e2e0-43a8-9e96-cfd244d96979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:27.815744 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2a37e-e2e0-43a8-9e96-cfd244d96979 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:27.816380 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f2a37e-e2e0-43a8-9e96-cfd244d96979 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:27.818352 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f2a37e-e2e0-43a8-9e96-cfd244d96979 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:27.847728 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1417/2820] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:01:27 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:27.851032 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226c253-970a-4d7e-a130-850f4d60f0bb admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:27.862294 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226c253-970a-4d7e-a130-850f4d60f0bb admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:27.930199 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a247b-4212-4041-9860-37c3ff72f0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:27.930876 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a247b-4212-4041-9860-37c3ff72f0f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:27.931234 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a247b-4212-4041-9860-37c3ff72f0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:27.931431 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a247b-4212-4041-9860-37c3ff72f0f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:27.932106 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a247b-4212-4041-9860-37c3ff72f0f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:27.934462 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a247b-4212-4041-9860-37c3ff72f0f6 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:27.960203 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1404/2821] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:01:27 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:27.962656 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2a37e-e2e0-43a8-9e96-cfd244d96979 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:27.975620 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2a37e-e2e0-43a8-9e96-cfd244d96979 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:27.980997 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97871659-8bdc-4599-ad72-ba96c0aa96a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:27.982080 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97871659-8bdc-4599-ad72-ba96c0aa96a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:27.982430 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97871659-8bdc-4599-ad72-ba96c0aa96a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:27.982753 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97871659-8bdc-4599-ad72-ba96c0aa96a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:27.983488 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97871659-8bdc-4599-ad72-ba96c0aa96a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:27.985190 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97871659-8bdc-4599-ad72-ba96c0aa96a8 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:27.999798 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1418/2822] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:28.002955 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a247b-4212-4041-9860-37c3ff72f0f6 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:28.013346 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a247b-4212-4041-9860-37c3ff72f0f6 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:28.019222 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757369c-915c-491f-a328-f5c7c9d77d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:28.019996 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757369c-915c-491f-a328-f5c7c9d77d95 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:28.020121 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757369c-915c-491f-a328-f5c7c9d77d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:28.020354 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757369c-915c-491f-a328-f5c7c9d77d95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:28.020990 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1757369c-915c-491f-a328-f5c7c9d77d95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:28.022641 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1757369c-915c-491f-a328-f5c7c9d77d95 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:28.025369 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:28.036987 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1405/2823] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:28.041675 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97871659-8bdc-4599-ad72-ba96c0aa96a8 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:28.052996 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97871659-8bdc-4599-ad72-ba96c0aa96a8 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:28.063001 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d870d0c-ec8e-4d4b-bc10-b1b0dc5b1d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:28.063860 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d870d0c-ec8e-4d4b-bc10-b1b0dc5b1d03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:28.064141 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d870d0c-ec8e-4d4b-bc10-b1b0dc5b1d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:28.064412 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d870d0c-ec8e-4d4b-bc10-b1b0dc5b1d03 admin admin] PATH_INFO: `/v3/projects/75fbf75bdea148318547a7524b520aee/users/18bf18c3f4034586ad20542170a9cc8b/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:28.082718 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d870d0c-ec8e-4d4b-bc10-b1b0dc5b1d03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75fbf75bdea148318547a7524b520aee, user_id=18bf18c3f4034586ad20542170a9cc8b, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:28.085435 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d870d0c-ec8e-4d4b-bc10-b1b0dc5b1d03 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:28.099288 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1419/2824] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:28 2022] PUT /identity/v3/projects/75fbf75bdea148318547a7524b520aee/users/18bf18c3f4034586ad20542170a9cc8b/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:28.112470 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5aaeb-9dc9-4a0c-b856-4a8cb83f4a30 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:28.114246 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5aaeb-9dc9-4a0c-b856-4a8cb83f4a30 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:28.114554 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5aaeb-9dc9-4a0c-b856-4a8cb83f4a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:28.278100 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-0cd5aaeb-9dc9-4a0c-b856-4a8cb83f4a30 None None] MFA Rules not processed for user `18bf18c3f4034586ad20542170a9cc8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:28.279339 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0cd5aaeb-9dc9-4a0c-b856-4a8cb83f4a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:28.348880 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1406/2825] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:28.353400 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d870d0c-ec8e-4d4b-bc10-b1b0dc5b1d03 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:28.419335 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d870d0c-ec8e-4d4b-bc10-b1b0dc5b1d03 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:28.424257 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6b95b-79c2-4363-b344-a7e25c564765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:28.424877 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6b95b-79c2-4363-b344-a7e25c564765 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:28.425159 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6b95b-79c2-4363-b344-a7e25c564765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:28.425438 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6b95b-79c2-4363-b344-a7e25c564765 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:28.426100 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6b95b-79c2-4363-b344-a7e25c564765 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:28.427994 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6b95b-79c2-4363-b344-a7e25c564765 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:28.454331 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:28.474591 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1420/2826] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:01:28 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:28.475564 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5aaeb-9dc9-4a0c-b856-4a8cb83f4a30 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:28.488405 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5aaeb-9dc9-4a0c-b856-4a8cb83f4a30 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:28.559920 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece4872-d7fc-4f11-b9f6-af96d70d55eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:28.560562 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece4872-d7fc-4f11-b9f6-af96d70d55eb admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:28.560842 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece4872-d7fc-4f11-b9f6-af96d70d55eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:28.561114 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece4872-d7fc-4f11-b9f6-af96d70d55eb admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:28.561767 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece4872-d7fc-4f11-b9f6-af96d70d55eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:28.563835 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece4872-d7fc-4f11-b9f6-af96d70d55eb admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:28.587618 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1407/2827] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:01:28 2022] POST /identity/v3/users => generated 298 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:01:28.592068 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6b95b-79c2-4363-b344-a7e25c564765 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:28.604793 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6b95b-79c2-4363-b344-a7e25c564765 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:28.610511 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb1a4e-6c9d-4999-b619-378d81239f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:28.611547 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb1a4e-6c9d-4999-b619-378d81239f24 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:28.612007 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb1a4e-6c9d-4999-b619-378d81239f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:28.612431 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb1a4e-6c9d-4999-b619-378d81239f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:28.613344 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb1a4e-6c9d-4999-b619-378d81239f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:28.615429 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb1a4e-6c9d-4999-b619-378d81239f24 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:28.639890 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1421/2828] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:28.640904 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece4872-d7fc-4f11-b9f6-af96d70d55eb admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:28.651534 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece4872-d7fc-4f11-b9f6-af96d70d55eb admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:28.656491 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382dea1-0887-463e-acfa-cfe8a69586ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:28.657155 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382dea1-0887-463e-acfa-cfe8a69586ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:28.657432 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382dea1-0887-463e-acfa-cfe8a69586ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:28.657704 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382dea1-0887-463e-acfa-cfe8a69586ee admin admin] PATH_INFO: `/v3/projects/04f9c0a8156f4d958ee7ca067aaadadd/users/ff4f9f6f302b48cfad4bb62f4ba9d219/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:28.678890 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382dea1-0887-463e-acfa-cfe8a69586ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=04f9c0a8156f4d958ee7ca067aaadadd, user_id=ff4f9f6f302b48cfad4bb62f4ba9d219, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:28.681916 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382dea1-0887-463e-acfa-cfe8a69586ee admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:28.696707 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1408/2829] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:28 2022] PUT /identity/v3/projects/04f9c0a8156f4d958ee7ca067aaadadd/users/ff4f9f6f302b48cfad4bb62f4ba9d219/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:28.701446 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb1a4e-6c9d-4999-b619-378d81239f24 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:28.711794 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb1a4e-6c9d-4999-b619-378d81239f24 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:28.780657 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4797fa-fb85-4ba6-806f-3f177b761b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:28.780657 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4797fa-fb85-4ba6-806f-3f177b761b10 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:28.780657 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4797fa-fb85-4ba6-806f-3f177b761b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:28.781924 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4797fa-fb85-4ba6-806f-3f177b761b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:28.785209 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4797fa-fb85-4ba6-806f-3f177b761b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:28.786056 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4797fa-fb85-4ba6-806f-3f177b761b10 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:28.797935 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1422/2830] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:28.802123 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382dea1-0887-463e-acfa-cfe8a69586ee admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:28.813250 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382dea1-0887-463e-acfa-cfe8a69586ee admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:28.818942 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09333bcb-0da8-4be9-b772-c9d575f96622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:28.819626 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09333bcb-0da8-4be9-b772-c9d575f96622 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:28.819972 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09333bcb-0da8-4be9-b772-c9d575f96622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:28.820270 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09333bcb-0da8-4be9-b772-c9d575f96622 admin admin] PATH_INFO: `/v3/projects/04f9c0a8156f4d958ee7ca067aaadadd/users/ff4f9f6f302b48cfad4bb62f4ba9d219/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:28.822617 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09333bcb-0da8-4be9-b772-c9d575f96622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04f9c0a8156f4d958ee7ca067aaadadd, user_id=ff4f9f6f302b48cfad4bb62f4ba9d219, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:28.828237 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09333bcb-0da8-4be9-b772-c9d575f96622 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:28.844232 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1409/2831] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:28 2022] PUT /identity/v3/projects/04f9c0a8156f4d958ee7ca067aaadadd/users/ff4f9f6f302b48cfad4bb62f4ba9d219/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:28.858524 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440638c5-f72a-4504-ad19-cd9adb76a0c1 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:28.858963 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440638c5-f72a-4504-ad19-cd9adb76a0c1 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:28.859132 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440638c5-f72a-4504-ad19-cd9adb76a0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:28.894624 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-440638c5-f72a-4504-ad19-cd9adb76a0c1 None None] MFA Rules not processed for user `ff4f9f6f302b48cfad4bb62f4ba9d219`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:28.895910 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-440638c5-f72a-4504-ad19-cd9adb76a0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:28.978829 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1423/2832] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:01:28.990984 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09333bcb-0da8-4be9-b772-c9d575f96622 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:28.993068 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-09333bcb-0da8-4be9-b772-c9d575f96622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:29.044202 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:29.059636 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09333bcb-0da8-4be9-b772-c9d575f96622 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:29.063770 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f76165-a43c-473b-9345-4a3cb73565ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:29.064377 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f76165-a43c-473b-9345-4a3cb73565ac service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:29.064783 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f76165-a43c-473b-9345-4a3cb73565ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:29.065055 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f76165-a43c-473b-9345-4a3cb73565ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:29.076833 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f76165-a43c-473b-9345-4a3cb73565ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:29.078394 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f76165-a43c-473b-9345-4a3cb73565ac service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:29.088878 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440638c5-f72a-4504-ad19-cd9adb76a0c1 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:29.090048 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1410/2833] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:29.091324 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-440638c5-f72a-4504-ad19-cd9adb76a0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:29.181240 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:29.183252 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f76165-a43c-473b-9345-4a3cb73565ac service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:29.184744 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-57f76165-a43c-473b-9345-4a3cb73565ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:29.193552 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440638c5-f72a-4504-ad19-cd9adb76a0c1 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:29.198463 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f76165-a43c-473b-9345-4a3cb73565ac service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:29.204652 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54978f44-c052-43c0-9d2e-2698eaa7de5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:29.205874 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54978f44-c052-43c0-9d2e-2698eaa7de5a service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:29.208440 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f0329-6fcd-4935-a9e1-83fe407e7c99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:29.208672 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54978f44-c052-43c0-9d2e-2698eaa7de5a service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:29.209233 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54978f44-c052-43c0-9d2e-2698eaa7de5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:29.210121 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f0329-6fcd-4935-a9e1-83fe407e7c99 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:29.210688 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f0329-6fcd-4935-a9e1-83fe407e7c99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:29.211291 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f0329-6fcd-4935-a9e1-83fe407e7c99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:29.211683 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-54978f44-c052-43c0-9d2e-2698eaa7de5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:29.233288 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54978f44-c052-43c0-9d2e-2698eaa7de5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:29.235242 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54978f44-c052-43c0-9d2e-2698eaa7de5a service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:29.256017 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1424/2834] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:29.300541 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f0329-6fcd-4935-a9e1-83fe407e7c99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:29.301663 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f0329-6fcd-4935-a9e1-83fe407e7c99 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:29.312236 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1411/2835] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:29.644026 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54978f44-c052-43c0-9d2e-2698eaa7de5a service nova] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:29.724615 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54978f44-c052-43c0-9d2e-2698eaa7de5a service nova] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:29.729540 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42727bb7-09c0-4210-a327-156571f8c89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:29.730676 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42727bb7-09c0-4210-a327-156571f8c89d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:29.731024 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42727bb7-09c0-4210-a327-156571f8c89d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:29.732006 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42727bb7-09c0-4210-a327-156571f8c89d admin admin] PATH_INFO: `/v3/users/18bf18c3f4034586ad20542170a9cc8b` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:29.732967 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42727bb7-09c0-4210-a327-156571f8c89d admin admin] RBAC: Authorizing `identity:delete_user(user_id=18bf18c3f4034586ad20542170a9cc8b)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:29.734973 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42727bb7-09c0-4210-a327-156571f8c89d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:29.792047 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-42727bb7-09c0-4210-a327-156571f8c89d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18bf18c3f4034586ad20542170a9cc8b'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:29.802380 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-42727bb7-09c0-4210-a327-156571f8c89d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18bf18c3f4034586ad20542170a9cc8b'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:29.826373 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-42727bb7-09c0-4210-a327-156571f8c89d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18bf18c3f4034586ad20542170a9cc8b'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:29.843622 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-42727bb7-09c0-4210-a327-156571f8c89d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18bf18c3f4034586ad20542170a9cc8b'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:29.844535 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-42727bb7-09c0-4210-a327-156571f8c89d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18bf18c3f4034586ad20542170a9cc8b'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:29.852474 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1425/2836] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:01:29 2022] DELETE /identity/v3/users/18bf18c3f4034586ad20542170a9cc8b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:29.857567 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aed6b4-0e8f-4755-b763-fef32796241b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:29.858162 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aed6b4-0e8f-4755-b763-fef32796241b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:29.858162 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aed6b4-0e8f-4755-b763-fef32796241b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:29.888160 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-73aed6b4-0e8f-4755-b763-fef32796241b None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:29.890262 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-73aed6b4-0e8f-4755-b763-fef32796241b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:29.977253 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1412/2837] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:29.989748 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42727bb7-09c0-4210-a327-156571f8c89d admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:29.992199 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-42727bb7-09c0-4210-a327-156571f8c89d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:30.078042 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42727bb7-09c0-4210-a327-156571f8c89d admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:30.081885 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36461b56-59a6-441d-a504-3a71eac481a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:30.082626 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36461b56-59a6-441d-a504-3a71eac481a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:30.082915 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36461b56-59a6-441d-a504-3a71eac481a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:30.083168 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36461b56-59a6-441d-a504-3a71eac481a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:30.095731 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36461b56-59a6-441d-a504-3a71eac481a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:30.097344 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36461b56-59a6-441d-a504-3a71eac481a4 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:30.109272 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1426/2838] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:30.454593 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aed6b4-0e8f-4755-b763-fef32796241b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:30.456413 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-73aed6b4-0e8f-4755-b763-fef32796241b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:30.476716 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aed6b4-0e8f-4755-b763-fef32796241b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:30.490393 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e549567-9307-41e7-8f78-20cefc2ec2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:30.502236 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e549567-9307-41e7-8f78-20cefc2ec2f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:30.502581 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e549567-9307-41e7-8f78-20cefc2ec2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:30.502870 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e549567-9307-41e7-8f78-20cefc2ec2f1 admin admin] PATH_INFO: `/v3/projects/75fbf75bdea148318547a7524b520aee` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:30.504190 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e549567-9307-41e7-8f78-20cefc2ec2f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75fbf75bdea148318547a7524b520aee)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:30.506269 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e549567-9307-41e7-8f78-20cefc2ec2f1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:30.560375 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7e549567-9307-41e7-8f78-20cefc2ec2f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75fbf75bdea148318547a7524b520aee', 'request_id': 'req-7e549567-9307-41e7-8f78-20cefc2ec2f1'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:30.566684 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7e549567-9307-41e7-8f78-20cefc2ec2f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75fbf75bdea148318547a7524b520aee', 'request_id': 'req-7e549567-9307-41e7-8f78-20cefc2ec2f1'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:30.572991 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7e549567-9307-41e7-8f78-20cefc2ec2f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75fbf75bdea148318547a7524b520aee', 'request_id': 'req-7e549567-9307-41e7-8f78-20cefc2ec2f1'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:30.587062 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7e549567-9307-41e7-8f78-20cefc2ec2f1 admin admin] The token cache is being invalidate because project 75fbf75bdea148318547a7524b520aee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:01:30.587476 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7e549567-9307-41e7-8f78-20cefc2ec2f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:30.588190 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7e549567-9307-41e7-8f78-20cefc2ec2f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:30.589926 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1413/2839] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:01:30 2022] DELETE /identity/v3/projects/75fbf75bdea148318547a7524b520aee => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:30.594686 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36461b56-59a6-441d-a504-3a71eac481a4 service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:30.610292 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36461b56-59a6-441d-a504-3a71eac481a4 service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:30.620115 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:30.693346 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbac49-47f6-4c7c-97d3-98e6457d0b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:30.694023 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbac49-47f6-4c7c-97d3-98e6457d0b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:30.694304 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbac49-47f6-4c7c-97d3-98e6457d0b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:30.694576 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbac49-47f6-4c7c-97d3-98e6457d0b23 admin admin] PATH_INFO: `/v3/users/ff4f9f6f302b48cfad4bb62f4ba9d219` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:30.695853 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dbac49-47f6-4c7c-97d3-98e6457d0b23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff4f9f6f302b48cfad4bb62f4ba9d219)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:30.697775 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dbac49-47f6-4c7c-97d3-98e6457d0b23 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:30.748257 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-31dbac49-47f6-4c7c-97d3-98e6457d0b23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff4f9f6f302b48cfad4bb62f4ba9d219'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:30.758180 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-31dbac49-47f6-4c7c-97d3-98e6457d0b23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff4f9f6f302b48cfad4bb62f4ba9d219'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:30.767125 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-31dbac49-47f6-4c7c-97d3-98e6457d0b23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff4f9f6f302b48cfad4bb62f4ba9d219'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:30.780275 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-31dbac49-47f6-4c7c-97d3-98e6457d0b23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff4f9f6f302b48cfad4bb62f4ba9d219'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:30.780973 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-31dbac49-47f6-4c7c-97d3-98e6457d0b23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff4f9f6f302b48cfad4bb62f4ba9d219'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:30.786840 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1427/2840] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:01:30 2022] DELETE /identity/v3/users/ff4f9f6f302b48cfad4bb62f4ba9d219 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:31.082979 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e549567-9307-41e7-8f78-20cefc2ec2f1 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:31.084447 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7e549567-9307-41e7-8f78-20cefc2ec2f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:31.094196 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:31.109466 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e549567-9307-41e7-8f78-20cefc2ec2f1 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:31.170929 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b0a64-6321-4b74-b335-2145c342e070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:31.171569 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b0a64-6321-4b74-b335-2145c342e070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:31.171849 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b0a64-6321-4b74-b335-2145c342e070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:31.172108 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b0a64-6321-4b74-b335-2145c342e070 admin admin] PATH_INFO: `/v3/projects/04f9c0a8156f4d958ee7ca067aaadadd` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:31.173298 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b0a64-6321-4b74-b335-2145c342e070 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04f9c0a8156f4d958ee7ca067aaadadd)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:31.175313 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b0a64-6321-4b74-b335-2145c342e070 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:31.231398 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e72b0a64-6321-4b74-b335-2145c342e070 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04f9c0a8156f4d958ee7ca067aaadadd', 'request_id': 'req-e72b0a64-6321-4b74-b335-2145c342e070'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:31.237671 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e72b0a64-6321-4b74-b335-2145c342e070 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04f9c0a8156f4d958ee7ca067aaadadd', 'request_id': 'req-e72b0a64-6321-4b74-b335-2145c342e070'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:31.245277 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e72b0a64-6321-4b74-b335-2145c342e070 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04f9c0a8156f4d958ee7ca067aaadadd', 'request_id': 'req-e72b0a64-6321-4b74-b335-2145c342e070'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:31.260013 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e72b0a64-6321-4b74-b335-2145c342e070 admin admin] The token cache is being invalidate because project 04f9c0a8156f4d958ee7ca067aaadadd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:01:31.260298 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e72b0a64-6321-4b74-b335-2145c342e070 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:31.260934 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e72b0a64-6321-4b74-b335-2145c342e070 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:31.262523 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1414/2841] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:01:31 2022] DELETE /identity/v3/projects/04f9c0a8156f4d958ee7ca067aaadadd => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:31.267480 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff9b5e-b67b-4b28-81ec-6ca8e8bb099c None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:31.267952 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff9b5e-b67b-4b28-81ec-6ca8e8bb099c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:31.268063 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff9b5e-b67b-4b28-81ec-6ca8e8bb099c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:31.290129 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-baff9b5e-b67b-4b28-81ec-6ca8e8bb099c None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:31.291386 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-baff9b5e-b67b-4b28-81ec-6ca8e8bb099c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:31.355428 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1428/2842] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:31.364709 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5b474-945f-45e5-9a48-70608eb9187a None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:31.364991 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5b474-945f-45e5-9a48-70608eb9187a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:31.365264 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5b474-945f-45e5-9a48-70608eb9187a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:31.388276 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-11e5b474-945f-45e5-9a48-70608eb9187a None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:31.390191 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-11e5b474-945f-45e5-9a48-70608eb9187a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:31.401292 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1415/2843] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:31.406230 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff9b5e-b67b-4b28-81ec-6ca8e8bb099c None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:31.416446 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff9b5e-b67b-4b28-81ec-6ca8e8bb099c None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:31.422971 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38197353-c7d7-46e5-a35d-c0adb79e28b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:31.423570 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38197353-c7d7-46e5-a35d-c0adb79e28b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:31.423853 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38197353-c7d7-46e5-a35d-c0adb79e28b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:31.424124 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38197353-c7d7-46e5-a35d-c0adb79e28b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:31.424773 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38197353-c7d7-46e5-a35d-c0adb79e28b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:01:31.425077 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38197353-c7d7-46e5-a35d-c0adb79e28b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:31.426760 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38197353-c7d7-46e5-a35d-c0adb79e28b7 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:31.439535 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1429/2844] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 01:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:01:31.443759 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5b474-945f-45e5-9a48-70608eb9187a None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:31.453661 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5b474-945f-45e5-9a48-70608eb9187a None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:31.460180 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bc4e4-def0-4a7f-8aad-2ad8aa2b9710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:31.460828 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bc4e4-def0-4a7f-8aad-2ad8aa2b9710 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:31.461102 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bc4e4-def0-4a7f-8aad-2ad8aa2b9710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:31.461370 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bc4e4-def0-4a7f-8aad-2ad8aa2b9710 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:31.462030 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73bc4e4-def0-4a7f-8aad-2ad8aa2b9710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:31.463985 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73bc4e4-def0-4a7f-8aad-2ad8aa2b9710 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:31.493732 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1416/2845] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:01:31 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:01:31.497962 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38197353-c7d7-46e5-a35d-c0adb79e28b7 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:31.508039 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38197353-c7d7-46e5-a35d-c0adb79e28b7 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:31.524538 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:31.576876 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c28b9-8544-487e-80bb-d0e1dba2fcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:31.577487 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c28b9-8544-487e-80bb-d0e1dba2fcbd admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:31.577790 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c28b9-8544-487e-80bb-d0e1dba2fcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:31.578114 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c28b9-8544-487e-80bb-d0e1dba2fcbd admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:31.578748 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c28b9-8544-487e-80bb-d0e1dba2fcbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:31.580752 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c28b9-8544-487e-80bb-d0e1dba2fcbd admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:31.604495 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1430/2846] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:01:31 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:31.608955 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bc4e4-def0-4a7f-8aad-2ad8aa2b9710 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:31.620115 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bc4e4-def0-4a7f-8aad-2ad8aa2b9710 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:31.626408 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e7618-978c-43ae-b4d0-594a29b9e42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:31.627028 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e7618-978c-43ae-b4d0-594a29b9e42f admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:31.627306 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e7618-978c-43ae-b4d0-594a29b9e42f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:31.627567 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e7618-978c-43ae-b4d0-594a29b9e42f admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:31.628218 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e7618-978c-43ae-b4d0-594a29b9e42f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:31.629908 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e7618-978c-43ae-b4d0-594a29b9e42f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:31.640794 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1417/2847] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:31.645257 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c28b9-8544-487e-80bb-d0e1dba2fcbd admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:31.662708 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c28b9-8544-487e-80bb-d0e1dba2fcbd admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:31.671253 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fff726-3471-41a5-824f-bca9aa44fb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:31.671878 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fff726-3471-41a5-824f-bca9aa44fb10 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:31.672167 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fff726-3471-41a5-824f-bca9aa44fb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:31.672441 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fff726-3471-41a5-824f-bca9aa44fb10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:31.673116 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fff726-3471-41a5-824f-bca9aa44fb10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:31.675170 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fff726-3471-41a5-824f-bca9aa44fb10 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:31.689636 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1431/2848] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:31.694097 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e7618-978c-43ae-b4d0-594a29b9e42f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:31.704757 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e7618-978c-43ae-b4d0-594a29b9e42f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:31.710325 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364d0ca-e3df-46d3-9bda-487fdd77dfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:31.710972 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364d0ca-e3df-46d3-9bda-487fdd77dfe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:31.711246 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364d0ca-e3df-46d3-9bda-487fdd77dfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:31.711517 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364d0ca-e3df-46d3-9bda-487fdd77dfe1 admin admin] PATH_INFO: `/v3/projects/b8a20401bea9457db93d605d37818a8d/users/b08d25bc237f445d91fac676c687d6f6/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:31.729193 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4364d0ca-e3df-46d3-9bda-487fdd77dfe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8a20401bea9457db93d605d37818a8d, user_id=b08d25bc237f445d91fac676c687d6f6, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:31.732155 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4364d0ca-e3df-46d3-9bda-487fdd77dfe1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:31.748259 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1418/2849] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:31 2022] PUT /identity/v3/projects/b8a20401bea9457db93d605d37818a8d/users/b08d25bc237f445d91fac676c687d6f6/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:31.758771 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a99d7c-9e22-4477-a38a-8a7f6c90c1ae None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:31.759083 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a99d7c-9e22-4477-a38a-8a7f6c90c1ae None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:31.759376 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a99d7c-9e22-4477-a38a-8a7f6c90c1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:31.790744 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-98a99d7c-9e22-4477-a38a-8a7f6c90c1ae None None] MFA Rules not processed for user `b08d25bc237f445d91fac676c687d6f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:31.792002 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-98a99d7c-9e22-4477-a38a-8a7f6c90c1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:31.864855 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1432/2850] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:31.876885 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364d0ca-e3df-46d3-9bda-487fdd77dfe1 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:31.879336 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4364d0ca-e3df-46d3-9bda-487fdd77dfe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:31.919547 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:31.955221 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364d0ca-e3df-46d3-9bda-487fdd77dfe1 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:31.959167 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef02b4-3e2a-4f0d-9862-1efd3b231081 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:31.959783 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef02b4-3e2a-4f0d-9862-1efd3b231081 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:31.960208 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef02b4-3e2a-4f0d-9862-1efd3b231081 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:31.960489 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef02b4-3e2a-4f0d-9862-1efd3b231081 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:31.969402 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef02b4-3e2a-4f0d-9862-1efd3b231081 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:31.970922 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef02b4-3e2a-4f0d-9862-1efd3b231081 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:31.980315 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1419/2851] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:34.209088 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c369eb4-ab96-4181-8253-d4e0c713d499 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:34.209615 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c369eb4-ab96-4181-8253-d4e0c713d499 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:34.209615 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c369eb4-ab96-4181-8253-d4e0c713d499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:34.229442 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-4c369eb4-ab96-4181-8253-d4e0c713d499 None None] MFA Rules not processed for user `0aabc9e5eaa94103bb88e425ed745854`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:34.231039 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-4c369eb4-ab96-4181-8253-d4e0c713d499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:34.299060 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1433/2852] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:34.569797 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef02b4-3e2a-4f0d-9862-1efd3b231081 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:34.640826 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef02b4-3e2a-4f0d-9862-1efd3b231081 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:34.645467 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd286a2c-2677-4c06-bc0f-8d160da4563f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:34.646144 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd286a2c-2677-4c06-bc0f-8d160da4563f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:34.646424 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd286a2c-2677-4c06-bc0f-8d160da4563f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:34.646696 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd286a2c-2677-4c06-bc0f-8d160da4563f admin admin] PATH_INFO: `/v3/users/b08d25bc237f445d91fac676c687d6f6` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:34.647829 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd286a2c-2677-4c06-bc0f-8d160da4563f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b08d25bc237f445d91fac676c687d6f6)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:34.649767 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd286a2c-2677-4c06-bc0f-8d160da4563f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:34.699259 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-cd286a2c-2677-4c06-bc0f-8d160da4563f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b08d25bc237f445d91fac676c687d6f6'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:34.711804 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-cd286a2c-2677-4c06-bc0f-8d160da4563f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b08d25bc237f445d91fac676c687d6f6'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:34.719719 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-cd286a2c-2677-4c06-bc0f-8d160da4563f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b08d25bc237f445d91fac676c687d6f6'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:34.728858 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-cd286a2c-2677-4c06-bc0f-8d160da4563f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b08d25bc237f445d91fac676c687d6f6'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:34.729570 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-cd286a2c-2677-4c06-bc0f-8d160da4563f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b08d25bc237f445d91fac676c687d6f6'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:34.743606 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1420/2853] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:01:34 2022] DELETE /identity/v3/users/b08d25bc237f445d91fac676c687d6f6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:34.748339 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe9ef1-f678-4dfd-a3ce-c71671de62f3 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:34.748530 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe9ef1-f678-4dfd-a3ce-c71671de62f3 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:34.748804 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe9ef1-f678-4dfd-a3ce-c71671de62f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:34.767871 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-bafe9ef1-f678-4dfd-a3ce-c71671de62f3 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:34.769076 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-bafe9ef1-f678-4dfd-a3ce-c71671de62f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:34.797776 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:34.832807 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1434/2854] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:34.843628 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd286a2c-2677-4c06-bc0f-8d160da4563f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:34.845361 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-cd286a2c-2677-4c06-bc0f-8d160da4563f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:34.912551 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd286a2c-2677-4c06-bc0f-8d160da4563f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:34.924084 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4704831-ce38-464f-9896-533835ad0132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:34.924710 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4704831-ce38-464f-9896-533835ad0132 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:34.924989 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4704831-ce38-464f-9896-533835ad0132 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:34.925487 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4704831-ce38-464f-9896-533835ad0132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:34.933015 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:34.936260 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4704831-ce38-464f-9896-533835ad0132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:34.938411 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4704831-ce38-464f-9896-533835ad0132 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:34.950051 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1421/2855] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:35.265880 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe9ef1-f678-4dfd-a3ce-c71671de62f3 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:35.267079 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-bafe9ef1-f678-4dfd-a3ce-c71671de62f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:35.286711 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe9ef1-f678-4dfd-a3ce-c71671de62f3 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:35.291959 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4cd10-f512-4ec7-8ca6-2ac9a88ece5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:35.292773 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4cd10-f512-4ec7-8ca6-2ac9a88ece5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:35.293427 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4cd10-f512-4ec7-8ca6-2ac9a88ece5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:35.293707 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4cd10-f512-4ec7-8ca6-2ac9a88ece5b admin admin] PATH_INFO: `/v3/projects/b8a20401bea9457db93d605d37818a8d` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:35.295044 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4cd10-f512-4ec7-8ca6-2ac9a88ece5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8a20401bea9457db93d605d37818a8d)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:35.297088 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4cd10-f512-4ec7-8ca6-2ac9a88ece5b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:35.348887 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-87f4cd10-f512-4ec7-8ca6-2ac9a88ece5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8a20401bea9457db93d605d37818a8d', 'request_id': 'req-87f4cd10-f512-4ec7-8ca6-2ac9a88ece5b'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:35.358832 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-87f4cd10-f512-4ec7-8ca6-2ac9a88ece5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8a20401bea9457db93d605d37818a8d', 'request_id': 'req-87f4cd10-f512-4ec7-8ca6-2ac9a88ece5b'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:35.366837 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-87f4cd10-f512-4ec7-8ca6-2ac9a88ece5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8a20401bea9457db93d605d37818a8d', 'request_id': 'req-87f4cd10-f512-4ec7-8ca6-2ac9a88ece5b'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:35.379306 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-87f4cd10-f512-4ec7-8ca6-2ac9a88ece5b admin admin] The token cache is being invalidate because project b8a20401bea9457db93d605d37818a8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:01:35.379642 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-87f4cd10-f512-4ec7-8ca6-2ac9a88ece5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:35.380402 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-87f4cd10-f512-4ec7-8ca6-2ac9a88ece5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:35.382035 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1435/2856] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:01:35 2022] DELETE /identity/v3/projects/b8a20401bea9457db93d605d37818a8d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:35.387597 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd9ef3-8ec9-4bb0-961f-21150953e8a8 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:35.387869 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd9ef3-8ec9-4bb0-961f-21150953e8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:35.388141 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd9ef3-8ec9-4bb0-961f-21150953e8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:35.407706 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e8cd9ef3-8ec9-4bb0-961f-21150953e8a8 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:35.408995 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e8cd9ef3-8ec9-4bb0-961f-21150953e8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:35.475791 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1422/2857] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:01:35.484003 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3501234-df7e-44c8-a3a5-9ec750540fa3 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:35.484283 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3501234-df7e-44c8-a3a5-9ec750540fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:35.484565 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3501234-df7e-44c8-a3a5-9ec750540fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:35.504772 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-b3501234-df7e-44c8-a3a5-9ec750540fa3 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:35.505951 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b3501234-df7e-44c8-a3a5-9ec750540fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:35.516372 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1436/2858] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:35.520978 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd9ef3-8ec9-4bb0-961f-21150953e8a8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:35.535752 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd9ef3-8ec9-4bb0-961f-21150953e8a8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:35.542397 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9ad19-2c4a-49b3-a8c8-1284b886e19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:35.543105 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9ad19-2c4a-49b3-a8c8-1284b886e19b admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:35.543382 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9ad19-2c4a-49b3-a8c8-1284b886e19b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:35.544078 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9ad19-2c4a-49b3-a8c8-1284b886e19b admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:35.544296 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9ad19-2c4a-49b3-a8c8-1284b886e19b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:01:35.544598 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9ad19-2c4a-49b3-a8c8-1284b886e19b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:35.546454 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9ad19-2c4a-49b3-a8c8-1284b886e19b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:35.559520 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1423/2859] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 01:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:01:35.564286 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3501234-df7e-44c8-a3a5-9ec750540fa3 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:35.576409 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3501234-df7e-44c8-a3a5-9ec750540fa3 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:35.581495 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9bbe10-fec0-45b5-8b57-ab929b8b382f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:35.582691 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bbe10-fec0-45b5-8b57-ab929b8b382f admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:35.582959 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bbe10-fec0-45b5-8b57-ab929b8b382f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:35.583225 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bbe10-fec0-45b5-8b57-ab929b8b382f admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:35.583851 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9bbe10-fec0-45b5-8b57-ab929b8b382f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:35.585888 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9bbe10-fec0-45b5-8b57-ab929b8b382f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:35.621341 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1437/2860] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:01:35 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:01:35.623247 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9ad19-2c4a-49b3-a8c8-1284b886e19b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:35.635604 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9ad19-2c4a-49b3-a8c8-1284b886e19b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:35.704666 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7bf8a8-da7d-426a-bfee-21d869fecdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:35.705270 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7bf8a8-da7d-426a-bfee-21d869fecdff admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:35.705597 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7bf8a8-da7d-426a-bfee-21d869fecdff admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:35.705892 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7bf8a8-da7d-426a-bfee-21d869fecdff admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:35.706530 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7bf8a8-da7d-426a-bfee-21d869fecdff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:35.708422 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7bf8a8-da7d-426a-bfee-21d869fecdff admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:35.731084 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1424/2861] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:01:35 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:35.735695 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9bbe10-fec0-45b5-8b57-ab929b8b382f admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:35.745931 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9bbe10-fec0-45b5-8b57-ab929b8b382f admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:35.751152 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645c001-9d77-4b61-b4c7-aef7dc821a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:35.751761 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645c001-9d77-4b61-b4c7-aef7dc821a07 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:35.752039 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645c001-9d77-4b61-b4c7-aef7dc821a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:35.752309 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645c001-9d77-4b61-b4c7-aef7dc821a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:35.752955 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645c001-9d77-4b61-b4c7-aef7dc821a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:35.754644 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645c001-9d77-4b61-b4c7-aef7dc821a07 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:35.765211 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1438/2862] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:01:35.769277 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7bf8a8-da7d-426a-bfee-21d869fecdff admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:35.779850 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7bf8a8-da7d-426a-bfee-21d869fecdff admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:35.785654 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ab6ff-5740-4765-997a-ec21129958bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:35.786283 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ab6ff-5740-4765-997a-ec21129958bf admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:35.786555 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ab6ff-5740-4765-997a-ec21129958bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:35.786823 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ab6ff-5740-4765-997a-ec21129958bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:35.787480 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ab6ff-5740-4765-997a-ec21129958bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:35.789088 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ab6ff-5740-4765-997a-ec21129958bf admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:35.799225 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1425/2863] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:35.803525 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645c001-9d77-4b61-b4c7-aef7dc821a07 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:35.814189 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645c001-9d77-4b61-b4c7-aef7dc821a07 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:35.819121 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8601c-7457-4663-a2ba-f9404d01893d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:35.819807 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8601c-7457-4663-a2ba-f9404d01893d admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:35.820115 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8601c-7457-4663-a2ba-f9404d01893d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:35.820411 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8601c-7457-4663-a2ba-f9404d01893d admin admin] PATH_INFO: `/v3/projects/08097b0559c04ed4af6dda519c4e261a/users/bd1231c96a3a4a71908fa4e124f97ded/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:35.836468 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8601c-7457-4663-a2ba-f9404d01893d admin admin] RBAC: Authorizing `identity:create_grant(project_id=08097b0559c04ed4af6dda519c4e261a, user_id=bd1231c96a3a4a71908fa4e124f97ded, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:35.839189 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8601c-7457-4663-a2ba-f9404d01893d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:35.854382 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1439/2864] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:35 2022] PUT /identity/v3/projects/08097b0559c04ed4af6dda519c4e261a/users/bd1231c96a3a4a71908fa4e124f97ded/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:35.866032 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab4588-22a7-4cce-b30d-6c6d1b4dbe45 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:35.866351 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab4588-22a7-4cce-b30d-6c6d1b4dbe45 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:35.866645 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab4588-22a7-4cce-b30d-6c6d1b4dbe45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:35.894398 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-2cab4588-22a7-4cce-b30d-6c6d1b4dbe45 None None] MFA Rules not processed for user `bd1231c96a3a4a71908fa4e124f97ded`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:35.895602 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2cab4588-22a7-4cce-b30d-6c6d1b4dbe45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:35.945648 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:35.966166 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1426/2865] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:35.977147 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8601c-7457-4663-a2ba-f9404d01893d admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:35.978979 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1cf8601c-7457-4663-a2ba-f9404d01893d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:36.046315 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8601c-7457-4663-a2ba-f9404d01893d admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:36.050143 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b04642-5385-45ba-9d8c-576bb352363b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fbafa16c1ce4402ae4086e51767c05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:36.050999 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b04642-5385-45ba-9d8c-576bb352363b service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:36.051118 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b04642-5385-45ba-9d8c-576bb352363b service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:36.051435 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b04642-5385-45ba-9d8c-576bb352363b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:36.059940 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:36.062867 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b04642-5385-45ba-9d8c-576bb352363b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:36.064871 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b04642-5385-45ba-9d8c-576bb352363b service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:36.079181 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1440/2866] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:39.058996 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00238d-fba0-4bc2-ab50-3becfe54264d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:39.059521 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00238d-fba0-4bc2-ab50-3becfe54264d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:39.059521 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00238d-fba0-4bc2-ab50-3becfe54264d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:39.080099 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-2c00238d-fba0-4bc2-ab50-3becfe54264d None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:39.081249 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2c00238d-fba0-4bc2-ab50-3becfe54264d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:39.142772 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1427/2867] 10.222.0.62 () {58 vars in 1016 bytes} [Sun Aug 28 01:01:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:39.166023 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b04642-5385-45ba-9d8c-576bb352363b service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:39.167531 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-92b04642-5385-45ba-9d8c-576bb352363b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:39.251003 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b04642-5385-45ba-9d8c-576bb352363b service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:39.258009 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6659a-3a77-4a05-b8d5-32ca1acdfb83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:39.258868 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6659a-3a77-4a05-b8d5-32ca1acdfb83 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:39.259365 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6659a-3a77-4a05-b8d5-32ca1acdfb83 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:39.259753 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6659a-3a77-4a05-b8d5-32ca1acdfb83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:39.272363 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6659a-3a77-4a05-b8d5-32ca1acdfb83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:39.274732 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6659a-3a77-4a05-b8d5-32ca1acdfb83 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:39.286617 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1441/2868] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:42.191313 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4059f5-48fc-4b88-a936-7eff9de430ec None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:42.191830 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4059f5-48fc-4b88-a936-7eff9de430ec None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:42.191939 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4059f5-48fc-4b88-a936-7eff9de430ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:42.213355 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-5f4059f5-48fc-4b88-a936-7eff9de430ec None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:42.214566 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5f4059f5-48fc-4b88-a936-7eff9de430ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:42.223897 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1428/2869] 10.222.0.62 () {58 vars in 1016 bytes} [Sun Aug 28 01:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:42.245306 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6659a-3a77-4a05-b8d5-32ca1acdfb83 service nova] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:42.258325 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6659a-3a77-4a05-b8d5-32ca1acdfb83 service nova] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:42.265229 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476e774-0721-4799-95f3-480f8d0e722a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:42.266008 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476e774-0721-4799-95f3-480f8d0e722a service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:42.266314 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476e774-0721-4799-95f3-480f8d0e722a service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:42.266607 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476e774-0721-4799-95f3-480f8d0e722a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:42.276557 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476e774-0721-4799-95f3-480f8d0e722a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:42.278203 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476e774-0721-4799-95f3-480f8d0e722a service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:42.288632 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1442/2870] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:45.541573 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e9288-6fe3-431d-93fe-9e8fbe6af25a None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:45.544787 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e9288-6fe3-431d-93fe-9e8fbe6af25a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:45.545038 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e9288-6fe3-431d-93fe-9e8fbe6af25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:45.572173 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-231e9288-6fe3-431d-93fe-9e8fbe6af25a None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:45.573693 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-231e9288-6fe3-431d-93fe-9e8fbe6af25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:45.585318 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1429/2871] 10.222.0.62 () {58 vars in 1016 bytes} [Sun Aug 28 01:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:45.626213 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476e774-0721-4799-95f3-480f8d0e722a service nova] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:45.627733 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-7476e774-0721-4799-95f3-480f8d0e722a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:45.642459 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476e774-0721-4799-95f3-480f8d0e722a service nova] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:45.648049 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60527f-44d0-447d-9687-a13f325cf62f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:45.648648 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60527f-44d0-447d-9687-a13f325cf62f service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:45.648923 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60527f-44d0-447d-9687-a13f325cf62f service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:45.649190 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60527f-44d0-447d-9687-a13f325cf62f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:45.658522 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60527f-44d0-447d-9687-a13f325cf62f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:45.660905 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60527f-44d0-447d-9687-a13f325cf62f service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:45.673678 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1443/2872] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:46.211847 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e9288-6fe3-431d-93fe-9e8fbe6af25a None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:46.222799 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e9288-6fe3-431d-93fe-9e8fbe6af25a None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:46.229401 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7685780-c1c1-4416-991a-4b359a9804ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:46.230260 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7685780-c1c1-4416-991a-4b359a9804ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:46.230612 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7685780-c1c1-4416-991a-4b359a9804ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:46.230941 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7685780-c1c1-4416-991a-4b359a9804ba admin admin] PATH_INFO: `/v3/users/bd1231c96a3a4a71908fa4e124f97ded` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:46.232579 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7685780-c1c1-4416-991a-4b359a9804ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd1231c96a3a4a71908fa4e124f97ded)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:46.234675 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7685780-c1c1-4416-991a-4b359a9804ba admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:46.290731 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f7685780-c1c1-4416-991a-4b359a9804ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd1231c96a3a4a71908fa4e124f97ded'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:46.305071 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f7685780-c1c1-4416-991a-4b359a9804ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd1231c96a3a4a71908fa4e124f97ded'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:46.312175 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f7685780-c1c1-4416-991a-4b359a9804ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd1231c96a3a4a71908fa4e124f97ded'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:46.321176 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f7685780-c1c1-4416-991a-4b359a9804ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd1231c96a3a4a71908fa4e124f97ded'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:46.321983 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f7685780-c1c1-4416-991a-4b359a9804ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd1231c96a3a4a71908fa4e124f97ded'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:46.328629 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1430/2873] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:01:46 2022] DELETE /identity/v3/users/bd1231c96a3a4a71908fa4e124f97ded => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:46.333262 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1b2aa-2f24-4132-956a-180e90570297 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:46.333558 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1b2aa-2f24-4132-956a-180e90570297 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:46.333825 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1b2aa-2f24-4132-956a-180e90570297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:46.357787 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-29a1b2aa-2f24-4132-956a-180e90570297 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:46.359293 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-29a1b2aa-2f24-4132-956a-180e90570297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:46.422960 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1444/2874] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:46.432767 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7685780-c1c1-4416-991a-4b359a9804ba admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:46.434539 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f7685780-c1c1-4416-991a-4b359a9804ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:46.493167 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7685780-c1c1-4416-991a-4b359a9804ba admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:46.498174 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73beae36-88e4-4914-957b-70cedfa6cf61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:46.498770 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73beae36-88e4-4914-957b-70cedfa6cf61 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:46.499041 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73beae36-88e4-4914-957b-70cedfa6cf61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:46.499306 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73beae36-88e4-4914-957b-70cedfa6cf61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:46.505822 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:46.509928 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73beae36-88e4-4914-957b-70cedfa6cf61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:46.511906 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73beae36-88e4-4914-957b-70cedfa6cf61 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:46.521733 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1431/2875] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:46.809572 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1b2aa-2f24-4132-956a-180e90570297 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:46.811132 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-29a1b2aa-2f24-4132-956a-180e90570297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:46.828419 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1b2aa-2f24-4132-956a-180e90570297 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:46.833617 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2eb4f9-6b57-4452-a1a6-d503e6d81458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:46.834370 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2eb4f9-6b57-4452-a1a6-d503e6d81458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:46.834561 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2eb4f9-6b57-4452-a1a6-d503e6d81458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:46.834824 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2eb4f9-6b57-4452-a1a6-d503e6d81458 admin admin] PATH_INFO: `/v3/projects/08097b0559c04ed4af6dda519c4e261a` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:46.836318 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2eb4f9-6b57-4452-a1a6-d503e6d81458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08097b0559c04ed4af6dda519c4e261a)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:46.838261 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2eb4f9-6b57-4452-a1a6-d503e6d81458 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:46.894734 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8b2eb4f9-6b57-4452-a1a6-d503e6d81458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08097b0559c04ed4af6dda519c4e261a', 'request_id': 'req-8b2eb4f9-6b57-4452-a1a6-d503e6d81458'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:46.896392 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:46.904011 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8b2eb4f9-6b57-4452-a1a6-d503e6d81458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08097b0559c04ed4af6dda519c4e261a', 'request_id': 'req-8b2eb4f9-6b57-4452-a1a6-d503e6d81458'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:46.910860 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8b2eb4f9-6b57-4452-a1a6-d503e6d81458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08097b0559c04ed4af6dda519c4e261a', 'request_id': 'req-8b2eb4f9-6b57-4452-a1a6-d503e6d81458'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:46.922446 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8b2eb4f9-6b57-4452-a1a6-d503e6d81458 admin admin] The token cache is being invalidate because project 08097b0559c04ed4af6dda519c4e261a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:01:46.922730 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8b2eb4f9-6b57-4452-a1a6-d503e6d81458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:46.923350 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8b2eb4f9-6b57-4452-a1a6-d503e6d81458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:46.924818 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1445/2876] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:01:46 2022] DELETE /identity/v3/projects/08097b0559c04ed4af6dda519c4e261a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:49.592434 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37da53-8593-45e4-9fe3-8ff01a7dc6d3 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:49.592934 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37da53-8593-45e4-9fe3-8ff01a7dc6d3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:49.593118 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37da53-8593-45e4-9fe3-8ff01a7dc6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:49.613433 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-af37da53-8593-45e4-9fe3-8ff01a7dc6d3 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:49.614805 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-af37da53-8593-45e4-9fe3-8ff01a7dc6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:49.676402 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1432/2877] 10.222.0.62 () {58 vars in 1016 bytes} [Sun Aug 28 01:01:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:49.703465 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2eb4f9-6b57-4452-a1a6-d503e6d81458 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:49.705057 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8b2eb4f9-6b57-4452-a1a6-d503e6d81458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:49.787605 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2eb4f9-6b57-4452-a1a6-d503e6d81458 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:49.794357 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb33ca7-034a-49d6-b8db-41647ca52a22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:49.794986 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb33ca7-034a-49d6-b8db-41647ca52a22 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:49.795271 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb33ca7-034a-49d6-b8db-41647ca52a22 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:49.795540 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb33ca7-034a-49d6-b8db-41647ca52a22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:49.804710 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb33ca7-034a-49d6-b8db-41647ca52a22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:49.806358 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb33ca7-034a-49d6-b8db-41647ca52a22 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:49.817079 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1446/2878] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:52.561518 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cafc0-7fc5-46c5-8b4a-2b018bd514aa None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:52.561969 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cafc0-7fc5-46c5-8b4a-2b018bd514aa None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:52.562106 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cafc0-7fc5-46c5-8b4a-2b018bd514aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:52.582614 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-360cafc0-7fc5-46c5-8b4a-2b018bd514aa None None] MFA Rules not processed for user `3302fdf33b5b4583a10e7c760c577cda`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:52.583825 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-360cafc0-7fc5-46c5-8b4a-2b018bd514aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:52.644713 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1433/2879] 10.222.0.52 () {58 vars in 1009 bytes} [Sun Aug 28 01:01:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:52.695274 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb33ca7-034a-49d6-b8db-41647ca52a22 service nova] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:52.696719 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-0fb33ca7-034a-49d6-b8db-41647ca52a22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:52.773041 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb33ca7-034a-49d6-b8db-41647ca52a22 service nova] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:52.778717 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797d761-cff2-4d6c-a81c-0b260cb1a85b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80a6019cf424c16a1d461a632cf8568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:52.779285 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bba794-93d9-4ddb-882e-6550383b113b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:52.779411 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797d761-cff2-4d6c-a81c-0b260cb1a85b service swift] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:52.779595 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797d761-cff2-4d6c-a81c-0b260cb1a85b service swift] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:52.779696 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bba794-93d9-4ddb-882e-6550383b113b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:52.780004 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797d761-cff2-4d6c-a81c-0b260cb1a85b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:52.780126 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bba794-93d9-4ddb-882e-6550383b113b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:52.788745 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797d761-cff2-4d6c-a81c-0b260cb1a85b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:52.790432 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797d761-cff2-4d6c-a81c-0b260cb1a85b service swift] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:52.799222 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f6bba794-93d9-4ddb-882e-6550383b113b None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:52.799393 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1447/2880] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Aug 28 01:01:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:01:52.800501 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f6bba794-93d9-4ddb-882e-6550383b113b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:52.809492 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1434/2881] 10.222.0.62 () {58 vars in 1016 bytes} [Sun Aug 28 01:01:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:01:52.832947 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797d761-cff2-4d6c-a81c-0b260cb1a85b service swift] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:52.836315 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f797d761-cff2-4d6c-a81c-0b260cb1a85b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:52.855746 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797d761-cff2-4d6c-a81c-0b260cb1a85b service swift] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:52.862235 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19cc73-46a6-4cba-9ce4-4ad28e1733b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:52.862860 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19cc73-46a6-4cba-9ce4-4ad28e1733b7 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:52.863130 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19cc73-46a6-4cba-9ce4-4ad28e1733b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:52.863402 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19cc73-46a6-4cba-9ce4-4ad28e1733b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:52.875990 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19cc73-46a6-4cba-9ce4-4ad28e1733b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:52.878403 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19cc73-46a6-4cba-9ce4-4ad28e1733b7 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:52.889867 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1448/2882] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:56.000317 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14ee9c-ff86-451a-a886-d84e9313f89a None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:56.000893 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14ee9c-ff86-451a-a886-d84e9313f89a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:56.000983 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14ee9c-ff86-451a-a886-d84e9313f89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:56.022789 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-7b14ee9c-ff86-451a-a886-d84e9313f89a None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:56.024114 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7b14ee9c-ff86-451a-a886-d84e9313f89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:56.034438 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1435/2883] 10.222.0.62 () {58 vars in 1016 bytes} [Sun Aug 28 01:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:56.064541 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19cc73-46a6-4cba-9ce4-4ad28e1733b7 service nova] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:56.077478 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19cc73-46a6-4cba-9ce4-4ad28e1733b7 service nova] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:56.083720 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0dbf9-638b-4c27-895a-b0ab9bda4537 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:56.084349 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0dbf9-638b-4c27-895a-b0ab9bda4537 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:56.084648 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0dbf9-638b-4c27-895a-b0ab9bda4537 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:56.084935 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0dbf9-638b-4c27-895a-b0ab9bda4537 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:56.095558 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0dbf9-638b-4c27-895a-b0ab9bda4537 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:56.098074 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0dbf9-638b-4c27-895a-b0ab9bda4537 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:56.110300 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1449/2884] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:02:06.017743 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=61 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:06.104492 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=84 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:07.228171 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57b845-c598-4a36-9a0f-0d8dd2a32ae5 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:07.228655 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57b845-c598-4a36-9a0f-0d8dd2a32ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:07.228838 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57b845-c598-4a36-9a0f-0d8dd2a32ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:07.249108 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-bc57b845-c598-4a36-9a0f-0d8dd2a32ae5 None None] MFA Rules not processed for user `3302fdf33b5b4583a10e7c760c577cda`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:07.250444 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bc57b845-c598-4a36-9a0f-0d8dd2a32ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:07.257761 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1436/2885] 10.222.0.52 () {58 vars in 967 bytes} [Sun Aug 28 01:02:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:07.270103 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0dbf9-638b-4c27-895a-b0ab9bda4537 service nova] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:07.282582 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0dbf9-638b-4c27-895a-b0ab9bda4537 service nova] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:07.287783 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899f782-d4ae-49b4-bc59-14f55da93ffe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80a6019cf424c16a1d461a632cf8568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:07.288377 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899f782-d4ae-49b4-bc59-14f55da93ffe service swift] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:07.288657 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899f782-d4ae-49b4-bc59-14f55da93ffe service swift] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:07.288929 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899f782-d4ae-49b4-bc59-14f55da93ffe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:07.297512 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899f782-d4ae-49b4-bc59-14f55da93ffe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:07.299159 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899f782-d4ae-49b4-bc59-14f55da93ffe service swift] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:07.307036 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1450/2886] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Aug 28 01:02:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:02:09.265326 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57b845-c598-4a36-9a0f-0d8dd2a32ae5 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:09.267183 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bc57b845-c598-4a36-9a0f-0d8dd2a32ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:09.344886 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899f782-d4ae-49b4-bc59-14f55da93ffe service swift] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:09.346418 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c899f782-d4ae-49b4-bc59-14f55da93ffe service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:09.371381 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899f782-d4ae-49b4-bc59-14f55da93ffe service swift] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:09.373328 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57b845-c598-4a36-9a0f-0d8dd2a32ae5 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:09.378525 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f86ce3-d2d6-4f26-8d43-0bc6b89caa24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae87149f6ab04a9997263598737ae27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:09.379026 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37945891-ab68-4bd1-813b-896061f0d138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:09.379159 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f86ce3-d2d6-4f26-8d43-0bc6b89caa24 service placement] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:09.379411 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f86ce3-d2d6-4f26-8d43-0bc6b89caa24 service placement] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:09.379653 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37945891-ab68-4bd1-813b-896061f0d138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:09.379764 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f86ce3-d2d6-4f26-8d43-0bc6b89caa24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:09.379930 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37945891-ab68-4bd1-813b-896061f0d138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:09.380221 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37945891-ab68-4bd1-813b-896061f0d138 admin admin] PATH_INFO: `/v3/users/0aabc9e5eaa94103bb88e425ed745854` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:09.381342 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37945891-ab68-4bd1-813b-896061f0d138 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aabc9e5eaa94103bb88e425ed745854)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:09.381536 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-06f86ce3-d2d6-4f26-8d43-0bc6b89caa24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:09.383327 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37945891-ab68-4bd1-813b-896061f0d138 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:09.393455 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f86ce3-d2d6-4f26-8d43-0bc6b89caa24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:09.395157 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f86ce3-d2d6-4f26-8d43-0bc6b89caa24 service placement] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:09.405887 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1437/2887] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:02:09.431499 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-37945891-ab68-4bd1-813b-896061f0d138 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aabc9e5eaa94103bb88e425ed745854'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:09.438521 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-37945891-ab68-4bd1-813b-896061f0d138 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aabc9e5eaa94103bb88e425ed745854'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:09.446728 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-37945891-ab68-4bd1-813b-896061f0d138 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aabc9e5eaa94103bb88e425ed745854'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:09.458925 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-37945891-ab68-4bd1-813b-896061f0d138 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aabc9e5eaa94103bb88e425ed745854'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:09.459619 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-37945891-ab68-4bd1-813b-896061f0d138 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aabc9e5eaa94103bb88e425ed745854'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:09.465819 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1451/2888] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:02:09 2022] DELETE /identity/v3/users/0aabc9e5eaa94103bb88e425ed745854 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:02:09.652601 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f86ce3-d2d6-4f26-8d43-0bc6b89caa24 service placement] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:09.663627 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f86ce3-d2d6-4f26-8d43-0bc6b89caa24 service placement] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:09.722563 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c6438-ed25-4c59-b95b-995401511729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:09.723187 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c6438-ed25-4c59-b95b-995401511729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:09.723455 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c6438-ed25-4c59-b95b-995401511729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:09.723757 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c6438-ed25-4c59-b95b-995401511729 admin admin] PATH_INFO: `/v3/projects/5c0685292e6e4995adb05ad94eb139d5` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:09.724870 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c6438-ed25-4c59-b95b-995401511729 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c0685292e6e4995adb05ad94eb139d5)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:09.726821 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c6438-ed25-4c59-b95b-995401511729 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:09.776057 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-923c6438-ed25-4c59-b95b-995401511729 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c0685292e6e4995adb05ad94eb139d5', 'request_id': 'req-923c6438-ed25-4c59-b95b-995401511729'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:09.781957 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-923c6438-ed25-4c59-b95b-995401511729 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c0685292e6e4995adb05ad94eb139d5', 'request_id': 'req-923c6438-ed25-4c59-b95b-995401511729'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:09.788245 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-923c6438-ed25-4c59-b95b-995401511729 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c0685292e6e4995adb05ad94eb139d5', 'request_id': 'req-923c6438-ed25-4c59-b95b-995401511729'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:09.802435 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-923c6438-ed25-4c59-b95b-995401511729 admin admin] The token cache is being invalidate because project 5c0685292e6e4995adb05ad94eb139d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:02:09.802753 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-923c6438-ed25-4c59-b95b-995401511729 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:09.803511 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-923c6438-ed25-4c59-b95b-995401511729 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:09.805225 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1438/2889] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:02:09 2022] DELETE /identity/v3/projects/5c0685292e6e4995adb05ad94eb139d5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:02:09.810662 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5cab8-982b-4047-96cf-2def6ce185bc None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:09.811133 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5cab8-982b-4047-96cf-2def6ce185bc None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:09.811581 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5cab8-982b-4047-96cf-2def6ce185bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:09.831988 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-58c5cab8-982b-4047-96cf-2def6ce185bc None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:09.833233 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-58c5cab8-982b-4047-96cf-2def6ce185bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:09.899118 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1452/2890] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:09.908454 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2594e-da1d-4b4a-aa50-899ffab3f316 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:09.908742 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2594e-da1d-4b4a-aa50-899ffab3f316 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:09.909024 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2594e-da1d-4b4a-aa50-899ffab3f316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:09.929330 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a5b2594e-da1d-4b4a-aa50-899ffab3f316 None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:09.930546 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a5b2594e-da1d-4b4a-aa50-899ffab3f316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:09.938922 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1439/2891] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:09.943279 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5cab8-982b-4047-96cf-2def6ce185bc None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:09.953807 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5cab8-982b-4047-96cf-2def6ce185bc None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:09.959069 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769afd6-ac1b-4f46-aa10-200e0655b924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:09.959666 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769afd6-ac1b-4f46-aa10-200e0655b924 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:09.959971 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769afd6-ac1b-4f46-aa10-200e0655b924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:09.960241 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769afd6-ac1b-4f46-aa10-200e0655b924 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:09.960886 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769afd6-ac1b-4f46-aa10-200e0655b924 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:02:09.961185 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769afd6-ac1b-4f46-aa10-200e0655b924 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:09.962822 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769afd6-ac1b-4f46-aa10-200e0655b924 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:09.975461 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1453/2892] 10.222.0.52 () {58 vars in 1153 bytes} [Sun Aug 28 01:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:02:09.980188 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2594e-da1d-4b4a-aa50-899ffab3f316 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:09.990459 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2594e-da1d-4b4a-aa50-899ffab3f316 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:09.996006 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9432c2-f843-4211-96de-8a92f2fda02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:09.996597 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9432c2-f843-4211-96de-8a92f2fda02a admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:09.996874 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9432c2-f843-4211-96de-8a92f2fda02a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:09.997145 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9432c2-f843-4211-96de-8a92f2fda02a admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:09.997764 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9432c2-f843-4211-96de-8a92f2fda02a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:09.999710 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9432c2-f843-4211-96de-8a92f2fda02a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:10.004234 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:10.030105 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1440/2893] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:02:09 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:02:10.034249 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769afd6-ac1b-4f46-aa10-200e0655b924 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:10.044715 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769afd6-ac1b-4f46-aa10-200e0655b924 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:10.093263 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:10.110448 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bc4d1-63ef-4ff8-ac3a-4bd767ec09f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:10.111060 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bc4d1-63ef-4ff8-ac3a-4bd767ec09f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:10.111368 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bc4d1-63ef-4ff8-ac3a-4bd767ec09f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:10.111640 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bc4d1-63ef-4ff8-ac3a-4bd767ec09f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:10.112285 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34bc4d1-63ef-4ff8-ac3a-4bd767ec09f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:10.114244 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34bc4d1-63ef-4ff8-ac3a-4bd767ec09f8 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:10.137009 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1454/2894] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:02:10 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:02:10.143573 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9432c2-f843-4211-96de-8a92f2fda02a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:10.159832 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9432c2-f843-4211-96de-8a92f2fda02a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:10.167945 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b2b38-6ff3-4e29-9a00-8b1ea7fd884a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:10.168538 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b2b38-6ff3-4e29-9a00-8b1ea7fd884a admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:10.168818 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b2b38-6ff3-4e29-9a00-8b1ea7fd884a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:10.169087 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b2b38-6ff3-4e29-9a00-8b1ea7fd884a admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:10.169728 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b2b38-6ff3-4e29-9a00-8b1ea7fd884a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:10.171384 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b2b38-6ff3-4e29-9a00-8b1ea7fd884a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:10.181605 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1441/2895] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:02:10.185645 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bc4d1-63ef-4ff8-ac3a-4bd767ec09f8 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:10.196334 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bc4d1-63ef-4ff8-ac3a-4bd767ec09f8 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:10.202921 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ae8b9-f3c5-4e16-be6b-059b4774b890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:10.203630 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ae8b9-f3c5-4e16-be6b-059b4774b890 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:10.203998 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ae8b9-f3c5-4e16-be6b-059b4774b890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:10.204308 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ae8b9-f3c5-4e16-be6b-059b4774b890 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:10.205161 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ae8b9-f3c5-4e16-be6b-059b4774b890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:10.206923 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ae8b9-f3c5-4e16-be6b-059b4774b890 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:10.218999 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1455/2896] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:02:10.223407 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b2b38-6ff3-4e29-9a00-8b1ea7fd884a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:10.234600 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b2b38-6ff3-4e29-9a00-8b1ea7fd884a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:10.240433 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55042e-f1ff-424a-a685-f58e666d675e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:10.241079 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55042e-f1ff-424a-a685-f58e666d675e admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:10.241356 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55042e-f1ff-424a-a685-f58e666d675e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:10.241626 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55042e-f1ff-424a-a685-f58e666d675e admin admin] PATH_INFO: `/v3/projects/e4c4925f35cb482abd26c0efc1947756/users/7d679331201547f789ebc19a6715d1f8/roles/2231e998e50146f4b53b832f2f88c1c8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:10.258280 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55042e-f1ff-424a-a685-f58e666d675e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4c4925f35cb482abd26c0efc1947756, user_id=7d679331201547f789ebc19a6715d1f8, role_id=2231e998e50146f4b53b832f2f88c1c8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:10.261067 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55042e-f1ff-424a-a685-f58e666d675e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:10.276112 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1442/2897] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:02:10 2022] PUT /identity/v3/projects/e4c4925f35cb482abd26c0efc1947756/users/7d679331201547f789ebc19a6715d1f8/roles/2231e998e50146f4b53b832f2f88c1c8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:02:10.281368 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c606896-b884-4ece-af3d-afaeae3d2a2c None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:10.281657 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c606896-b884-4ece-af3d-afaeae3d2a2c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:10.282010 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c606896-b884-4ece-af3d-afaeae3d2a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:10.302141 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-8c606896-b884-4ece-af3d-afaeae3d2a2c None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:10.303379 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8c606896-b884-4ece-af3d-afaeae3d2a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:10.364292 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1456/2898] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:02:10.374491 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55042e-f1ff-424a-a685-f58e666d675e admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:10.380638 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4c55042e-f1ff-424a-a685-f58e666d675e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:10.440562 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55042e-f1ff-424a-a685-f58e666d675e admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:10.445093 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c0acc-c6a6-410e-8733-d929f4305492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:10.445708 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c0acc-c6a6-410e-8733-d929f4305492 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:10.446119 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c0acc-c6a6-410e-8733-d929f4305492 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:10.446442 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c0acc-c6a6-410e-8733-d929f4305492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:10.457405 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c0acc-c6a6-410e-8733-d929f4305492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:10.459118 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c0acc-c6a6-410e-8733-d929f4305492 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:10.469502 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1443/2899] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:02:11.652286 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f148d3-3064-41c2-b351-893bc12dfe09 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:11.653323 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f148d3-3064-41c2-b351-893bc12dfe09 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:11.653806 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f148d3-3064-41c2-b351-893bc12dfe09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:11.675377 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-55f148d3-3064-41c2-b351-893bc12dfe09 None None] MFA Rules not processed for user `ea556832341448239b867f33e7053ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:11.676599 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-55f148d3-3064-41c2-b351-893bc12dfe09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:11.765101 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1457/2900] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:02:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:14.782807 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc27d8-c8f9-409f-9c57-08e8009908b2 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:14.783304 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc27d8-c8f9-409f-9c57-08e8009908b2 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:14.783496 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc27d8-c8f9-409f-9c57-08e8009908b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:14.829768 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a1cc27d8-c8f9-409f-9c57-08e8009908b2 None None] MFA Rules not processed for user `7d679331201547f789ebc19a6715d1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:14.831199 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a1cc27d8-c8f9-409f-9c57-08e8009908b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:14.917244 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1444/2901] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:02:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:14.919094 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f148d3-3064-41c2-b351-893bc12dfe09 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:14.931136 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f148d3-3064-41c2-b351-893bc12dfe09 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:14.936133 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbea83-fdf1-4fc1-8b4c-b3f12cb98638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:14.936932 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbea83-fdf1-4fc1-8b4c-b3f12cb98638 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:14.937278 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbea83-fdf1-4fc1-8b4c-b3f12cb98638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:14.937618 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbea83-fdf1-4fc1-8b4c-b3f12cb98638 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:14.938392 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcbea83-fdf1-4fc1-8b4c-b3f12cb98638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:14.940523 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcbea83-fdf1-4fc1-8b4c-b3f12cb98638 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:14.979675 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1458/2902] 10.222.0.52 () {60 vars in 1153 bytes} [Sun Aug 28 01:02:14 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:02:14.984249 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc27d8-c8f9-409f-9c57-08e8009908b2 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:14.996589 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc27d8-c8f9-409f-9c57-08e8009908b2 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:15.047373 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:15.068030 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fe990-41d3-49b7-88fa-c74f7f823fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:15.068751 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fe990-41d3-49b7-88fa-c74f7f823fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:15.069095 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fe990-41d3-49b7-88fa-c74f7f823fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:15.069435 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fe990-41d3-49b7-88fa-c74f7f823fe1 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:15.070184 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fe990-41d3-49b7-88fa-c74f7f823fe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:15.072221 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fe990-41d3-49b7-88fa-c74f7f823fe1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:15.102794 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1445/2903] 10.222.0.52 () {60 vars in 1144 bytes} [Sun Aug 28 01:02:14 2022] POST /identity/v3/users => generated 298 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:02:15.106918 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbea83-fdf1-4fc1-8b4c-b3f12cb98638 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:15.119540 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbea83-fdf1-4fc1-8b4c-b3f12cb98638 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:15.125575 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d66965-4e53-4a5a-b936-5215f2be6ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:15.126800 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d66965-4e53-4a5a-b936-5215f2be6ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:15.127262 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d66965-4e53-4a5a-b936-5215f2be6ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:15.127954 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d66965-4e53-4a5a-b936-5215f2be6ea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:15.128758 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d66965-4e53-4a5a-b936-5215f2be6ea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:15.130544 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d66965-4e53-4a5a-b936-5215f2be6ea3 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:15.144752 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1459/2904] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:02:15.151555 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fe990-41d3-49b7-88fa-c74f7f823fe1 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:15.172683 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fe990-41d3-49b7-88fa-c74f7f823fe1 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:15.183533 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e46332-753f-48b6-9f97-aeb4c9e968f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:15.184920 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e46332-753f-48b6-9f97-aeb4c9e968f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:15.185305 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e46332-753f-48b6-9f97-aeb4c9e968f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:15.185688 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e46332-753f-48b6-9f97-aeb4c9e968f8 admin admin] PATH_INFO: `/v3/projects/6724b6f5953f4bb498c39c4f6e4188cf/users/d338f9266789478a8ad25c357d4663e1/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:15.205375 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e46332-753f-48b6-9f97-aeb4c9e968f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6724b6f5953f4bb498c39c4f6e4188cf, user_id=d338f9266789478a8ad25c357d4663e1, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:15.209328 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e46332-753f-48b6-9f97-aeb4c9e968f8 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:15.226566 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1446/2905] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:02:15 2022] PUT /identity/v3/projects/6724b6f5953f4bb498c39c4f6e4188cf/users/d338f9266789478a8ad25c357d4663e1/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:02:15.231169 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d66965-4e53-4a5a-b936-5215f2be6ea3 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:15.244269 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d66965-4e53-4a5a-b936-5215f2be6ea3 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:15.295230 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:15.328648 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23baa8-0509-4f87-838e-471e46d7513e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:15.329273 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23baa8-0509-4f87-838e-471e46d7513e admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:15.329556 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23baa8-0509-4f87-838e-471e46d7513e admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:15.329830 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23baa8-0509-4f87-838e-471e46d7513e admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:15.331666 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23baa8-0509-4f87-838e-471e46d7513e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:15.333539 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23baa8-0509-4f87-838e-471e46d7513e admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:15.345219 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1460/2906] 10.222.0.52 () {58 vars in 1122 bytes} [Sun Aug 28 01:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:02:15.349392 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e46332-753f-48b6-9f97-aeb4c9e968f8 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:15.360995 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e46332-753f-48b6-9f97-aeb4c9e968f8 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:15.366283 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76f3dc-8127-4de0-930b-9c725ffd25a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:15.366951 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76f3dc-8127-4de0-930b-9c725ffd25a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:15.367232 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76f3dc-8127-4de0-930b-9c725ffd25a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:15.367503 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76f3dc-8127-4de0-930b-9c725ffd25a9 admin admin] PATH_INFO: `/v3/projects/6724b6f5953f4bb498c39c4f6e4188cf/users/d338f9266789478a8ad25c357d4663e1/roles/cc013581bb07418d9ec6a3a1d282ea53` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:15.369446 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76f3dc-8127-4de0-930b-9c725ffd25a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6724b6f5953f4bb498c39c4f6e4188cf, user_id=d338f9266789478a8ad25c357d4663e1, role_id=cc013581bb07418d9ec6a3a1d282ea53)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:15.373131 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76f3dc-8127-4de0-930b-9c725ffd25a9 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:15.385506 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1447/2907] 10.222.0.52 () {60 vars in 1483 bytes} [Sun Aug 28 01:02:15 2022] PUT /identity/v3/projects/6724b6f5953f4bb498c39c4f6e4188cf/users/d338f9266789478a8ad25c357d4663e1/roles/cc013581bb07418d9ec6a3a1d282ea53 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:02:20.171890 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca038f2b-8b75-459e-ab0d-6323c342360d None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:20.172362 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca038f2b-8b75-459e-ab0d-6323c342360d None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:20.172627 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca038f2b-8b75-459e-ab0d-6323c342360d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:20.213547 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-ca038f2b-8b75-459e-ab0d-6323c342360d None None] MFA Rules not processed for user `d338f9266789478a8ad25c357d4663e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:20.214995 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ca038f2b-8b75-459e-ab0d-6323c342360d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:20.317408 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1461/2908] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:02:20 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:20.327556 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76f3dc-8127-4de0-930b-9c725ffd25a9 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:20.330045 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4f76f3dc-8127-4de0-930b-9c725ffd25a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:20.413388 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76f3dc-8127-4de0-930b-9c725ffd25a9 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:20.417056 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d494312-d479-465e-ad3c-ab297d7d9d11 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34fd9f7932e14a409d7668d40ff6680e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:20.417884 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d494312-d479-465e-ad3c-ab297d7d9d11 service glance] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:20.418462 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d494312-d479-465e-ad3c-ab297d7d9d11 service glance] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:20.418823 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d494312-d479-465e-ad3c-ab297d7d9d11 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:20.510393 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d494312-d479-465e-ad3c-ab297d7d9d11 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:20.511639 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d494312-d479-465e-ad3c-ab297d7d9d11 service glance] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:20.521162 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1448/2909] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:02:20.651502 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f126213-7b94-4e1c-9309-1b0baa06bc7b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:20.651910 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f126213-7b94-4e1c-9309-1b0baa06bc7b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:20.652423 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f126213-7b94-4e1c-9309-1b0baa06bc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:20.674621 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-9f126213-7b94-4e1c-9309-1b0baa06bc7b None None] MFA Rules not processed for user `3302fdf33b5b4583a10e7c760c577cda`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:20.675883 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9f126213-7b94-4e1c-9309-1b0baa06bc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:20.735103 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1462/2910] 10.222.0.52 () {58 vars in 1009 bytes} [Sun Aug 28 01:02:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:20.748516 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d494312-d479-465e-ad3c-ab297d7d9d11 service glance] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:20.749991 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9d494312-d479-465e-ad3c-ab297d7d9d11 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:20.815546 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:20.843555 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d494312-d479-465e-ad3c-ab297d7d9d11 service glance] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:20.848919 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a711e-8cc8-4ca6-9312-a0234106f4fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80a6019cf424c16a1d461a632cf8568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:20.849548 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a711e-8cc8-4ca6-9312-a0234106f4fc service swift] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:20.849826 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a711e-8cc8-4ca6-9312-a0234106f4fc service swift] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:20.850124 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a711e-8cc8-4ca6-9312-a0234106f4fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:20.859164 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a711e-8cc8-4ca6-9312-a0234106f4fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:20.860904 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a711e-8cc8-4ca6-9312-a0234106f4fc service swift] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:20.869378 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1449/2911] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Aug 28 01:02:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:02:26.016266 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756319b-f6cc-4f44-a55d-d4dcb070e2cd None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:26.016774 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756319b-f6cc-4f44-a55d-d4dcb070e2cd None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:26.016861 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756319b-f6cc-4f44-a55d-d4dcb070e2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:26.041393 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-d756319b-f6cc-4f44-a55d-d4dcb070e2cd None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:26.042897 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d756319b-f6cc-4f44-a55d-d4dcb070e2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:26.117696 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1463/2912] 10.222.0.62 () {58 vars in 1016 bytes} [Sun Aug 28 01:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:26.139119 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a711e-8cc8-4ca6-9312-a0234106f4fc service swift] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:26.140748 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3d7a711e-8cc8-4ca6-9312-a0234106f4fc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:26.240909 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a711e-8cc8-4ca6-9312-a0234106f4fc service swift] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:26.246978 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496618f-000b-4cdc-9b88-f429bd425a0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:26.247630 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496618f-000b-4cdc-9b88-f429bd425a0b service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:26.247889 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496618f-000b-4cdc-9b88-f429bd425a0b service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:26.248159 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496618f-000b-4cdc-9b88-f429bd425a0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:26.266050 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496618f-000b-4cdc-9b88-f429bd425a0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:26.267650 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496618f-000b-4cdc-9b88-f429bd425a0b service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:26.278901 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1450/2913] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:02:29.350520 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2cd31-50dd-4f5b-8744-4fe316f00ede None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:29.351064 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2cd31-50dd-4f5b-8744-4fe316f00ede None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:29.351064 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2cd31-50dd-4f5b-8744-4fe316f00ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:29.360128 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:29.371959 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-a0e2cd31-50dd-4f5b-8744-4fe316f00ede None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:29.373270 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a0e2cd31-50dd-4f5b-8744-4fe316f00ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:29.381613 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1464/2914] 10.222.0.62 () {58 vars in 1016 bytes} [Sun Aug 28 01:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:29.403192 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496618f-000b-4cdc-9b88-f429bd425a0b service nova] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:29.404756 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9496618f-000b-4cdc-9b88-f429bd425a0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:29.421282 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496618f-000b-4cdc-9b88-f429bd425a0b service nova] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:29.427404 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8fc420-93c8-4eaa-bf80-dd7e00a26bab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:29.428239 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fc420-93c8-4eaa-bf80-dd7e00a26bab service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:29.428701 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fc420-93c8-4eaa-bf80-dd7e00a26bab service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:29.429171 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fc420-93c8-4eaa-bf80-dd7e00a26bab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:29.438916 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8fc420-93c8-4eaa-bf80-dd7e00a26bab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:29.440654 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8fc420-93c8-4eaa-bf80-dd7e00a26bab service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:29.451799 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1451/2915] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:02:29.641254 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc6ee6-032d-4d48-b939-34c6bb177879 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:29.641610 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc6ee6-032d-4d48-b939-34c6bb177879 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:29.642024 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc6ee6-032d-4d48-b939-34c6bb177879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:29.667808 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-b0fc6ee6-032d-4d48-b939-34c6bb177879 None None] MFA Rules not processed for user `7d679331201547f789ebc19a6715d1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:29.669075 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b0fc6ee6-032d-4d48-b939-34c6bb177879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:29.677082 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1465/2916] 10.222.0.52 () {58 vars in 958 bytes} [Sun Aug 28 01:02:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:31.734119 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ae35e-6399-41dc-9680-71e51fde0b25 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:31.734655 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ae35e-6399-41dc-9680-71e51fde0b25 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:31.734655 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ae35e-6399-41dc-9680-71e51fde0b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:31.754748 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f62ae35e-6399-41dc-9680-71e51fde0b25 None None] MFA Rules not processed for user `3302fdf33b5b4583a10e7c760c577cda`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:31.755966 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f62ae35e-6399-41dc-9680-71e51fde0b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:31.764447 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1452/2917] 10.222.0.52 () {58 vars in 1009 bytes} [Sun Aug 28 01:02:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:31.777290 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc6ee6-032d-4d48-b939-34c6bb177879 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:31.789944 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc6ee6-032d-4d48-b939-34c6bb177879 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:31.795278 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2997d2a-aa29-435c-8129-9911c7829458 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80a6019cf424c16a1d461a632cf8568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:31.795917 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2997d2a-aa29-435c-8129-9911c7829458 service swift] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:31.796194 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2997d2a-aa29-435c-8129-9911c7829458 service swift] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:31.796465 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2997d2a-aa29-435c-8129-9911c7829458 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:31.804639 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2997d2a-aa29-435c-8129-9911c7829458 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:31.806292 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2997d2a-aa29-435c-8129-9911c7829458 service swift] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:31.814903 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1466/2918] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Aug 28 01:02:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:02:32.503032 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a46543-ad5d-4e9a-ab80-0ac4ef5ab73f None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:32.503333 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a46543-ad5d-4e9a-ab80-0ac4ef5ab73f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:32.503592 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a46543-ad5d-4e9a-ab80-0ac4ef5ab73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:32.547090 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-27a46543-ad5d-4e9a-ab80-0ac4ef5ab73f None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:32.548361 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-27a46543-ad5d-4e9a-ab80-0ac4ef5ab73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:32.569146 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1453/2919] 10.222.0.62 () {58 vars in 1016 bytes} [Sun Aug 28 01:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:32.607005 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2997d2a-aa29-435c-8129-9911c7829458 service swift] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:32.626508 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2997d2a-aa29-435c-8129-9911c7829458 service swift] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:32.638834 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db59fa-7243-45a9-af24-9269ed995299 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:32.640898 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db59fa-7243-45a9-af24-9269ed995299 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:32.642671 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db59fa-7243-45a9-af24-9269ed995299 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:32.643464 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db59fa-7243-45a9-af24-9269ed995299 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:32.659608 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db59fa-7243-45a9-af24-9269ed995299 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:32.661420 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db59fa-7243-45a9-af24-9269ed995299 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:32.681375 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1467/2920] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:02:42.533290 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=56 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:42.669103 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=16 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:42.867962 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb60ae-26aa-4430-9fdc-df5a2363f11b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:42.868244 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb60ae-26aa-4430-9fdc-df5a2363f11b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:42.868540 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb60ae-26aa-4430-9fdc-df5a2363f11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:42.889580 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-12cb60ae-26aa-4430-9fdc-df5a2363f11b None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:42.890913 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-12cb60ae-26aa-4430-9fdc-df5a2363f11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:42.899967 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1454/2921] 10.222.0.62 () {58 vars in 1016 bytes} [Sun Aug 28 01:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:42.920648 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db59fa-7243-45a9-af24-9269ed995299 service nova] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:42.934110 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db59fa-7243-45a9-af24-9269ed995299 service nova] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:42.940008 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037aae54-7165-4ee4-8402-9c369b919218 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:42.940636 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037aae54-7165-4ee4-8402-9c369b919218 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:42.941362 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037aae54-7165-4ee4-8402-9c369b919218 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:42.941362 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037aae54-7165-4ee4-8402-9c369b919218 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:42.950791 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037aae54-7165-4ee4-8402-9c369b919218 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:42.952533 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037aae54-7165-4ee4-8402-9c369b919218 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:42.962798 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1468/2922] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:02:46.049110 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bde5ac-6bc5-45e9-a67c-3d404b36066d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:46.049643 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bde5ac-6bc5-45e9-a67c-3d404b36066d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:46.049643 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bde5ac-6bc5-45e9-a67c-3d404b36066d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:46.133326 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-72bde5ac-6bc5-45e9-a67c-3d404b36066d None None] MFA Rules not processed for user `f0ea7ade0fdf4b01bc4d2a18f09385cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:46.134477 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-72bde5ac-6bc5-45e9-a67c-3d404b36066d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:46.195189 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1455/2923] 10.222.0.62 () {58 vars in 1016 bytes} [Sun Aug 28 01:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:46.218111 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037aae54-7165-4ee4-8402-9c369b919218 service nova] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:46.289775 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037aae54-7165-4ee4-8402-9c369b919218 service nova] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:46.297219 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba05799-c26c-4539-9be3-c8133b3aaaba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f890ff4e7807477db7f17c2f6434dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:46.297911 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba05799-c26c-4539-9be3-c8133b3aaaba service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:46.298144 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba05799-c26c-4539-9be3-c8133b3aaaba service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:46.298423 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba05799-c26c-4539-9be3-c8133b3aaaba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:46.307812 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba05799-c26c-4539-9be3-c8133b3aaaba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:46.309745 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba05799-c26c-4539-9be3-c8133b3aaaba service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:46.319449 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1469/2924] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:02:56.192890 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=48 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:56.315037 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=36 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:56.738261 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bde5ac-6bc5-45e9-a67c-3d404b36066d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:56.802259 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bde5ac-6bc5-45e9-a67c-3d404b36066d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:56.806532 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182d8a2-8ba2-4419-8bc7-935cb0bd8912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:56.807247 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182d8a2-8ba2-4419-8bc7-935cb0bd8912 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:56.807759 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182d8a2-8ba2-4419-8bc7-935cb0bd8912 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:56.808194 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182d8a2-8ba2-4419-8bc7-935cb0bd8912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:56.818567 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182d8a2-8ba2-4419-8bc7-935cb0bd8912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:56.820025 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182d8a2-8ba2-4419-8bc7-935cb0bd8912 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:56.830341 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1456/2925] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:06.825830 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=26 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:15.819518 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba05799-c26c-4539-9be3-c8133b3aaaba service nova] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:15.821081 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-eba05799-c26c-4539-9be3-c8133b3aaaba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:15.892368 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182d8a2-8ba2-4419-8bc7-935cb0bd8912 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:15.894280 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3182d8a2-8ba2-4419-8bc7-935cb0bd8912 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:15.912368 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182d8a2-8ba2-4419-8bc7-935cb0bd8912 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:15.918041 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9655c5-196a-4c61-ac0c-21023782875d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:15.918962 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9655c5-196a-4c61-ac0c-21023782875d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:15.919096 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9655c5-196a-4c61-ac0c-21023782875d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:15.919390 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9655c5-196a-4c61-ac0c-21023782875d admin admin] PATH_INFO: `/v3/users/ea556832341448239b867f33e7053ef6` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:15.921227 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9655c5-196a-4c61-ac0c-21023782875d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea556832341448239b867f33e7053ef6)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:15.924246 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9655c5-196a-4c61-ac0c-21023782875d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:15.933912 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba05799-c26c-4539-9be3-c8133b3aaaba service nova] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:15.939464 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c9f1a-4fba-4a61-b9c1-ea20a079c221 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae87149f6ab04a9997263598737ae27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:15.940078 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c9f1a-4fba-4a61-b9c1-ea20a079c221 service placement] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:15.940361 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c9f1a-4fba-4a61-b9c1-ea20a079c221 service placement] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:15.940634 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c9f1a-4fba-4a61-b9c1-ea20a079c221 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:15.942473 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-7d7c9f1a-4fba-4a61-b9c1-ea20a079c221 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:15.955595 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c9f1a-4fba-4a61-b9c1-ea20a079c221 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:15.957410 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c9f1a-4fba-4a61-b9c1-ea20a079c221 service placement] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:15.968912 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1470/2926] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:15.984536 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4d9655c5-196a-4c61-ac0c-21023782875d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea556832341448239b867f33e7053ef6'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:16.004449 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4d9655c5-196a-4c61-ac0c-21023782875d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea556832341448239b867f33e7053ef6'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:16.012822 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4d9655c5-196a-4c61-ac0c-21023782875d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea556832341448239b867f33e7053ef6'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:16.020912 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4d9655c5-196a-4c61-ac0c-21023782875d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea556832341448239b867f33e7053ef6'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:16.021520 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4d9655c5-196a-4c61-ac0c-21023782875d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea556832341448239b867f33e7053ef6'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:16.028062 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1457/2927] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:03:15 2022] DELETE /identity/v3/users/ea556832341448239b867f33e7053ef6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:03:16.219869 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c9f1a-4fba-4a61-b9c1-ea20a079c221 service placement] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:16.231092 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c9f1a-4fba-4a61-b9c1-ea20a079c221 service placement] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:16.344815 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef44d7-883f-45d4-a5a0-8e06df7235fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:16.345404 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef44d7-883f-45d4-a5a0-8e06df7235fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:16.345690 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef44d7-883f-45d4-a5a0-8e06df7235fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:16.346029 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef44d7-883f-45d4-a5a0-8e06df7235fd admin admin] PATH_INFO: `/v3/projects/fb2585e83e3b491e9778b7a05784cf1a` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:16.347271 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef44d7-883f-45d4-a5a0-8e06df7235fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb2585e83e3b491e9778b7a05784cf1a)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:16.349197 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef44d7-883f-45d4-a5a0-8e06df7235fd admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:16.398341 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-aeef44d7-883f-45d4-a5a0-8e06df7235fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb2585e83e3b491e9778b7a05784cf1a', 'request_id': 'req-aeef44d7-883f-45d4-a5a0-8e06df7235fd'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:16.406312 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-aeef44d7-883f-45d4-a5a0-8e06df7235fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb2585e83e3b491e9778b7a05784cf1a', 'request_id': 'req-aeef44d7-883f-45d4-a5a0-8e06df7235fd'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:16.412553 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-aeef44d7-883f-45d4-a5a0-8e06df7235fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb2585e83e3b491e9778b7a05784cf1a', 'request_id': 'req-aeef44d7-883f-45d4-a5a0-8e06df7235fd'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:16.420236 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:16.424820 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-aeef44d7-883f-45d4-a5a0-8e06df7235fd admin admin] The token cache is being invalidate because project fb2585e83e3b491e9778b7a05784cf1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:03:16.425267 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-aeef44d7-883f-45d4-a5a0-8e06df7235fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:16.426606 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-aeef44d7-883f-45d4-a5a0-8e06df7235fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:16.428389 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1471/2928] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:03:16 2022] DELETE /identity/v3/projects/fb2585e83e3b491e9778b7a05784cf1a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:03:26.024595 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:46.878203 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9655c5-196a-4c61-ac0c-21023782875d admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:46.879771 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4d9655c5-196a-4c61-ac0c-21023782875d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:46.962464 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9655c5-196a-4c61-ac0c-21023782875d admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:47.021542 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33886a-b5d3-4746-9c13-2a80979454e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae87149f6ab04a9997263598737ae27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:47.022174 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33886a-b5d3-4746-9c13-2a80979454e1 service placement] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:47.022447 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33886a-b5d3-4746-9c13-2a80979454e1 service placement] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:47.022708 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33886a-b5d3-4746-9c13-2a80979454e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:47.024593 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3e33886a-b5d3-4746-9c13-2a80979454e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:47.035823 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33886a-b5d3-4746-9c13-2a80979454e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:47.037438 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33886a-b5d3-4746-9c13-2a80979454e1 service placement] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:47.047644 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1458/2929] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:57.043352 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=58 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:18.873669 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf0262-8ef1-48ea-8d34-e93d1219a7c9 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:18.874209 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf0262-8ef1-48ea-8d34-e93d1219a7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:18.874312 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf0262-8ef1-48ea-8d34-e93d1219a7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:18.903781 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-43bf0262-8ef1-48ea-8d34-e93d1219a7c9 None None] MFA Rules not processed for user `3302fdf33b5b4583a10e7c760c577cda`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:04:18.905050 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-43bf0262-8ef1-48ea-8d34-e93d1219a7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:18.962737 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1472/2930] 10.222.0.52 () {58 vars in 967 bytes} [Sun Aug 28 01:04:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:04:19.010973 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33886a-b5d3-4746-9c13-2a80979454e1 service placement] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:19.012728 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3e33886a-b5d3-4746-9c13-2a80979454e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:19.094599 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33886a-b5d3-4746-9c13-2a80979454e1 service placement] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:19.100218 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99815775-d8ea-47b1-a228-9594bdbb16a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80a6019cf424c16a1d461a632cf8568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:19.100849 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99815775-d8ea-47b1-a228-9594bdbb16a8 service swift] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:19.101156 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99815775-d8ea-47b1-a228-9594bdbb16a8 service swift] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:19.101451 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99815775-d8ea-47b1-a228-9594bdbb16a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:19.110717 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99815775-d8ea-47b1-a228-9594bdbb16a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:19.112402 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99815775-d8ea-47b1-a228-9594bdbb16a8 service swift] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:19.120964 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1459/2931] 10.222.0.52 () {60 vars in 1384 bytes} [Sun Aug 28 01:04:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:04:25.773587 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf0262-8ef1-48ea-8d34-e93d1219a7c9 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:25.776412 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-43bf0262-8ef1-48ea-8d34-e93d1219a7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:25.855284 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf0262-8ef1-48ea-8d34-e93d1219a7c9 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:25.859916 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39471194-d62d-45d8-99f8-3ca2da9bcaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:25.860867 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39471194-d62d-45d8-99f8-3ca2da9bcaaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:25.861142 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39471194-d62d-45d8-99f8-3ca2da9bcaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:25.861480 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39471194-d62d-45d8-99f8-3ca2da9bcaaa admin admin] PATH_INFO: `/v3/users/7d679331201547f789ebc19a6715d1f8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:25.862655 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39471194-d62d-45d8-99f8-3ca2da9bcaaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d679331201547f789ebc19a6715d1f8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:25.864594 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39471194-d62d-45d8-99f8-3ca2da9bcaaa admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:25.914595 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-39471194-d62d-45d8-99f8-3ca2da9bcaaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d679331201547f789ebc19a6715d1f8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:25.921654 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-39471194-d62d-45d8-99f8-3ca2da9bcaaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d679331201547f789ebc19a6715d1f8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:25.930179 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-39471194-d62d-45d8-99f8-3ca2da9bcaaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d679331201547f789ebc19a6715d1f8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:25.942669 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-39471194-d62d-45d8-99f8-3ca2da9bcaaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d679331201547f789ebc19a6715d1f8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:25.943304 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-39471194-d62d-45d8-99f8-3ca2da9bcaaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d679331201547f789ebc19a6715d1f8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:25.949373 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1473/2932] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:04:25 2022] DELETE /identity/v3/users/7d679331201547f789ebc19a6715d1f8 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:04:26.132662 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99815775-d8ea-47b1-a228-9594bdbb16a8 service swift] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:26.145880 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99815775-d8ea-47b1-a228-9594bdbb16a8 service swift] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:26.203839 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b21dfb-fe27-4b82-9b1b-66ab22546941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:26.204509 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b21dfb-fe27-4b82-9b1b-66ab22546941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:26.204809 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b21dfb-fe27-4b82-9b1b-66ab22546941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:26.205106 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b21dfb-fe27-4b82-9b1b-66ab22546941 admin admin] PATH_INFO: `/v3/projects/e4c4925f35cb482abd26c0efc1947756` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:26.206382 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b21dfb-fe27-4b82-9b1b-66ab22546941 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4c4925f35cb482abd26c0efc1947756)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:26.208416 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b21dfb-fe27-4b82-9b1b-66ab22546941 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:26.258007 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f0b21dfb-fe27-4b82-9b1b-66ab22546941 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4c4925f35cb482abd26c0efc1947756', 'request_id': 'req-f0b21dfb-fe27-4b82-9b1b-66ab22546941'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:26.263194 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f0b21dfb-fe27-4b82-9b1b-66ab22546941 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4c4925f35cb482abd26c0efc1947756', 'request_id': 'req-f0b21dfb-fe27-4b82-9b1b-66ab22546941'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:26.269170 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f0b21dfb-fe27-4b82-9b1b-66ab22546941 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4c4925f35cb482abd26c0efc1947756', 'request_id': 'req-f0b21dfb-fe27-4b82-9b1b-66ab22546941'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:26.287683 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f0b21dfb-fe27-4b82-9b1b-66ab22546941 admin admin] The token cache is being invalidate because project e4c4925f35cb482abd26c0efc1947756 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:04:26.287988 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f0b21dfb-fe27-4b82-9b1b-66ab22546941 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:26.288673 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f0b21dfb-fe27-4b82-9b1b-66ab22546941 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:26.290300 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1460/2933] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:04:26 2022] DELETE /identity/v3/projects/e4c4925f35cb482abd26c0efc1947756 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:04:26.294868 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39471194-d62d-45d8-99f8-3ca2da9bcaaa admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:26.296473 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-39471194-d62d-45d8-99f8-3ca2da9bcaaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:26.310630 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39471194-d62d-45d8-99f8-3ca2da9bcaaa admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:26.322907 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:26.372337 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183f9bd-0d39-40b6-a5ae-340fc0057fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:26.372970 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183f9bd-0d39-40b6-a5ae-340fc0057fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:26.373290 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183f9bd-0d39-40b6-a5ae-340fc0057fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:26.373565 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183f9bd-0d39-40b6-a5ae-340fc0057fce admin admin] PATH_INFO: `/v3/users/d338f9266789478a8ad25c357d4663e1` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:26.374880 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183f9bd-0d39-40b6-a5ae-340fc0057fce admin admin] RBAC: Authorizing `identity:delete_user(user_id=d338f9266789478a8ad25c357d4663e1)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:26.376849 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183f9bd-0d39-40b6-a5ae-340fc0057fce admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:26.427445 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f183f9bd-0d39-40b6-a5ae-340fc0057fce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd338f9266789478a8ad25c357d4663e1'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:26.434538 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f183f9bd-0d39-40b6-a5ae-340fc0057fce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd338f9266789478a8ad25c357d4663e1'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:26.443805 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f183f9bd-0d39-40b6-a5ae-340fc0057fce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd338f9266789478a8ad25c357d4663e1'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:26.456770 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f183f9bd-0d39-40b6-a5ae-340fc0057fce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd338f9266789478a8ad25c357d4663e1'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:26.457760 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f183f9bd-0d39-40b6-a5ae-340fc0057fce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd338f9266789478a8ad25c357d4663e1'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:26.467324 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1474/2934] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:04:26 2022] DELETE /identity/v3/users/d338f9266789478a8ad25c357d4663e1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:04:26.649856 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b21dfb-fe27-4b82-9b1b-66ab22546941 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:26.651465 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f0b21dfb-fe27-4b82-9b1b-66ab22546941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:26.664962 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b21dfb-fe27-4b82-9b1b-66ab22546941 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:26.691524 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:26.739375 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaeb85d-0360-4150-a10b-d354bb9996d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:26.740202 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaeb85d-0360-4150-a10b-d354bb9996d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:26.740574 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaeb85d-0360-4150-a10b-d354bb9996d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:26.740929 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaeb85d-0360-4150-a10b-d354bb9996d6 admin admin] PATH_INFO: `/v3/projects/6724b6f5953f4bb498c39c4f6e4188cf` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:26.742714 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaeb85d-0360-4150-a10b-d354bb9996d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6724b6f5953f4bb498c39c4f6e4188cf)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:26.745597 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaeb85d-0360-4150-a10b-d354bb9996d6 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:26.808698 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-abaeb85d-0360-4150-a10b-d354bb9996d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6724b6f5953f4bb498c39c4f6e4188cf', 'request_id': 'req-abaeb85d-0360-4150-a10b-d354bb9996d6'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:26.814385 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-abaeb85d-0360-4150-a10b-d354bb9996d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6724b6f5953f4bb498c39c4f6e4188cf', 'request_id': 'req-abaeb85d-0360-4150-a10b-d354bb9996d6'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:26.820563 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-abaeb85d-0360-4150-a10b-d354bb9996d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6724b6f5953f4bb498c39c4f6e4188cf', 'request_id': 'req-abaeb85d-0360-4150-a10b-d354bb9996d6'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:26.833498 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-abaeb85d-0360-4150-a10b-d354bb9996d6 admin admin] The token cache is being invalidate because project 6724b6f5953f4bb498c39c4f6e4188cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:04:26.833782 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-abaeb85d-0360-4150-a10b-d354bb9996d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:26.834427 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-abaeb85d-0360-4150-a10b-d354bb9996d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:26.835925 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1461/2935] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:04:26 2022] DELETE /identity/v3/projects/6724b6f5953f4bb498c39c4f6e4188cf => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:04:36.461666 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=46,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:36.830927 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:11.620520 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183f9bd-0d39-40b6-a5ae-340fc0057fce admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:11.622036 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f183f9bd-0d39-40b6-a5ae-340fc0057fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:11.721002 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183f9bd-0d39-40b6-a5ae-340fc0057fce admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:11.734120 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaeb85d-0360-4150-a10b-d354bb9996d6 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:11.736529 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-abaeb85d-0360-4150-a10b-d354bb9996d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:11.779487 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286d229-c953-4c6c-8857-25549b7f46a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:11.780105 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286d229-c953-4c6c-8857-25549b7f46a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:11.780382 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286d229-c953-4c6c-8857-25549b7f46a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:11.780653 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286d229-c953-4c6c-8857-25549b7f46a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:11.782644 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-0286d229-c953-4c6c-8857-25549b7f46a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:11.795009 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286d229-c953-4c6c-8857-25549b7f46a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:11.796460 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286d229-c953-4c6c-8857-25549b7f46a9 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:11.803975 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaeb85d-0360-4150-a10b-d354bb9996d6 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:11.808191 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1475/2936] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:05:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:05:11.810063 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa27f9b-9b2d-434e-8f19-b7792eada8f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:11.810879 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa27f9b-9b2d-434e-8f19-b7792eada8f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:11.811334 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa27f9b-9b2d-434e-8f19-b7792eada8f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:11.811785 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa27f9b-9b2d-434e-8f19-b7792eada8f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:11.813769 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bfa27f9b-9b2d-434e-8f19-b7792eada8f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:11.900831 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa27f9b-9b2d-434e-8f19-b7792eada8f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:11.902407 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa27f9b-9b2d-434e-8f19-b7792eada8f8 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:11.913202 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1462/2937] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:05:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:05:13.096582 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286d229-c953-4c6c-8857-25549b7f46a9 service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:13.098239 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-0286d229-c953-4c6c-8857-25549b7f46a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:13.113055 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286d229-c953-4c6c-8857-25549b7f46a9 service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:13.118570 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e7453-d1ef-4491-bccd-99f0a337cf10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94d8693c64e388bd0d15db07f5fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:13.119110 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e7453-d1ef-4491-bccd-99f0a337cf10 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:13.119388 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e7453-d1ef-4491-bccd-99f0a337cf10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:13.119673 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e7453-d1ef-4491-bccd-99f0a337cf10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:13.121702 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8a1e7453-d1ef-4491-bccd-99f0a337cf10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:13.137040 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e7453-d1ef-4491-bccd-99f0a337cf10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:13.139707 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e7453-d1ef-4491-bccd-99f0a337cf10 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:13.153395 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1476/2938] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:05:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:05:21.906245 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa27f9b-9b2d-434e-8f19-b7792eada8f8 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:21.907850 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bfa27f9b-9b2d-434e-8f19-b7792eada8f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:21.908674 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=59 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:21.979252 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa27f9b-9b2d-434e-8f19-b7792eada8f8 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:21.985533 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2899400-66e5-442e-a4a4-d0f1ae561d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:21.986189 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2899400-66e5-442e-a4a4-d0f1ae561d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:21.986463 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2899400-66e5-442e-a4a4-d0f1ae561d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:21.986760 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2899400-66e5-442e-a4a4-d0f1ae561d7e admin admin] PATH_INFO: `/v3/users/d9e0ee03c3d440049eb1ac9dc3fbe02d` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:21.988065 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2899400-66e5-442e-a4a4-d0f1ae561d7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9e0ee03c3d440049eb1ac9dc3fbe02d)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:21.990091 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2899400-66e5-442e-a4a4-d0f1ae561d7e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:22.040112 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a2899400-66e5-442e-a4a4-d0f1ae561d7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9e0ee03c3d440049eb1ac9dc3fbe02d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:22.052205 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a2899400-66e5-442e-a4a4-d0f1ae561d7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9e0ee03c3d440049eb1ac9dc3fbe02d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:22.059373 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a2899400-66e5-442e-a4a4-d0f1ae561d7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9e0ee03c3d440049eb1ac9dc3fbe02d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:22.068574 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a2899400-66e5-442e-a4a4-d0f1ae561d7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9e0ee03c3d440049eb1ac9dc3fbe02d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:22.069200 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a2899400-66e5-442e-a4a4-d0f1ae561d7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9e0ee03c3d440049eb1ac9dc3fbe02d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:22.077189 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1463/2939] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:05:21 2022] DELETE /identity/v3/users/d9e0ee03c3d440049eb1ac9dc3fbe02d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:05:22.273209 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e7453-d1ef-4491-bccd-99f0a337cf10 service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:22.284452 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e7453-d1ef-4491-bccd-99f0a337cf10 service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:22.344721 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbfecf-13b0-4be3-b3a2-65d4cb5ddbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:22.345376 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbfecf-13b0-4be3-b3a2-65d4cb5ddbc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:22.345690 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbfecf-13b0-4be3-b3a2-65d4cb5ddbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:22.345986 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbfecf-13b0-4be3-b3a2-65d4cb5ddbc6 admin admin] PATH_INFO: `/v3/projects/afa739fb80584c4d9e99404bd102d512` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:22.347147 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cbfecf-13b0-4be3-b3a2-65d4cb5ddbc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afa739fb80584c4d9e99404bd102d512)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:22.349047 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cbfecf-13b0-4be3-b3a2-65d4cb5ddbc6 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:22.383738 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:22.405855 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-92cbfecf-13b0-4be3-b3a2-65d4cb5ddbc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afa739fb80584c4d9e99404bd102d512', 'request_id': 'req-92cbfecf-13b0-4be3-b3a2-65d4cb5ddbc6'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:22.415079 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-92cbfecf-13b0-4be3-b3a2-65d4cb5ddbc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afa739fb80584c4d9e99404bd102d512', 'request_id': 'req-92cbfecf-13b0-4be3-b3a2-65d4cb5ddbc6'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:22.421910 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-92cbfecf-13b0-4be3-b3a2-65d4cb5ddbc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afa739fb80584c4d9e99404bd102d512', 'request_id': 'req-92cbfecf-13b0-4be3-b3a2-65d4cb5ddbc6'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:22.434087 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-92cbfecf-13b0-4be3-b3a2-65d4cb5ddbc6 admin admin] The token cache is being invalidate because project afa739fb80584c4d9e99404bd102d512 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:05:22.434379 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-92cbfecf-13b0-4be3-b3a2-65d4cb5ddbc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:22.435120 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-92cbfecf-13b0-4be3-b3a2-65d4cb5ddbc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:22.436770 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1477/2940] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:05:22 2022] DELETE /identity/v3/projects/afa739fb80584c4d9e99404bd102d512 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:05:22.441024 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2899400-66e5-442e-a4a4-d0f1ae561d7e admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:22.442599 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a2899400-66e5-442e-a4a4-d0f1ae561d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:22.457126 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2899400-66e5-442e-a4a4-d0f1ae561d7e admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:22.517454 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3734eff-372f-4b0f-93bb-c852df62fbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:22.518009 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3734eff-372f-4b0f-93bb-c852df62fbbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:22.518287 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3734eff-372f-4b0f-93bb-c852df62fbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:22.518549 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3734eff-372f-4b0f-93bb-c852df62fbbe admin admin] PATH_INFO: `/v3/users/352335baa500425399e907313dba6209` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:22.519696 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3734eff-372f-4b0f-93bb-c852df62fbbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=352335baa500425399e907313dba6209)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:22.521633 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3734eff-372f-4b0f-93bb-c852df62fbbe admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:22.544297 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:22.571008 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f3734eff-372f-4b0f-93bb-c852df62fbbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '352335baa500425399e907313dba6209'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:22.583568 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f3734eff-372f-4b0f-93bb-c852df62fbbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '352335baa500425399e907313dba6209'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:22.591515 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f3734eff-372f-4b0f-93bb-c852df62fbbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '352335baa500425399e907313dba6209'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:22.600391 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f3734eff-372f-4b0f-93bb-c852df62fbbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '352335baa500425399e907313dba6209'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:22.601028 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f3734eff-372f-4b0f-93bb-c852df62fbbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '352335baa500425399e907313dba6209'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:22.607304 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1464/2941] 10.222.0.52 () {58 vars in 1224 bytes} [Sun Aug 28 01:05:22 2022] DELETE /identity/v3/users/352335baa500425399e907313dba6209 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:05:22.790947 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbfecf-13b0-4be3-b3a2-65d4cb5ddbc6 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:22.792813 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-92cbfecf-13b0-4be3-b3a2-65d4cb5ddbc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:22.808471 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbfecf-13b0-4be3-b3a2-65d4cb5ddbc6 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:22.869109 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54190df-a8ba-4459-9d1a-7ec80a94e2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea7ade0fdf4b01bc4d2a18f09385cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e55fe92e3a24b25b164aeab879fa6da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:22.870111 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54190df-a8ba-4459-9d1a-7ec80a94e2dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:22.870363 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54190df-a8ba-4459-9d1a-7ec80a94e2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:22.870670 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54190df-a8ba-4459-9d1a-7ec80a94e2dd admin admin] PATH_INFO: `/v3/projects/615b66d24e4f4b3bad86b1a09ad625ad` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:22.871994 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54190df-a8ba-4459-9d1a-7ec80a94e2dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=615b66d24e4f4b3bad86b1a09ad625ad)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:22.873987 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54190df-a8ba-4459-9d1a-7ec80a94e2dd admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:22.942624 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c54190df-a8ba-4459-9d1a-7ec80a94e2dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '615b66d24e4f4b3bad86b1a09ad625ad', 'request_id': 'req-c54190df-a8ba-4459-9d1a-7ec80a94e2dd'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:22.951475 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c54190df-a8ba-4459-9d1a-7ec80a94e2dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '615b66d24e4f4b3bad86b1a09ad625ad', 'request_id': 'req-c54190df-a8ba-4459-9d1a-7ec80a94e2dd'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:22.957718 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c54190df-a8ba-4459-9d1a-7ec80a94e2dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '615b66d24e4f4b3bad86b1a09ad625ad', 'request_id': 'req-c54190df-a8ba-4459-9d1a-7ec80a94e2dd'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:22.969365 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c54190df-a8ba-4459-9d1a-7ec80a94e2dd admin admin] The token cache is being invalidate because project 615b66d24e4f4b3bad86b1a09ad625ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:05:22.969656 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c54190df-a8ba-4459-9d1a-7ec80a94e2dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:22.970424 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c54190df-a8ba-4459-9d1a-7ec80a94e2dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:22.972030 dv-cinder-master-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1478/2942] 10.222.0.52 () {58 vars in 1233 bytes} [Sun Aug 28 01:05:22 2022] DELETE /identity/v3/projects/615b66d24e4f4b3bad86b1a09ad625ad => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:05:32.604052 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:32.966116 dv-cinder-master-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=65,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:09:00.028085 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3734eff-372f-4b0f-93bb-c852df62fbbe admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:09:00.029805 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f3734eff-372f-4b0f-93bb-c852df62fbbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:09:00.106720 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3734eff-372f-4b0f-93bb-c852df62fbbe admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:09:00.165983 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a57c4-7191-4da8-aa71-7d1a60756d9f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae87149f6ab04a9997263598737ae27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c69e3e973c449895457bb610103a43', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:09:00.166593 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a57c4-7191-4da8-aa71-7d1a60756d9f service placement] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:09:00.166874 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a57c4-7191-4da8-aa71-7d1a60756d9f service placement] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:09:00.167143 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a57c4-7191-4da8-aa71-7d1a60756d9f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:09:00.169332 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-eb7a57c4-7191-4da8-aa71-7d1a60756d9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:09:00.181785 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a57c4-7191-4da8-aa71-7d1a60756d9f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:09:00.183404 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a57c4-7191-4da8-aa71-7d1a60756d9f service placement] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:09:00.195122 dv-cinder-master-3-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1465/2943] 10.222.0.52 () {60 vars in 1365 bytes} [Sun Aug 28 01:09:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:09:10.190083 dv-cinder-master-3-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=58 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}